Thank you for sharing your experience. I don't have this particular type of allergy but I have a friend who does, and she could completely emphathize with you.
We were involved in a workplace stretching class where we were going to use latex exercise bands to do some shoulder and neck strengthening exercises. As soon as the latex bands were passed out, I could see by her face that something was wrong. She wouldn't even touch the band or the paper that the band had touched. I had no idea she had latex allergy before that. I felt so bad for her that she couldn't participate in the exercises. If only there had been a latex-free band available for her.
This just points out how widespread this allergy is and how important it is to ask the "Do you have latex allergy" question, even in an exercise class.