Everyone's digestive system and how our bodies process food is different. Perhaps there also could be a natural aversion to some types of food that our brains subconsciously believe is "bad" for us (as in presenting a health risk). Let's face it, what makes blue cheese blue is the particular type of mold. Mold is a bacteria and humans generally view bacteria as a health risk.
This is an evolutionary reason.
There is some research that shows some of this may be inherited in our DNA from our ancestors so maybe if not you, Lisa, one of your early ancestors might have experienced a strong negative reaction to this type of mold.