In a work environment that is already uncomfortable, I don't think trying to befriend the supervisor is the answer. It's not my personality to "suck up" anyway, and I'd just end up being disgusted with myself and even more miserable.

If I act professionally (which I do), then hopefully she will treat me as a professional (and will learn how to be professional herself).

Good news - my evaluation went very well!