Sexual attraction is hormonal and chemical, and being attracted to another woman does not necessarily mean that you are a lesbian. It's quite possible that while there is strong chemistry between you and this particular woman, you may not find it with other women. Many people who have been in this situation would never admit it.
The fact that she's married would prevent you from initiating a relationship, and the fact that she's our boss would make it difficult to talk to her about it, so you're between a rock and a hard place!
If she is approachable, you may want to discuss it with her. This would get things out into the open and relieve tension, and in her experience as a lesbian she may have some advice for you.
If not, you may want to speak with a gay friend or to a counselor to find ways to explore this new issue that has come up for you.