Not at all. Think about going on a "date" with someone. If you didn't particularly enjoy the date's company, will you go out again? It would be silly and encouraging the other person, which is rude.
You still should say thank you at the end of the evening, because, after all, you were a guest in someone else's house. However, inviting them over would encourage a friendship, and since that is not your desire, I wouldn't do it at all.