I see - I thought you meant that particular issue/person would heat up. My advice, you know what you want to do, it's perfectly ok, and if you are confident and conduct yourself as such you shouldn't have much difficulty. People will ask about kids, be prepared, be yourself, and you will be fine.
You're not committing the crime of the century, you just don't want to have kids. Hold your head up and enjoy life! If you expect difficulty you'll get it. If you feel good about your choices and act like it people will have to deal w/it. Good luck