Well, how and where are you praying? Is it the act itself? Do you feel claustrophobic when you talk to other people? Praying is just talking to God and you can do it anytime anywhere. Some believe that it must be a grand event like literally going into a closet with grandiose words and long periods of time. There is nothing wrong with this, but if Christ is our example (which He is for the Christian)this is not how He prayed. He simply talked to the Father, honestly, often, in a Garden, on the Cross, with friends.