I don't have an answer for you on why the male is doing that and the female isn't. Birds can be emotion-sensitive - perhaps he's picking up on your worries.
Your frustration and impatience aren't going to help them, Phillip! Honestly, sit back, relax, and enjoy HAVING them. When they're ready they'll get it together. In the meantime, why not join a few of the Yahoo bird chats? You'll continue to learn more about breeding so you'll be prepared when they are successful.
About taking the eggs out ... you can BUT what if the same thing happens again? Will you pull them again as quickly? If so you run the risk of wearing out your female and hurting her health by provoking her to lay continuously. I personally think you should leave the eggs in there the amount of time they would normally take to incubate. It at least gives the female a chance to get ready for the next go round and keeps them in a natural cycle.