I agree with Lisa, do what makes you happy! If you are afraid to venture away from a secure area of your life, figure out a way that you can keep your current income but persue your idea.
Life is tough, you can't let it take control of you. Everyday you are going to face difficult decisions. For the rest of your life, all you can do is make the choices that seem best at the time and don't sweat the small stuff!
Be happy, it isn't worth giving the past that much power. You have gone through some tough stuff but it is in the past.The present is just that,a present and the future can be anything you want it to be! You hold all the cards, listen to what your head and heart tell you and don't give a damn what others think. Don't give some a--h--- the power to make your life anything less than what it should be.