No, but get "risk-averse" out of your vocabulary. Any new venture carries risk. It requires an investment of time and money. If you really were risk averse you would be asking about insurance and IRAs; how to invest in gold lest the Dollar plummet, etc...
The answer is not to give up on your dreams, but rather to learn to manage risk.
It's not as easy as before (believe me, I know): You need to have the full support of your spouse to begin with. You need to set up budgets (gotta feed the family first), you need to strike a time balance (can't abandon your family because you're working all the time). You need to leverage resources very well (ie, don't waste time on online forums, hehe).
Finally, you need to put a very high value on time. It's the only resource you cannot make more of. It's finite. Don't watch TV, don't work more than you have to at your day job, don't steal time from your family; those are all things you need to take into account.
Don't underestimate rest either. You can learn from long-distance runners: They quickly learn that the most important and strategic part of training for a race is the time they rest. If you are not rested, you are not performing at capacity. You need to put in quality time, not a lot of time.
But it is possible though. Startups are not just for single 20 year olds. Those extra years of experience give you the tools you need to leverage resources and use time better. Read "The 80/20 Principle" book if you have not already.