This is going to vary widely but if you're like me and are essentially doing all the work yourself then your expenses could be very low.
In my case, my greatest single expense is web hosting. I'm paying $270/month for a dedicated dual-core web server with Windows Server 2008 and SQL. I went the dedicated route because I'm doing a few automated tasks with the web server that a shared hosting provider wouldn't allow. Plus the performance is nice to have. But you could easily pay less with shared hosting, or a virtual dedicated hosting service.
Then there's advertising. Of course if you're offering something truly remarkable, the website can spread by word of mouth and you may not need to advertise. I have one product that doesn't really need advertising, and another that does.
My monthly expenses are something like this:
- web hosting - $270
- advertising - $100
- merchant account fee - $20
Then throw in the occasional big purchases like enterprise software and such. I've spent over $2,000 on software during the past two years. And I did hire a lawyer to write some agreements for one of my sites which had more legal complexities than other sites I've done. That was about $1,500. Beyond that, there hasn't been much. Like you said, when you're a one-man show the biggest investment is time.
My plan is to do all the work myself for as long as I can. I want the company to be profitable and healthy before even considering hiring other developers. The stakes are higher once you start hiring. And as Alain stated, payroll will be the greatest expense by far.
Cloud Hosting
On the subject of web hosting, I just wanted to make a few points and suggest a few things for you to look into. As we discussed in the comments, it sounds like you're attempting to build a website that could potentially see a lot of traffic so it'd be good to choose something like Windows Azure, Amazon EC2, or Google App Engine. There's a discussion here about these 3 services. The pricing is very competitive with these services and they make a lot of sense for high-traffic websites.
Efficiency
You have to keep in mind that these services charge based on compute time and server resources. So to save cost, I think it's important to start with an efficient server-side language and database engine. Twitter made the mistake of building their site with Ruby, which is one of the slower web-friendly languages in existence. C# and Java are compiled languages and either one would be a better choice, depending on what you're more familiar with. If you're curious, here's a list of benchmarking results showing the raw number-crunching horsepower of various popular languages. And here's a slightly more realistic benchmark heavy on string manipulation. Java is 67X faster than Ruby in the first benchmark and 14X faster in the second. Of course most of the time the bottleneck is actually going to be on the database side of things and the two most popular choices out there (Microsoft SQL and MySQL) are very well optimized. But when you're concerned about scalability, even the web framework matters. So yeah, don't use Ruby.
Content Delivery Network
And then you should host static content (images, css, js) with a CDN (content delivery network) like Amazon CloudFront. They are ridiculously cheap. I was paying them around 10 cents a month. Of course my sites were only getting around 500 visits a day collectively at the time, but still it's a bargain.