Some resources to help you on your way:

Web Hosting:

• Justhost – some of the web’s cheapest hosting – and it’s really easy to set up WordPress and get your blog or website up and running for non-technical people.
• Webnet77 – good middle of the range solution. If you’re streaming video / audio from your own servers, they give unmetered data packages, which basically means “as much as you like as long as you’re ethical”
• Rackspace – when you’re one of the “big boys”, and need your site to be up 99.999% of the time. They say “fanatical support” and in my every experience, they’ve gotten back to me within minutes of my query. Little pricey if you’re starting out, but totally worth it!

Email Management Systems:

• AWeber – The “Google” of email marketing – the gold standard. It’s the same tool I use to run all my mailing lists. Cheap & incredibly easy to use. Excellent delivery rates.
• MailChimp – similar to AWeber, also great – different billing model, charging for mails sent instead of a monthly flat-rate.
• GetResponse – as good as either of the previous two, if they’re not your flavour

Web Design Tools:

• Wix – yes, it’s a weird name, but it’s super simple, drag and drop web design for musicians. All in flash, which I’m not nuts about, but it’s free and really powerful. Probably my favourite non-Wordpress option.
• Sayvee – I like it too. VERY easy, got all the functionality, but you’ll have to deal with a one-page site. Nothing wrong with that, but it’s quite simple. Hilarious marketing videos…

Shopping Carts:

• PayPal – Lets you accept credit cards in minutes. Easy for anyone to set up and use, and it’s reliable. Great if you have just a handful of packages to sell.
• 1Shoppingcart – Highly recommended as an email management system and shopping cart  connection system. Lets you customise your shopping cart look & feel, and you can set up a merchant account through them too.
• Interspire – my favourite store package – you can get a store and shopping cart set up in 15 minutes, looking beautiful. (They also have an amazing self-hosted email management service I highly recommend if you prefer that to Aweber/etc. – 1 off fee, instead of monthly)
• Mals-e

Miscellaneous:

• Ping.Fm – tool to update all your social networks in one fell swoop (free)

Songwriting Help

• SongsAlive is an awesome, “fully-featured” songwriting community. They have workshops, help you network, offer critique and feedback, and help you promote your songs. Very nice people too.
• The Ravenous Raven Twitter Songwriting Community – pretty much what it says. RR is full of short, concise tips on songwriting. He also has a Facebook and LinkedIN page.