I've used 5quidhost.co.uk for one of my own websites and recommended it to several other people/companies. The free hosting is limited in size and bandwidth but allows you to install a content management system (Joomla, Wordpress) plus pages and images for a starter website. If you like it, you can just stay with the free product - or move on to the next stage, buy more capacity and expand.
The main advantage is the quality of the technical support. Quick responses that answer the question and actually help towards a solution, quite rare and valuable!