Aragorn,
It was such an open-ended question, I felt that I would wait for some others to do the hard work of replying first and Martin has done a great job.
Your point about on-line ordering suggests you have a commercial site in mind and for this, it isn't worth messing about with any of the so- called free sites in my mind. You need to find a web host that offers a load of auto - installable stuff like "shopping carts" etc. - even if you don't plan to use them straight away.
The good news is that there are plenty of such hosts - I use USA based hosts because they are cheaper and tend to offer more. At present I use Hostdime which is a pretty reliable outfit that can also register and manage a domain name for you at a reasonable price. Please note the hosting a website and registering domain names are separate activities that do not need to be combined but usually can be if you wish.
The bad news is that any site with commercial pretensions will need a lot of work to keep it fresh which is vital if you expect people to buy through it. Freshness is needed to get a decent search engine ranking and also to appeal to visitors. Good content is also vital, a few pictures and an amateur looking site will sell virtually nothing.
This said, a commercial site does not need a lot of bells and whistles - the fewer the better really but whatever is there had better be good.
I use Dreamweaver to do my sites. I started with Microsoft Frontpage but found it a real pain - reasonably easy to use initially but its propensity to create all sorts of unnecessary files and scatter them around my site drove me up the wall.
A simple site as you are proposing should not need a lot in the way of automated site management and I suggest you steer clear of it until and unless you find it absolutely necessary. (It is a bit like cutting dovetails by hand or with a jig and I am arguing that you should do it by hand to start with) . A "hand-built" site need not be complicated and you will develop a feel for what needs to go where. There are a zillion free or nearly free Wyswig editors around - I suggest you try this one
http://www.nvu.com/ which is from the same outfit that makes the Firefox open source browser.
So:
1. Pick a domain name and see if it is registered - if not do so.
2. Register the domain name at a webhost you plane to use if they offer this service
3. Create the simplest page you can think of in an HTML wysiwig editor and upload it to your site using either the built in FTP of the editor or a separate FTP client or even the file manager that the control panel of your website (something the web host provides). I prefer a separate FTP client and again there are good free ones like Filezilla or SmartFTP
4. Test your page(s)
5. Use the Script installer on the control panel and install a couple of things like a PHP bulletin board or picture gallery to get a feel for how these things work. When you have seen how to (say) upload pictures, edit them and so forth in your new PHP gallery. then you can try your shopping cart.