I totally agree. There is nothing wrong with starting with a single stage, and for some people that might be all they ever need or want. I did all my loading on one for years. If you do that and eventually move to a turret or progressive you will still find uses for the single stage press. On the other hand if you know you are going to want to move up a turret is a better place to start because as you gain experience you can move ahead without additional expenses. Either one is a excellent option.
The biggest thing is that you need to start by educating yourself, and I don't know of a better way than to start with the book Wes recommended. Then ask questions here when you need to.