That's very true. The handheld game I'm working on has a character polycount limit of around 250!!

And starting out low will also get you trained in being efficient, which, even with higher poly models, is still important.