I would use a smooth proxy for 1 half of the model about now, since youve got the basics there.

I then would keep tweeking and adding to the low poly, using the proxy to evaluate the changes.