Are you using the hdi as a light source?
Just use it to fill in the blanks for the reflections and refractions. Keep your render quality and raytrace quality really far down while you get your lighiting right. Shove a lambert on everything so you can see how the light is going over your scene, get some color variation, have a keylight, with variation on the fill lighting. It looks a little flat at the moment.