IBL will elimanate many things you are currently doing. It also provides more accurate calculations and you can see the HDR in the viewport. I recommend you to go through the help files to unserstand all the options for the IBL.