Bump just works on the diffuse/ spec component by bending the normals. It wouldnt work with shadows anyway.

You can plug a displacement map in to do this, the render time will be high but just bake out the shadows if you can to avoid recalculation.