you can adjust the colour gain to -.5 (I think its the colour gain) that way that evers mid grey comes out as being even, darker and its lowered and whiter and its raised.

Its the way Zbrush makes displacments so you have to do that to get your displacement looking right,