invert the spec map that you would use on the specular colour and apply the inverted map to the diffuse.