a stainless steel or brushed metal look would definitely be manipulated more in the specular map than in the color map. it's technically all the same color, the distinct look is from the way the light is caught in the micro grooves in the metal itself.