paint the dirt into your texture map, or use a layered shader to a procedural dirt texture on top of the normal wall texture (you could control where the dirt goes with a greyscale painted UV map)

Alan