are you useing 4.5 or 5 ? which one ? looks like the photons are way to low. its not a problem with the shadows are anti-alias. Mayas software render or MentalRay ?