When using shadow depth maps:
To get the best quality when "Use Dmap Auto Focus" is turned on, make sure the large floors do not cast shadows.
When large floors cast shadows, the region for the shadow map covers a much larger area so the shadow map precision is lower for the areas of attention and may shift over an animation.
Try turning off "Use Dmap Auto Focus" and determine the constant angle of focus for the light that works throughout the entire animation
Israel "Izzy" Long
Motion and Title Design for Broadcast-Film-DS
izzylong.com