It seems to happen at any distance. In my case, I wasn't even using stencil shadows (open mesh - won't work). It's ten months ago so I don't recall that well. Also, if you get the camera in the area of the shadow, the surroundings become darkened as well, even though they aren't affected by the light - the entire scene is affected.