This would heavily reduce the frame rate, but maybe a second, extended view frustum for shadows could be a solution.