This checkbox is supposed to place a light that's static and dynamic at the same time, i.e. it casts dynamic shadows and lights the diffuse part of a material.

You say they don't act this way? Do you have a level where this happens?