Plus the model can get the light direction from static lights too(so they'll have bright part and dark part instead of having uniform brightness)
I am interested how you would solve this. Lightmaps are limited to mapped surfaces. But your character is moving in a 3d room.
I think, to do this perfectly we would need a 3d data block, like a complete volume covering your level subdivided into lots of small blocks (voxels?). Each of these blocks should save directional lighting information. So you could light your dynamic models very accurate wherever it is, even when flying through the room.
But it also needs bunch of memory.