The main problem you are having is the shadows...

Stencil shadows run extremely slow right now. Hopefully a new, and faster way will soon be created. Especially slow if your models are not simple closed meshes. The biggest performance hit comes with models not being closed, or so the manual says.