I have tested it now and it's only possible if all entities have a model bounding box.
Now I write me a function to do it automatically with all entities with a action attached and for fixed entities (objects) I think I could use a invisible second model for collision of buildings with the fixed objects.

Much more work but it's better than nothing to do.