You could use a LOD system so that the isides of the buildings are not created until the player is really close to them. Even one floor at a time.

Your use or colour and texture is beautiful.