I tried this once, you've got the easy part finished...

You obviously can't have all bricks actively physics enabled, it wouldn't be usable. You also have to find a system for bricks to check their attachments. I tree-like scan that tries to find a solid (ground) so they now if their still attached to something...