I think the best way to achieve this, is to actually fake it more or less. Just make your house like you want it to be, then make a few brick parts and wooden poles and perhaps broken windows and the like. Then after the big explosion with lot's of fire, create those brickparts and other ruin-like material, perhaps even let it fly around and fall down.
I think that a brick model for every brick of your house will become terribly slow, especially when they're going to move all at once because of that explosion. However I've never tested this,
Cheers