Yes. But you loose terrain chunking and other options that makes terrain so useful.

Use this method instead: Create your terrain as needed and let the space where your building will stand at zero height (flatten it). Then create a model based hill on top of the building to cover it. Use the same texture scale as in the terrain.