Yes. Absolutely Old_Bill brought important points here. As far as I know the GPU manufacturers integrate physics in collaboration with Havoks. That is a tool that we cannot afford (at least most of us). But it will be supported in the big engines. So it will make it into games in the future.

But how easy would it be to integrate such hardware gpu phyisics into ODE, Newton or other affordable solutions?

Models, Textures and Games from Dexsoft