I got the same problem with too many physics objects too close together. Just has to be managed.