I had almost the same problem... and to solve it used invisible/non-passable blocks... I placed them over the areas I had problems with (a big block for the floor and smaller blocks for collision with slopes greater than 50 degress)

It's not the perfect solution but it worked just fine for me...