It's not just you, I really should of added a pause before the lift starts moving (even a normal size model will slide off of a lift if it moves fast enough).
But, yes, you really want to reduce the size of you models. For most games, over 80-quants for an average size player is overkill.