I'm not too sure about grabbing a ledge from the top, can you walk backwards off a ladder's top and grab it as you fall? Can you jump up to a ladder and grab onto it mid air? I can't remember if I set it up so that you can only use a ladder if you are on the ground or not. As to how you'd get that to work, allow the player to grab onto the ladder even if he is airborne, that might work. I think that the ultimate way to get ladders working the best, is to have trigger areas where if the player enters it, ie walks to the top of a ladder, he automatically climbs onto it, it may be tricky to program.

@BlueBeast
I'd say the jumping is average, not the best, the jumping height changes slightly when the frame rate is low, which is a bit annoying, and you can bob in the ground and stuff when you land, otherwise it works pretty cool, the animations with the jumping are good.