Maybe some invisible box (ledge_box) along a ladge and check if players hand (vec_for_vertex) is in passable && you == ladge_box then grab? But its only sugestion, I've never used this.

Never say never.