I am no programmer, so I really don't know what I am talking about here, but could you not put an invisible object around the ladder to serve as the thing detected by the mouse cursor?