I've got my problem solved. Now I need to add ladder climbing, platforms and some tweaks before releasing the source code (it will be dirty but yet useful).
Edit: added ladder! it's still not finished yet, so no source code, just a demo for you guys to give it a try. If you'll find any issues, please let me know. Here it is: Download link