Nvm, I got it. Part of the problem was that I didn't have any rotations. Also I had problems to construct a right vector when the up and front vector were parallel (which is somehow logical since there're endless possibilities for the right vector).

Thx all for your help