For stuff like that you should use local coordinates (e.g. a camera-bound triad) and move the stuff around the camera, not vice versa as is usually done.