Its probably the camera as you said.

If you have a camera that is tied to the player, and some part of the physics code makes the player jitter, then your camera view will do likewise. One thing that is useful in writing physics code is tolerances. Don't have code that says if your player elevation is above zero then fall, if below zero then spring up. The times that I have experienced jittering in my physics code is when I didn't allow tolerances, and also when I expected movement to be instantaneous. Don't have your camera or your player move the entire distance in one frame. Spread it out over several frames, maybe as much as a few seconds worth even.

These are the most useful pieces of advise I can offer without seeing the code.