camera.x = player.x;
camera.y = player.y;
camera.z += clamp((player.z-camera.z)*0.1,-5,5)*time_step;

I don't really understand what you are trying to do, but try my code example above.