If "time_step * 5" is larger than the absolute difference between "temp_ang.pan" and "my.pan", the rotation will overshoot the target angle and cause the entity's pan to shake left and right repetitively (as the target angle is never reached).

If the camera angle depends on the entity's angle (this is what I assumed) the camera will shake, too.