You're tracing to the camera's position. When the camera is in front of the wall, the trace hits nothing, so you're putting it back at the old position. I recommend keeping track of where the camera would be if there were no obstacles, and trace to that position always.
