This is normally the case when the deadzone of the joystick isn't configured correctly and the device sends input although it's actually centered.

Always learn from history, to be sure you make the same mistakes again...