Mouse sensitivity changes when moving using a controller

I use a controller to move and the mouse to look. When I start moving using the controller, the mouse still works but will increase its sensitivity at least times two. The effect is instant and reverts when I stop moving.