Touch Issue Stops Turning

When on mobile using touch to turn, if the thumb I am using wiggles or otherwise moves a bit, the section of screen with the turn buttons moves as well and it stops registering the turn. It's ruined many laps and makes mobile play more frustrating than it needs to be. Why does this part of the screen move? Video attached.