Just to make it clear, it does happen while scrolling towards the right and the bottom? But not when scrolling to the top or left?
Are you maybe running the game in a virtual machine? All virtual machines I've tested had the same issue.
Can you do a test? When it happens, press CTRL+TAB to unlock your cursor from the game and then just click once to lock it again. Does that fix the problem?