So I was having this problem and playing games in Fullscreen (windowed) didn't fix it. I found the issue was that my main monitor had the option 'play HDR games and apps' while my second monitor didn't. Disabling the option on my main monitor fixed the issue