I've done a bit of digging here to figure out some of what is happening. It's not related to reported clock speed from the CPU. It's also only worked around by the legacy power plans in windows. If you change the new windows "power mode" it does not work around the issue.