I suspect that you're only just beating refresh rate + the overhead for running the reprojection so when the scene gets more complicated (low level or in the merge) it's dipping the framerate (74fps will be enough) and triggering reprojection. Try turning smoothing off and see if it still happens, if you drop below refresh you may start to see ghosting/double image of fast moving objects, particularly when looking sideways.