Yup, I tried that. What's odd is the moment you click the OK button it goes right back to photoshop. Usually it takes a few seconds for the editing to create the new layer. But it's instantly goes back to photoshop with no new layer, now output mask, and nothing was smoothed out.