I want to make sure i understand the issue... you are using the vertex paint modifier to paint the mesh, and afterwards, when you collapse the modifier stack and open up the mesh to try and edit on a sub-object level, the viewport display has artifacting and smoothing group issues?