If you want someone to be able to watch without impacting latency, you can do that simply by removing them from any of the controller slots. If a spectator's computer lags, the actual netplay match won't be disrupted and the spectator will simply fall behind.