Boot into Safe Mode (on Apple Silicon; shutdown, keeppower button pressed until it tells you its loading safe mode) before doing the xcode update. It resolves the variety of issues being reported.
The install itself can take 10-20min on top of the download time.