I just realized that I was doing something different and maybe that's why. I was opening the Browsers panel > Project and then just select Unused > delete them both from Logic and the hard drive. But that was keeping the regions and the parent files intact.