Have you tried installing the base xfce desktop package called "xfce4"? Installing that will install the base xfce desktop, without all of the extra packages used by Xubuntu (eg, gnome-dependencies, xubuntu artwork, etc). This way you wouldn't have more than one text editor, update manager, cd burner, audio player, etc (because thay are all required by Xubuntu).