would have to be an elite spec that "takes away attunements"
one idea i have is that the attunements become tomes like firebrand tomes mixed with engie kits (no page limit instead all tome casts cost an energy mechanic that builds up while out of tome). when not using an elemental tome your weapon skills are a neutral "arcane" attunement.