The TLBs store the resulting translation. They would be permitted to store that the address was XN - but not required to store why it was XN (i.e. XN due UWXN/WXN). Therefore if you changed the setting of UWXN/WXN you would also need to invalidate the TLBs.