Depending on the number of items in your game, I'd advice balance these effect around the premise that all characters have their full allotment of magic items attuned, because this is most certainly going to be the default situation. This makes de-attuning an advantage, rather than punishing...