How do I make item frames unbreakable in Adventure Mode without locking the item inside?

I’m trying to make a map and the players in adventure mode can break item frames, so I’m trying to change that.

I’ve searched it up and both the Invulnerable tag and the Fixed tag don’t work for me, because the item frame becomes unbreakable, but it also prevents the item from being removed.

I want to make the item frame unbreakable, but I want to be able to take the item in Adventure mode. How can I do this?