How to use "If you were in my shoes "

I’m confused regarding uses of this idiom as clause
For example

If I were in your shoes , I wouldn’t have done that .

Well clearly the speaker is talking about something that has already happened and he can do anything about it
But Couldn’t the if clause be " If I had been you " since they’re referring to a past condition