Difference between "saying" and "having said", in referring to the past

What is the difference between these two sentences?

I felt/feel sorry for saying nasty things about her previously.

I felt/feel sorry for having said nasty things about her previously.

Thanks a lot