Random Freezing on Ubuntu MATE 20.04

I guess I sort of solved this one, but I’m still having troubles… let me explain

I recently installed ubuntu MATE on my main computer, after having good experiences on my laptop.
It ran perfectly fine for ~1 month with no issue. After that I began experiencing freezing about every hour. This was partially solved by putting "iommu=pt" into my GRUB boot parameters. Now the freezing happens much less often, about every 10 or so hours.
I haven’t found any significant errors in var/log/syslog and dmesg finds no errors either.

The only answer I found to this exact question related to NVIDIA drivers conflicting. I’m running:

Radeon RX 480 4GB

Ryzen 5 1600x

8GB DDR4 2400

and Ubuntu is installed on my 1tb WD SSD (not NVMe)

Another note, the mouse is not frozen when my system freezes, but my keyboard doesn’t work.

One more thing, The frozen screen eventually goes black with no response, only fix is to hard reset the machine.

UPDATE:
I’ve run Memtest86 free and it returned with no errors.
so I can rule out bad memory as the culprit.

UPDATE 2:
I’m trying this on GNOME (I was running on MATE before), I’ll update later if it freezes.