Removing saved custom colors from "favorites" in ArcGIS Pro

This is easy to do in ArcMap via style manager but I have spent half an hour trying to figure this out to no avail in ArcGIS Pro.

I accidentally saved some duplicates of custom colors and it says the colors themselves were saved in "favorites." Managing that folder only shows a saved polygon symbol and none of the colors I created.

How do I remove the colors I’ve saved?