"I'd go careful OR carefully with that"

I have recently used this expression in an answer on another site:

This is not a frequent structure and I should have more knowledge in the field to discern if you can say that about algorithms. You can be original and use it, but I’d go careful with that nonetheless.

While proofreading my answer, it struck me as a rather strange expression. It doesn’t look grammatical and I am aware that it is colloquial. When I look it up online, some dictionaries correct it to "go carefully" (which would be grammatically more acceptable) or just define "careful" instead (Google).

However, I am sure I picked it up from native speakers, it just sounds so natural to me. My question is, in this context, are these two sentences perfect synonyms?

I’d go careful with that.

and

I’d go carefully with that.

Do they both mean, "I’d be careful with that?"