Can 'It does “to” subject' be used in this context?

Wealth does not make you happy, but it does “to” me.

I don’t want to repeat the phrase “make subject happy” as seen below, so can I say “it does to me”?

Wealth does not make you happy, but it does make me happy