Can you play COD: Ghost with someone who has the 360 version downloaded to his Xbox One S if you have the gold edition on your Xbox One X?

I have an Xbox One X, my son has an Xbox One S: We both have Ghost. I have the gold edition from Xbox One, he has the 360 version he placed on his Xbox One S. However it’s not letting us play together. Why?