Xcloud on Android, games say controller not connected, but it is

Just been trying to use xcloud on my Huawei p10 pro, I blue toothed my xbox one controller to android and it seems to work as it can use the d pad to cycle though icons on the phone, but when I start up a game on xcloud the game says please reconnect the controller. Any idea whats wrong?

Thanks