Azure Windows VM cannot access file share of itself by public IP address

I made a virtual machine on Azure Virtual Machines with Windows Server 2019.

I tried to access SMB file share of the server from the same machine. But it failed.

access from: 123.123.123.123 (The same machine)
access to: 123.123.123.123 (public IP address)

net use 123.123.123.123test /user:test

The specified network password is not correct.

I tried to access it from another PC and it succeeded. The same NSG was used between the two cases. It was not caused by the NSG or firewall settings on Windows.

access from: 1.2.3.4 (non-Azure PC)
access to: 123.123.123.123 (public IP address)

net use 123.123.123.123test /user:test

Azure VMs only know their private address. I added the public address to the NIC. After that I was able to access the file share.

Does anybody know why I couldn’t access the same machine? I guess IP address is somehow associated with the problem.