Barn doors that angle into the entry way

Without a bottom track, I can think of three issues:

The wall is not vertical (plumb) but the doors are.

The doors are not plumb, which means they are not attached correctly to hang straight underneath the track support (such as you mounted the door on the wrong side of the hanger.)

There's an air current pushing the doors into the wall (such as a duct blowing into the space and a return on the other side of the doors.)

You need a Floor guide. Most are installed on the floor, sometimes they attach to the wall at the base of the door.

They come in a variety of kinds, some just plane plastic, some with rollers, some adjustable ETC.

You can buy them or you could make something from materials you already have on hand. It really is just a tab or roller that keeps the bottom of the door from swinging into or away from the wall.

You should check with the manufacturer of your doors track/hardware to see if they have one that matches the spacing of the tracks you have. If not it will not be difficult to place one at the appropriate distance from the wall to match that spacing.