How can I fix a ceiling fan with 4 lights where only 1 light works?

I bought a used ceiling fan from Craigslist and just installed it. It’s a Hampton Bay fixture that takes intermediate size light bulbs. Only one of the four lights works. The weird thing is, if I take the bulb and put it in the opposite side then that works. If I then put another bulb in its place, the extra bulb won’t work. Adjacent sides don’t work at all. Also when I turned the fan on, it was touching the little part that sticks out from the chain. The light fixture was a little crooked so I bent it back.

How can I fix it?