In what ways is the NFT marketplace different from the stock market?

But stocks are backed by companies, and the stocks themselves pay dividends to their owners. From what I understand this is not the case with NFTs. This means the only goal with NFTs is resell what you purchase to pocket the difference.

Not all stocks pay dividends. Almost all investors expect to sell their shares for more than they paid for them.

The difference between shares and NFTs is that most people buying shares do so through a well regulated marketplace, that has national regulations. The marketplace for NFTs isn't regulated.

There is debate about what you are buying. The definition I like is that you are buying a window in a museum. Today that window looks of a item that is desirable. In the future, after a reorganization, that window might look at a storage room with no lights. There have been stories that in matter of weeks after buying a NFT, the purchaser found that the "item" had disappeared, and the url returned a 404 error. But they now owned the 404 error message.

The NFT market can be likened to the fad of naming a star in a star registry.

Can buyers also attempt to monetize their NFT by licensing it out (like an icon or logo)?

No, they cannot. Buying an NFT does not transfer the copyright to the underlying work, and the copyright is what you need to own to license or otherwise restrict the use of the work. In fact, the underlying work is typically hosted at a public URL that anyone, not just the buyer of the NFT, can view. You can even have multiple NFTs created on the same work. In this respect, buying an NFT is similar to buying a signed, numbered limited edition. Other people can still get the regular version of the work at the going rate (which is usually free for online resources), but your version is "special".

As you point out, buying an NFT isn't much like buying a stock. With a stock you are buying a share of a company that will (you hope) make profits. It will then use those profits either to pay out a dividend or to reinvest so as to grow its business and make even more profits in the future. These revenue streams, and the prospects of future revenue, are what people mean when they talk about the "fundamentals" of a security. NFTs have no fundamentals.

Then again, people buy lots of things that have no fundamentals. The traditional art market is a perfect example. So, it's worth asking, how do NFTs compare to investing in traditional art. The main difference is that with traditional art you actually receive the artwork in question. You can hang it on your wall, and if people want to see it, they have to come to your gallery to look at it. (Various kinds of reproductions may exist, like photos or prints, but they're generally of inferior quality to the original. That's why people still go to art museums.) None of that is the case with NFT art sales.

Likewise, with traditional art sales, the way people know you own the work is that they see it hanging on your wall and not somebody else's. With an NFT the only way they know that you own the work is if they go look up who owns it in the registry stored on the blockchain. Right now, basically nobody ever does that. Will they do it in the future? Who can say?

Am I missing something?

No, not really. NFTs are an attempt to replicate for digital art and music the characteristics, especially scarcity, of physical art, and it doesn't really work very well. If your concern is for artists getting paid for their work, platforms like patreon and bandcamp are a better way to do that. If you're looking for a speculative investment, there are lots of things you can speculate on, many of which are more likely to make money for you, and almost all of which have lower transaction costs (selling an NFT typically involves a 10% payment to the originator, plus whatever transaction fees that particular blockchain is imposing). And if you're just looking for a way to show off how much money you have, there are better ways to do that too. At least if you pay to have your name put on a building, people will see it when they walk by.

I don’t want to write a whole answer but

But stocks are backed by companies

Stock is not backed by the company it IS the company. One share of a company is ownership equal to 1/1,000,000,000th (or whatever depending on the number of shares issued by the company) of the company’s equity. You have a claim to that much of the company.

Someone “bought” Jack Dorsey’a first tweet. That person didn’t buy the tweet, it’s still on Twitter. That person bought a token containing the tweet. It’s not clear if that transaction, sold by the founder and CEO of Twitter, even includes a license to republish the tweet. When you buy an NFT you’re not buying art or a tweet or a news article or a music album you’re buying a non-fungible token. You’re buying a token, not anything else. It doesn’t innately give you rights to anything other than the token. With a different salt value you can make another NFT of Jack Dorsey’s first tweet, the code just won’t be exactly the same as the other “Jack Dorsey’s First Tweet” token, so it’s not fungible. And I’m not sure there’s anything stopping me from getting on one of these exchanges and selling an Elon Musk tweet, even though I didn’t author it, I didn’t publish it, I don’t host it, I have no exclusive rights to it or any authorization to sell it; because I’m not selling a tweet I’m selling a token.

What’s the market value for an arcade token from the 1980s? What if I laser etch a picture of Elon Musk on it? That’s essentially an NFT, only better, because I can hold it. I have one but I’ll only sell it for $100,000, and no other one will ever be exactly, to the micron, the same as this one.