Does a musician under an LLC have to file a foreign qualification for shows in other states?

Being a musician isn't that different from other businesses in this respect. A company has to register or qualify in a state if it is "doing business" in the state.

Whether a company is doing business in a state is a very blurry line. If you have an office or employees working in a state then you are definitely doing business, but occasional visits to a state for business reasons would generally not rise to doing business. See this article for more details.

If you go on tour to a bunch of states, then I expect you are not doing business in those states and don't need to qualify. If you have a weekly gig in another state that is close to your home, then you probably are doing business there and should qualify.

If you are somewhere in between and are not sure, then you can probably get away with not qualifying, especially if your revenue is small. It is not uncommon for small companies to neglect to register in other states, and it is hard for states to enforce this especially since the "doing business" requirements are very vague.

This is like asking a barber if you need a haircut. The state will always say yes.

The consequences for not registering are often times non-existent even if the state notices. Some states even have retroactive limited liability if you need to register a business just to use their courts.

This is worth ignoring.

This changes if there are revenue/income tax obligations though.