Brake shoes rubbing on drum

I recently installed new brake shoes on my car’s rear drum brakes. Although the brakes are working ok I noticed the shoes are rubbing slightly on one wheel. It’s only rubbing on one spot and I can still spin the wheel quite easily. Would that indicate that there’s a problem with the drum? There’s nothing obviously wrong with the drum and the brakes are installed correctly.