How would the momentum of photons affect the stability of a Dyson sphere?

So a body surrounded by a shell experiences zero gravitational force, but how would the momentum of the photons affect a shell around a star? It seems like more force would be exerted on a near surface because it absorbs a higher density of photons per unit of area. Would that make a hypothetical Dyson sphere non-gravitationally stable around a sun?