Mouse proofing ground-level siding

This is our second winter in our house and have been noticing mice ever since it started getting cold. I’ve been examining the exterior of the house trying to locate intrusion points which I’ve been sealing up with steel wool and caulk. The majority of the exterior at ground level is concrete foundation but one area on the side has vinyl siding which extends to ground level.

While examining this area today I noticed pieces of insulation on the ground indicating mice could be burrowing under this area but I have no idea how to seal it up since it extends along the entire side of the house. I slid a finger under and there is a big gap to the other side but I don’t know what the other side looks like and am trying to avoid removing the siding if at all possible.

What would you recommend I do to prevent intrusion in this area?