How would you do specific origins to specific destinations using network analyst in ArcGIS Pro?

I’m working in ArcGIS Pro 2.5 and I have an Advanced license.

There will be 2 datasets:

1. about 400 points for origins (ZIP centroids)
2. about 40 points for destinations (healthcare facilities)

I already have a ZIP polygon feature class containing the number of visitors by ZIP going to particular healthcare facilities. Because of this, I already know which combinations of ZIPs go to which healthcare facilities. I previously used this feature class for a map series project (data driven pages in ArcMap) and set a page definition query to only display the amount of visitors by ZIP for one healthcare facility at a time. I know I’ll need to convert the ZIP polygons to centroids, but I’m trying to determine the best approach to use the dataset to calculate the distance and drive time from each ZIP centroid to each healthcare facility.

So far my thought is that I could use OD Cost Matrix, load my ZIP centroid locations, and load 1 healthcare facility destination at a time, then solve. I imagine it wouldn’t take long for each run with that amount of locations, but I’d still need to do that x40. Is there a better way to do this? I was thinking Route, but I’m not sure it’d be any faster. Is there a quick way to do that with ArcPy? Basically, I want to calculate distance/drive time to each of the 40 facilities for all 400 ZIPs. I don’t need the lines, just the table.