How does the descending gradient know what weights to adjust?

In general (or at least the basic implementation for the gradient descent), you apply for each iteration the update rule for each weight, using the partial derivative of the loss function with respect to that weight, as follows:

All the weights are updated while backpropagation in the gradient decent algorithm. The amount of weight update is determined by it gradient and the learning rate.