The past perfect use. Is this sentence correct?

Now she knew he would be unstoppable. That day, there had been no doubts inside of him when he had wielded his sword.

Is this correct use of the past perfect tense in the second sentence, considering the context?