Is the bold part of the following sentence problematic?

Vexed, I punched him in his upper arm to force him out of his trance.
Head still drooped, he responded by grabbing my wrist before I could withdraw my hand.

I want to express the idea of him not even raising his head while grabbing my wrist.
His head was originally drooped.