Is "deterred" appropriate here?

There would have to be previous sentences or conversation that establish the beard as an obstacle or something that would deter (beards don't typically do that). If the listener/reader is unaware of this, you need to use a different word, such as "intimidated" or "worried".