Some other thoughts.
From what I understand, historically Christian men cut their hair short and favored no facial hair to differentiate themselves from Jews. I don’t know if it was specifically because they didn’t want to be mistaken for a Jewish person, or if it simply was a trend in a group like preppy boys wear polo shirts and rock band guys wear t-shirts. Now, libertarian types who hunt and work with their hands often have very long beards. Things change over time, and it depends on your specific community.
My husband had a goatee for a while and when he went on a work assignment to Bogotá, Colombia, I told him to shave to have less hassle in customs. He was flying back and forth about once a month.
Some men in academia have facial hair, but I bet statistically people with higher educations are less likely to have facial hair, and also top spot professionals, C-level jobs, I would bet money over 90% of them are clean shaven, but I think most men in America shave anyway, including blue color and even high school drop outs.
Our protectors, like our military, police, and fireman, cannot have facial hair. This might further our perception that clean shaven is more trustworthy and admirable. Unless, you don’t trust those groups, then forget I mentioned it.