There's a prior AskHistorians thread with an interesting note about goatees as a marker of social protest at one time: https://www.reddit.com/r/AskHistorians/comments/1fwcrr/how_was_facial_hair_thought_of_throughout_the/

And an AskHistorian answer with information about shaving here: https://www.reddit.com/r/AskHistorians/comments/5uyd6o/did_ordinary_people_in_roman_empire_shave/

Fun fact I learned from the latter answer: Nero cultivated a neck beard.

But, while both prior answers are relevant and interesting, neither of them directly answer your question of whether some sort of aversion or disgust lay behind facial hair fashions. I'll watch with interest to see what the more knowledgeable folk around here have to say.

***Edit: Prior answers provided by users such as Celebreth, batmaaaaaaaaaaaan, and Ben__edikt. Whoever you are, Ben__edikt, I'll be quoting you on neck beards and Nero the next time I see someone sporting a Nero neck.