u/chocolatepot and u/cdesmoulins previously provided answers to similar questions for medieval Europe through the 19th century here and here.
u/Tiako answered a similar question in the context of ancient and east Asian history here. Their response also includes a relevant qualification about the extent to which we can draw inferences about what past cultures found attractiveness based on the art they left behind.