https://upload.wikimedia.org/wikipedia/commons/4/4d/George_B_McClellan_-_retouched.jpg is an example. I never understood the reasoning for this. I think Napoleon did it as well, so it predates the Victorian era.
More can always be said (I think it’s a requirement to include that) but this comment by u/LadyVagrant answers the question well I think.