Sure there were lots of very physical demanding jobs but I assume most of those worker also didn't eat very well. Give what we now know about kcal and protein necessary to build a lot of muscles.
Hi, this older answer from /u/iphikrates may be of some interest to you.