Did they have thinks like ancient bench presses or dumbbells?
You might be interested in my old answer here. The short answer is that they don't seem to have had any notable tools or machinery other than the halteres (shaped weights used for the long jump). They trained mainly be practising the sport they were trying to get good at, mixed with other sports to develop a balanced physique.