The important factor here is not the individual soldier and his equipment but the way the soldiers were organised and used as a whole. Rome employed a standing army of professional soldiers who were well trained and organised to fight as a unit (and those units to fight as part of larger units and so on), whereas many of their enemies were just bands of fighting men.

Once you have a properly organised army you can use tactics and strategies that require a higher degree of planning and discipline.