Surely it can't be a coincidence that multiple cultures spread through time and geography would all pick the same group?
Is it just a matter that they're a relatively prolific group that appeared in multiple cultures over time and as another group took power they became the proverbial punching bags?
You might be interested in this earlier answer from /u/yodatsracist: