As far as the Western culture is concerned, it should be remembered that we are a Judaeo-Chrisitan culture, because the Talmud gives the age of 18 as the "age for marriage". Source 1, Source 2, Source 3

I am sure that there are likely more factors at play, but this is the oldest-rooted one which I know of.