Which part of the middle ages are you asking about? The Umayyad Caliphate stretched from Spain to Persia and had a population of over 30 million people, living on some very productive land and very lucrative trade routes. Yes, some of the land was desert -- but the Arab heartland borders the Fertile Crescent and the very farmable flood plains of the Tigris, Euphrates, and Nile rivers.