/u/PangeranDipanagara has an awe-inspiring answer on an earlier thread:

• Before the advent of modern travel, did all Muslims really seek to carry out the Hajj to Mecca? How about far-flung territories like Indonesia?

The focus stretches into the early modern era to accommodate the written source record, but I think you'll find the answer well worth the read anyway.

I hope this helps!