It's mostly logistical issues. A sultan traveling from Istanbul to Mekka would need a huge army for protection. Traveling there and back would take months even years with a massive entourage which would destabilize the government back home and probably any province they pass through.