In the Mediterranean region ice trade developed in ancient times. Ice was harvested in mountains, transported to cities covered with hay and sawdust, stored in pits or buildings and sold to those who could afford cold. So cooled desserts on a desert were available but not affordable- as late as XIX century the Sultan of Zanzibar served his guests citruses on ice as a show-off. Source: Ancient Inventions by James Peter

I remember that it was after his victory at the battle of Hattin that Saladin was said to have offered chilled rosewater made from melted snow to the captured king Guy of Jerusalem, who in turn handed the chalice to the infamous Raynald of Chatillon. Saladin, watching as Reynald drank, said to the conquered king 'You handed him that water, and not I', implying that while Guy remained under his protection, Reynald did not. Source: Maybe Runciman's History of the Crusades?