The consensus is that he did drown, however the debate is how.

Because of poor relations with the Italian states in the Holy Roman Empire. Because of this, he had to walk to the Crusade, and he drowned in Armenia. Some sources seem indicate that he fell off his horse while crossing the river in full armour. Others say he simply went for a swim after a meal.

Sources: Frederick Barbarossa by Marcel Pacaut