It was a scandal for Francis I because he was allying with a Muslim ruler to fight Christians. Suleiman the Magnificent was allying with a Christian ruler to fight Christians. So you can see how the situation was fundamentally different - the Ottomans were not working with the French to fight other Muslims, and thus it wasn't controversial. Or at least, I have never encountered any source which claims that it was.