Arabic is better understood as a language family than as a single language, analogous to how Latin fragmented and adapted through contact with European languages to become the modern Romance languages. The difference between Moroccan Arabic and, say, Egyptian or Gulf Arabic is at least as great as the difference between Spanish and Romanian.
Also, some small populations in North Africa do still speak other languages, such as the Berber dialects.