The same reason all of Christendom didn't unite to prevent the Muslims from taking Constantinople. "All of Islam" represents diverse kingdoms, traditions, cultures, and sects that all had conflicting interests.

Just as England and France had no real reason to prevent Constantinople's downfall, the inhabitants of now-Libya had very little concern for the religious fate of the Iberian peninsula.