On religious grounds rather than race and skin color
This question is based on the premise that there were Muslim immigrants, other than Muslim slaves from Africa, in the Americas. I doubt this is the case, is there any evidence that there was a free Muslim population in pre-civil war America?