Yes. Also, your idea of who is "non-black" probably differs from people in the 18th and 19th centuries

/u/400-rabbits has previously answered Why did the early US go to the trouble and expense of importing slaves from Africa instead of just enslaving the Native Americans?

/u/anthropology_nerd has previously answered questions about whether Native Americans were enslaved