This an excellent question that i've covered to some small extent here, discussing the situation of Asian and Hispanic Americans during the Jim Crow Era.