White or Caucasian. Black, Negro, or African. Yellow, Oriental, or Asian. Red, Indian, or Native American.

What historical reasons are there behind the different naming schemes for different groups of people? For some groups a color is completely normal (white/black) but for others it is extremely offensive (yellow/red). Why is this?