The Oxford English Dictionary, which is the most reliable tool for tracing word derivations, suggests the word is "probably an alteration of neger n., after classical Latin niger."

"Niger", in turn, was a term used to describe a type of black stone, possibly jet.