For wheat, the change came as white bread became more popular and more people began to be able to buy it around the 18th century. A lot of this can be drawn as a reaction to declining food prices brought about by the agricultural revolution that made it feasible for people, at least the middle class and up, to be a bit more selective (removing the rough bran and stuff from the wheat).