I picture everything in varying shades of burlap and smelling of mud and feces.
/u/mikedash has a wonderful post on smell as a historical subject, especially in medieval cities.
After that amazingness, I'm almost embarrassed to link it, but my answer on the wardrobe size of an English peasant talks a little about color (see also the early follow-up questions).