Apologies if this is a stupid question.
On balance it must be brown bread, because generally the milling technologies available produced a lot of brown flour and very little white flour. The technology to produce a great deal of white flour was not developed until the 1860s and only started coming into widespread use in the 1880s.