The Bureau of Labor Statistics was established in 1884 as part of the Department of the Interior. In 1903, it was transferred to the new Department of Labor and Commerce, along with the Office of the Census. In 1913, when the Department of Labor was established, they took the Bureau of Labor Statistics with them, but the Department of Commerce kept the Office of the Census.
The Office of the Census was established in 1840 and it was an independent agency, until 1903. The kind of information you are looking for might be found in the Office of the Census, between 1840 and 1884, but since I have never worked with this data myself, I do not know how extensive their information is. Prior to 1840, there was no centralized office that collected and collated Census data, so you probably will not find any reputable government statistics, on the federal level, prior to 1840.