Mankind has existed for a long, long time (unless you're from Kansas) and so has our system of governments. As I twiddle away the hours of my short life on boring tax returns and menial tasks, I wonder what is recognized as history's first bureaucracy.
What great empire or small state is the first, as far as we know, human endeavor to codify laws and systems of procedures in a fashion that would be recognized as a bureaucracy by modern day society?
The oldest example of a set of bureaucratic rules we have is the Code of Urukagina, a code of laws established by the titular Urukagina during their tenure as the ruler of the Mesopotamian city-state of Lagash. It limits the power of the church and large property holders, so a pretty classic bureaucratic move. It's dated around 2,370 BC.
However the City of Lagash was clearly already established before this, and there are written records of a number of other Sumerian kingdoms pre-dating Lagash. So realistically there could be bureaucratic organizations that pre-date even those of Lagash.