To be clear I think his concerns were not directed at hordes of paper pushers and government agents. It was more a line about fear of unfettered democracy and a Tyranny of the Majority. That without the British government what benefits would possibly devolving to mob rule offer was his point.