In 1922 (the greatest extent of the empire, population wise) 458 million people were subjects of the English crown. This BBC page has a good breakdown. At this time, the empire controlled the most territory of any empire in history, along with ~25% of the world's population.
It was not, however the largest empire ever as a percentage of the world population. A few larger empires:
The main takeaway here is that while the British Empire was large in area, there are a lot of people in China, and there have been for a long time.