There are several interesting reasons for this, and it is still a hotly debated topic among historians. Here are a few theories.
It's important to remember that the population of France did grow tremendously - just less dramatically than Britain or Germany. Demographic history is a very difficult subject to get a handle on, especially considering the difficulty of obtaining records from the time. For more information I'd recommend A Short History of the Industrial Revolution in Britain (which contains a lot of comparisons with France), Barbier's Scarcity and Frontiers, Weber's Peasants into Frenchmen, and Malthus' works on human populations.
This question has been asked a few times: try checking these posts for supplementary answers
http://www.reddit.com/r/AskHistorians/comments/1rg0qy/why_did_industrial_era_france_have_a_smaller/
http://www.reddit.com/r/AskHistorians/comments/1kyoqh/what_was_the_cause_of_frances_low_population/
http://www.reddit.com/r/AskHistorians/comments/xdw65/what_are_the_factors_behind_of_the_slow/