I assume "native settlers" means Portugal settling colonies with Portuguese people, England settling colonies with English people, and so on and not native meaning native Americans? If that wasn't what you meant, I'm sorry, that's how I read it though so I'll answer the question of why the French colonies had so many less people than their European counterparts. Also I would note colonies were almost always settled with people from different nationalities as well as the native people of X country; to use two examples, the failed 1555 Huguenot French colony in Brazil had Scottish settlers too and Jamestown had Poles, French, Irish and Germans, etc. along with English people.

First, a brief overview of their early colonies in the New World. As mentioned above, the French had a failed colony in Brazil, as well as a few failed ones in North America(in modern day Canada and Florida). The first longer lasting colony was in Quebec, founded by Samuel de Champlain in 1608 and it was very much favored towards fur trade for guns and the like with the native people, as you said, the first agricultural settler with a family was Louis Hebert who settled in 1617; at which point the population was some sixty people and it gradually increased mostly due to births to ~300 by 1643. There was a major gender imbalance and not enough French women(which is why women were shipped out from 1663), due to much of the population being priests, soldiers or merchants and thus Indian women were married, which was allowed if they were Catholics by Louis XIII and Cardinal Richelieu, who wanted to increase the population of the colony and turn it agricultural from its place as a merchant colony, to this purpose the Company of New France was founded in 1627 seeking to increase the population, which didn't work out. So, "While the French didn't populate their colonies due to wanting to keep peace and fur trading business with the natives," is in a sense wrong, it was less that the officials didn't want to and more that they couldn't find many people to(in part due to their own policy, to be fair). There was also more movement during the period to 1760, but overall it was only around 10,000-20,000.

Now I'd name 4 major factors early on:

1. The founding circumstances as shown above attracted merchants and priests more than farmers and later attempts to populate it with farmers failed, this led to a sort of spiraling effect where low population = less farmers & permanent development = low population, etc., whereas merchants who were attracted didn't have as big a stake and could leave if they wanted to.

2. Protestants were not allowed to move to the colonies without becoming Catholic, a lot moved to the English colonies instead. In England, religious dissidents made up a big part of colonization.

3. Quebec was given a worse view by the people in France than the English colonies were in England which dissuaded people from moving there.

4. In England, peasants were being faster deprived of land than in France where they held onto it, the inheritance laws also promoted staying on the land due to more splitting up among sons.

You can consider England the opposite of this. They had more people who wanted to leave for various reasons(religious dissidents who were allowed to go, monetary, just wanting a new life, etc.), an attractive unknown land(Utopia for example is often mentioned in relation to this, and there was much more writing to promote colonization after the initial colonies, like The Generall Historie of Virginia), more agricultural settlers which led to the colony developing and more people coming.

Now I'll give some very brief reasons for Spain had more settlers:

1. As for why more normal people were attracted, Spanish America was obviously far richer than Quebec, some finding more middle class jobs as craftsmen or merchants, some mining or farming jobs.

2. Far more women. Both Indian women and to a much smaller extent European women(for example Bernal Díaz del Castillo in Historia verdadera de la conquista de la Nueva España notes a lot of instances of Spanish women coming alongside Spanish men).

3. Need for officials and priests led to consistent peninsular migration.