During an era of colonialism and with kingdoms like France with Colbert making protectionist laws, how did the other kingdoms keep up with the economic advantage that the countries with colonies (England, France, The Nederlands, Spain and Portugal) had?
I don't quite understand the reason why your question opposes these two kingdoms on one hand and the countries with colonies on the other. Austria and Russia were also colonial empires at that time, it's just that their colonies weren't overseas. Russia, in particular, was in the process of intense colonization of the southern steppe (more or less what is now Ukraine) and Volga region (agriculture), Ural mountains region (metallurgy), Siberia and the North-East of Asia (furs). Agriculture, metallurgy and fur trapping were the most important economic activities and huge sources of wealth. The Russian government also employed protectionist policies.
Sources: