In ancient China, Egypt, India, and many other ancient civilizations women would stain their nails with henna or various other red stains. Before the invention of enamel paint for nails, almost all of the nail colorant mentioned above are dyes that stain the nail instead of layers of paint that strengthens the nails like modern nail polish.
But for the most part people went without painting their nails.