Fleur-de-lis was at first a religious symbol. It is believed that the flower of lily was used to baptize King Clovis I. It is likely that the kings of France therefore kept this flower to commemorate their ancestor's (all kings of France were his descendants) conversion to Christianity. During the 12^(th) century King Louis VI and King Louis VII put this symbol on their scepters, and the latter order that fleur-de-lis be put on his son's coronation garment (his son being Philip II).
It is not known when Bleu de France was first used, but it is generally believed that its use originates in the 12^(th) as well.