Off the top of my head I can tell you that Hugues Capet and Henri IV where not crowned in Reims. Henri IV was crowned at Chartres.

There is more but I am on my phone and can't really give you a complete list nor sources ATM. If you really need a complete list and not an exemple, I would gladly do so when I come back.