They knew it was coming, they just didn't know where. Under operation fortitude the allies created fake army camps, set up dummy tanks and landing craft, and created fake radio traffic to feed the germans bad intel. This managed to get the Germans to expect the invasion at the French port city Calais, where the English channel is narrowest.