As soon as it started. US newspaper article from 1939.

EDIT: "started" being the traditional western September '39, and not '31 as sometimes is used as the start of the World War in Asia, since it wasn't a 'world' war yet at that point.