Short answer: If the particular pagan Scandinavians knew about distant lands (which they almost certainly did, considering the trade goods that have been found,) then sure, why not?

Longer answer: Like with most things related to the cosmology of pagan Scandinavia, we've got precious little to go on. All we know of their concept of Miðgarðr is that it was west of Jötunheim and was fenced off by the gods to protect humans from the jötnar. What mythological sources we have aren't terribly concerned with the events on Miðgarð, save for when one of the Æsír (usually Þórr or Óðinn) winds up there, so details are vague at best.