Could an American citizen have just gone to visit Moscow and see the sights? Could a Muscovite have decided to spend his winter in Florida?
You might be interested in some previous threads on travel between the United States and the Soviet Union: