When the Western Roman Empire still existed the "Byzantine" or Eastern half of the empire didn't really consider itself separate. At the time the East and West were just giant adminstrative units with a great deal of independence from each other, but neither considered themselves not to be part of the Roman Empire. Therefore, the Empire never switched to considering themselves just the Roman Empire because they always had before.