Good question, I am not sure exactly but I believe most Romans(not Byzantines) had already left, as there were barely even any troops there to defend the walls. Constantine XI and his troops basically were committing suicide by defending at all.