So I was thinking today: Between 100 BC and 400 AD Rome was a home to well over a million people, at times even nearing 1.5 million according to some sources. Even by modern standards it was not a small city. But having so many people required a lot of dense urban housing and a robust infrastructure. Hundreds of thousands of different structures, packed densely in the center of the metropolis.
Then in 500 AD the population fell to just around 100 thousand people, and then even more to just some 50-30 thousand people over the entire medieval period. At times it was supposedly completely abandoned.
So, was something like 90-95% of the city just completely empty for few hundred years? Was there a gigantic post-apocalyptic urban wasteland, full of empty houses, in the heart of Italy? Or were they all destroyed when the city started shrinking?
Not only in Rome, but the urban population of the regions of the Roman Empire also declined everywhere (more in the Western half than in the Eastern half). This collapse of the urban population followed long-run patterns of economic change.
Historians like Ian Morris, Josiah Ober, Alain Bresson, Walter Scheidel, and Ward Perkins are good references regarding long-term economic waves in Western Eurasia. There were three big waves:
This book is a good summary of Morris' research:
https://press.princeton.edu/books/hardcover/9780691155685/the-measure-of-civilization
This book by Ward Perkins is a good one explaining in detail the collapse of economic activity in the Western half of the Roman Empire:
https://www.amazon.com/Fall-Rome-End-Civilization/dp/0192807285
This lecture video by Ward Perkins gives a summary of the book:
So, the decline in the urban population in the city of Rome was not quick, Rome's population likely peaked at over 1 million around 100 to 150 AD, before the Antonine Plague. Then it slowly declined over the centuries. By the early 5th century it was already substantially smaller than during its peak.
Since houses tended to degrade the city did not look "empty" instead, tons of old Roman ruins were spread around mostly open plains. For example, the arena of the colosseum became grassland for sheep and according to this illustrated map, even around early modern period 16-17th centuries, Rome was still contained in a small fraction of the Aurelian Walls, built in the late 3rd century:
http://www.vidiani.com/maps/maps_of_europe/maps_of_vatican/detailed_antique_map_of_rome_city.jpg
Note the numerous ruins dating from the Roman period.