I've always heard stories of Roman emperors/wealthy statesmen partaking in orgies and I've always wondered how much perverted acts actually took place, such as the stories about Caligula and Tiberius, and how well these people's heigine would have been.
Probably not. A lot of the stuff you hear is exaggerated and conflated.
Orgies, contrary to popular belief, were more a religious ceremony than a purely carnal one. Orgies were part of the Cult of Bacchus, known in the Greek pantheon as Dionysius. Their focus was to connect with the god of wine by being carnal rather than just being carnal for carnality's sake.
This practice stayed the same when the Roman Republic conquered Greece in 146 BCE, when the Cult of Dionysius gained much more followers amongst the Romans, as many other cults did. For more information about cults in Rome, you should read the excellent book The Cults of the Roman Empire by Robert Tucan. It goes over the Cult of Dionysius as well as the Cult of Mithras, a Persian god who gained followers amongst the Legionnaries.
So, to answer your question, no. The orgies were more spiritual than people make them out to be, and many wealthy Romans were part of the Cult of Dionysius.