It seems to me that while Caligula was as hedonistic and power hungry as the other emperors, he mostly get's the bad rap because he was specifically hostile to the Senate.
I would also be curious to see if the same could accurately said about Nero!