I've found posts that danced around this subject but couldn't find a straight answer to this particular question so I'll ask it here.
When Dante describes images like centaur guards and Charon the boatman, did he actually think stuff like that might exist in Hell or was it all for entertainment value?
Whether he did or not, he included pagan imagery in a pretty serious story about Hell, wouldn't that be kind of heretical?
The Divine Comedy wasn't meant to provide a literal description of Hell (or Purgatory, or Heaven). The literary milieu Dante drew on to write the Comedy was incredibly complex, so it's only natural that the end product is equally sophisticated. While certain elements, like notable Florentines or juicy legends, were doubtlessly included to entertain and edify his audience, a great deal of the poem - the system of punishments/rewards, the classical references, even the metrical/philological structure of the poem itself - can instead be read allegorically to reveal a deeper, "mystical" meaning.
Of course, the Comedy is certainly meant to entertain. Dante intentionally imitates the classical poets and includes exciting mythological references because that was the high literature of his time. But it's also meant to educate. The universe is a comedy, according to Dante, because it rests entirely on God, the ultimate good. Centaurs guard in Hell while angels guard in Purgatory because Hell is for the wicked and Purgatory is for the good: neither group has any business switching places with the other. Dante's reworking of classical references in a non-pagan, non-Latin context is no accident - instead, it's part of his overall achievement.
Recommended further reading:
Not really. As /u/arivederlestelle points out, he was both showing off his education and being allegorical with the classical references. Also, he putting the pagans and classical monsters right where a Christian would expect to find them: Hell (except for Cato). He's not presenting them as beings to be worshipped by any means, which would be heretical.
It was also perfectly acceptable in Christendom to admire the good people who weren't Christians just as they never deluded themselves into thinking they were neccesarrily better because they were baptized. (One of Dante's points is that the Church of the time was focused on Italian politics to the exclusion of preaching the Gospel and calling sinners to repentance.) The conduct of the Muslim Saladin, for example, was used to contrast with the acts of Christian princes and a staple of the chansons de geste that were popular were the Nine Worthies -- three pagan, three Jewish and three Christian knights who exemplified chivalric ideals.
It's a bit off topic, but you could almost say that many of the differences between pre- and post-Reformation Christianity in the West are summarized by the way Dante and Milton treat Satan. Milton is full of sympathy for the Devil, depicting his pride as a kind of Greek hubris while he's not even a character in Inferno, clearly doesn't reign in Hell and is just as impotent as any other sinner.
Just to pile on to what /u/arivederlestelle has said in his fantastic answer - Dante's language and imagery are richly allegorical, and not necessarily to be taken as something the poet literally believed. One source of imagery that hasn't been mentioned here is astronomy, which seems to inform a lot of the structure and content of Dante's poem.
As for the issue of allegory, Dante perhaps explains it best in his own words:
"To elucidate, then, what we have to say, be it known that the sense of this work [(viz. the Divine Comedy)] is not simple, but on the contrary it may be called polysemous, that is to say, 'of more senses than one'; for it is one sense which we get through the letter, and another which we get through the thing the letter signifies; and the first is called literal, but the second allegorical or mystic. And this mode of treatment, for its better manifestation, may be considered in this verse:
'When lsrael came out of Egypt, and the house of Jacob from a people of strange speech, Judaea became his sanctification, Israel his power.‘
For if we inspect the letter alone the departure of the children of Israel from Egypt in the time of Moses is presented to us; if the allegory, our redemption wrought by Christ; if the moral sense, the conversion of the soul from the grief and misery of sin to the state of grace is presented to us; if the anagogical, the departure of the holy soul from the slavery of this corruption [(i.e. the bondage of the soul within the body)] to the liberty of eternal glory is presented to us.
And although these mystic senses have each their special denominations, they may all in general be called allegorical, since they differ from the literal and historical; for allegory is derived from alleon, in Greek, which means the same as the Latin alienum or diversum.”
-Dante Alighieri (Letter to Can Grande della Scala, 7)