According to Jules Claretie he was raised by his grandmother and aunt (who was also the betrothed of Robespierre), with the support of the widow of Pierre Philippeaux. He later went to the same school as his father (Lycée Louis-le-grand), at least until he was enrolled at Sainte-Barbe, finishing his education with a law degree from the University of Paris. Finally, Horace died of a fever on Haiti, leaving a daughter.

There are apparently also records of him serving as a corporal in the National Guard, plus documents from a masonic lodge in New York.