Did they hate him like anybody who came that close to destroying your civilization, or respect him because he was able to, or somewhere in between.
In between. You should read Livy's books on the Punic War but especially 21-22, or Plutarch's Scipio. Livy records that Hannibal had a dream in which he was marching through Italy and a vicious snake was following him. Romans in respected him as a general and tragic figure, but hated him as a tricky and faithless Phoenician. He is rarely discussed as a good person. At the time of the Punic wars the Romans really hated him. After Carthage lost, they reevaluated him.