They're Congreve rockets, black powder fueled rockets used by the British as an artillery weapon. They weren't particularly accurate - their only guidance system was the frame from which they were launched. On land, they were launched from an iron frame, while at sea, two ships were converted to launch them. They could also be launched from small boats. The bombs mentioned in the song are mortar bombs, explosive packed shells fired from mortars.