'Terrorism' is a pretty vague term, but the fact that Pearl Harbour was an attack on a military target rather than a civilian office building is probably the biggest reason.

Pearl Harbor was a planned military operation by the empire of Japan. 9-11 was a plot performed by a group independent of a recognized country.

Ouch... :/