Lots of societies had various kinds of magical beliefs, how did they attempt to use them in war? I mean beyond just sacrifices to the gods.
I've talked about this subject before in the below link.
In essence, the problem of answering your question of "how common was it" lies with the problem of defining something as magic. In a nutshell, whenever you have instances of divine intervention on the battlefield, is that an instance of magic in warfare?
If you believe the answer is yes, then there is a ton of "magical warfare" in ancient sources, as you yourself surmise, however most of this is covered under "religion" and warfare.
If you believe the answer is no, you still have to define magic. If we're going with a more scholarly definition of quasi-accepted but also quasi-forbidden extra-natural rituals and practices, then there is really only one book in all of antiquity that specifically talks about such practices, and that's Julius Africanus' Cesti. In which case, the answer to your question would be "super rare."
If you're talking about roll 5D6 for fireball, then you should understand that that conception of "magic" is a modern association of the way we think ancient people think of "magic" as "misunderstood science." But that's our way of thinking about it, not their way of thinking about it.