Well, remember that elemental magic is always direct in nature. There is no manipulation, illusion, divination, or alteration of the people involved. That is your biggest disadvantage. The best response to a skilled user of any of the aforementioned disciplines is brute force. They lack to raw offensive power and speed of elemental magic, so you must throw everything you've got against them before they have time to respond.