From what I understand, it was due to their low cost, as professors did not make much money in many Universities. However, once academia received more funding, the trend kept. It is the same reason that elbow pads are similarly associated, it started as a cost saving measure on the part of a lower income academic circle, and eventually became associated with that academic circle.