The first thing is to make certain that an internship represents more than janitorial duties: I knew a museum director who exploited students by having them work as janitors. He told me the students were able to put on their resumes that they had done an internship, so that was all that mattered. I did everything I could to steer students away from the facility. So the first thing is make certain you will learn something, get practical experience, and will not be exploited.

Consider all the possibilities: archaeological excavations in the area, historical parks, museums, archives, etc. Then decide what your dream internship would be and see if that is available. But don't hesitate to do something other than your dream - you might find something that you unexpectedly like. Then go to various facilities and ask about internships - what you would be doing, is there any amount of funding, what you are likely to learn.

Most of all, this can be some of your most valuable early experience. I strongly recommend doing what you're considering.