Was there a religious prohibition against going if you were not a druid? Did the local ruler have sway over access and repair/modification?
Stonehenge was built and added to over a period of roughly 1,500 years, from about 3100 BC to 1600 BC. Thinking of it as a construction like the pyramids with a clearly defined timescale isn't necessarily the way to view it.