In short, yes, they knew exactly who built the ruins around them.
If you'd like further details, here is an answer that was written by /u/bristoneman that deals with a similar topic