I'm doing a paper on this trial and I'd like to know this. Did they know about his presence at the Posen speeches for instance?
I'm not terribly familiar with Speer's case at Nuremberg, but in general all of the defendants went through lengthy interrogations. Keep in mind that they were not just asked about themselves, but also about others. I don't know offhand what documents the prosecutors might also have had on hand.
Speer wrote a famous set of memoirs, the first volume Inside the Third Reich has a short section at the end about his experience at Nuremberg.