For example are there any historical records on Umar ibn Al-Khattab taking Jerusalem away from Byzantine?
There is an inscription that records the death of 'Umar and is dated to 24 AH (644 CE), which conforms to the date known from Muslim sources. This inscription is sometimes referred to as the "Zuhayr inscription", named after its author. Regarding sources for Muhammad, his name is mentioned in near-contemporary sources; for example, there is the account of Sebeos.