I know that we have records of instruments used in ancient greece and mesopotamia. But do we have any "music sheet" from those times?
Yes, we do. Not terribly many examples, and they lead to more questions than answers.
Check the Hurrian songs, cuneiform on clay tablets, in this publication.
Also Seikilos epitaph.