And if so how far back would I have to travel before my English and my accent and their English and their accent become incomprehensible to one another?
Not to discourage further answers, but the reply by the excellent /u/bloodswan in this thread about why Chaucer is much more hard to understand than Shakespeare should give you an excellent overview of the differences in the English language over the centuries, and where it becomes hard to understand for modern English speakers.