Not to forestall further in-depth and comprehensive answers, but there is some reason to believe that Native American diseases did have some impact on Europeans, which the great /u/anthropology_nerd has written a bunch about, including for example, in this post. Hope this helps!