First of all, if we take the traditional definition of Eastern Europe, large part of it isn't actually Orthodox (Poland, but also Czech Republic, Slovakia, Hungary, the Baltic states).

Now, the religion division is rather simple to explain - Catholic (and later Protestant, sometimes) countries accepted Christianity from the West (in case of Poland, from Bohemia) while Orthodox countries accepted Christianity from Byzantium.