Because 1) At the time of the Roman Empire the technology needed to effectively farm the rich northern European soil, such as the heavy plow, has not yet being adopted thus they were not very productive agriculturally. 2) At the same time, the east was far richer because state structure and economic development has being in Greece, Anatolia, Egypt etc for far longer and they are therefore very wealthy. Wealth made them far more attractive immediate targets of conquest.