Columbus landed in America by crossing the Atlantic, so landing on the east side of Australia (in Cook's case) seems odd. Coincidentally, the anniversary of that is tomorrow.
The point of the voyage where he first landed in Australia was to do scientific observations and exploration in the Pacific Ocean. So naturally he would land on the East Coast.