Depending on your definition of North America, Columbus never actually landed on the continent. He only landed on island in the Carribean, never landing on the mainland (though he did sail along the Gulf coast of South America, including the mouth of the Amazon).
During his 1492 voyage he first landed in the Bahamas on the island of San Salvador, subsequently exploring a few others. He later landed on Cuba and finally on Hispaniola were he established the settlement of La Isabela.
Sources: