I know that there were plenty of Portuguese and Dutch traders that arrived in Japan in the 16th and 17th centuries, but were there any Japanese people who traveled to Portugal or the Netherlands during that time period?
Yes there were. See here.