It's so small compared to Spain. England could've probably taken a crack at Portugal too.
While you're waiting for quality responses, enjoy these previous /r/AskHistorians threads on the topic:
"Why did Spain never conquer Portugal?"
"How did Portugal remain independent from Spain?"