Germany was very dependant on iron exports from Sweden. The primary reason for the invasion of Norway was to ensure the trade routes and shipping docks were all secure so business could run as usual. France and Britain had plans to invade Norway before the German invasion in order to sever Germany's supply with iron ore exports from Sweden. The Germans acted quickly and took the initiative.
There was no need to invade Sweden. Only Norway.