I just really am curious if the general population had any problems with the American governments insistence on going to the moon at the time. Did people worry about the financial implications? Were they upset the money could have been spent elsewhere?
Tldr; was there opposion in the general public to the moon landing, and it's associated missions?
Absolutely. In fact, at no point prior to the first Moon landing did the program receive a majority of support by the public at large. Indeed, there were several notable very vocal public opponents of the program because they felt it drew funds away from or was a distraction from now important work (such as poverty reduction and anti-segregation).
And in some regards they had a solid case to make. In the 1960s the per capita gdp of the US was considerably lower than today. There was a level of common poverty that existed then that today exists mostly in the developing world. Remember that in the 1960s the whole country didn't even have indoor plumbing, electricity, or phones. And, of course, this was also the peak of the struggle against Jim Crow. Many people, correctly, saw the moon race as a geopolitical struggle and lamented the waste of resources for what was effectively war making on another front. Even more so while the Vietnam War was raging.
It was only after the fact that the Apollo program became more closely associated with peace, science, and the inchoate environmental movement. And, of course, for the spending to become a sunk cost that couldn't be undone or diverted elsewhere.
Sources & further reading: