This article discusses the widespread prejudice against Jewish people in general, and the strong opposition to allowing Jewish refugees - even refugee children - into the United States, but it doesn't go into the reasons or rationale behind that opposition. Did Americans share Germany's opinion that Jewish people were physical/moral/economic threats? Were there any public voices explaining why they opposed refugees, or was the social climate so tacitly anti-Semitic that no one needed to openly make the argument?
First, it is important to recognize that American views on immigration were significantly different at the time. The modern understanding of US immigration stems from immigration legislation passed in 1965. Prior to that, immigration policy was far more restrictive (Chinese Exclusion Act, Gentlemen's Agreement with Japan, etc). Prior to WWII, US immigration policy limited immigrants from any country to 2% of the number of people already living in the US in 1890. I don't mean to imply that immigration policy is what shaped public opinion. Just that you'd need to think of it in terms of an American public unfamiliar with widespread immigration, not the modern public understanding.
Concerning your question specifically, this wikipedia article may be a good start for you. Antisemitism in the US saw a rise in the late 30s/early 40s. There were a few significant figures that tied this into support of fascism, but this was far from universal. Henry Ford is a common example. Another was Father Coughlin, a conservative radio host with an audience in the millions.
Some opposition was also economic in nature. At the time, US immigration policy would deny entry to people they considered liable to become a public charge This category was expanded during the Depression to include anyone who didn't already have a job lined up. This excluded many Jewish refugees from entering. (Best source I could find) I remember reading a letter from a New York dentist organization to FDR asking to limit immigration so Jewish dentists wouldn't take their business. But since I can't find the source online, I don't want to make the claim that this was common.
If you're interested in the topic, there's a pretty famous book from the 80s called "The Abandonment of the Jews: America and the Holocaust 1941–1945".