I can find numerous articles to support this claim but none of them seem to cite a source.
Yes, Thomas Jefferson's Quran by Denise Spellberg discusses the disputes over religious freedom and Islam among the Founding generation in detail, including the Federalist slurs against Thomas Jefferson that he was a Muslim.