I remember from my high school history class a teacher saying that at the time, not everyone was in favor of the Bill of Rights, but I cannot remember the reasons stated or the people he said opposed it. My teacher was a football coach and didn't really know much about history so I didn't pay attention in his class. Was he correct or not?
The primary opposition to the Bill of Rights was that it would make things unnecessarily complicated. The theory was the federal government only had the powers explicitly granted to it by the constitution, ergo it was not necessary to explicitly enumerate the powers it didn't have.
Furthermore, some believed that by including a list of limitations, that might imply the government had powers, implicitly. For example, if you make a list of rights the government can't abridge (a la First Amendment) then some may argue that this implies the government can abridge other rights. This was the reason for the 10th amendment, to make it clear that the government only had the powers identified by the constitution.
The for/against division regarding the Bill of Rights fell primarily with Anti-Federalist/Federalist lines, with James Madison being a chief component of the against/Federalist, though he should be credited for helping mediate the final outcome.
Source: College History class.