There had to be some people who weren’t pro confederacy per-say but just didn’t want to fight to keep states in the union who wanted out
A version of this question comes up from time to time. As to why the North couldn't just let the South secede there's a good answer here here and another on what Northern opinion there was to just let them go here by u/secessionisillegal