There was never really a time when southerners weren't allowed to serve in the US armed forces. Even during the war, hundreds of thousands of southerners, white and, especially, black, served in the Union Army. Winfield Scott, George Thomas, and John Fremont, among others, were southern officers who remained loyal to the Union. I know this is a very brief answer, but I don't know how to go into much more detail about this.