You are in a loyal state so have no chance of conscription into the Confederate Army of course. As a resident of Colorado Territory, you would not be subject to draft for the American Army either, as it was not assigned a draft quota, nor were the Pacific coast states. For a broader look at conscription though, see here, which does touch on various exemptions available.