Hello! Here are some threads that can give you some context for this question:

• City guards weren't exactly what you might be imagining.
• Guard duty generally wasn't a full-time (or desirable) job.
• Castles could have garrisons of anywhere from a couple thousand to less than two dozen men.

Which city? What time period?