Was this a privilege for only the wealthy? Could working class white farm owners afford to have slaves?
Here's an older thread on this topic.
The tl;dr on it is that in the states where slavery was legal, the percentage of heads of households who were enslavers ranged from a low of 3 percent in Delaware to a high of 49 percent in Mississippi. About 26 percent of households in the South owned at least one slave.