It is highly probable (indeed, virtually certain) that you have crossed paths with a descendant of a slave owner.

Slavery has been a common institution in Europe, Asia, the Americas (long before Columbus) and Africa for thousands of years.

Almost everyone alive today is related to almost everyone who had surviving children several thousand years ago.

Some of those ancestors are bound to have owned slaves.

You yourself are probably descended from slave owners. So is almost everyone you have ever met.

(Only exceptions would be people with exclusive descent from some population (Aboriginal Australians? New Guineans? (I don't know if those cultures ever practiced slavery)) where slavery was never (or rarely) practiced.