I mean in the literal sense not slave-like conditions I.e sharecropping. Possible owners just didn't know since information could have been hard to come by or deliberately avoided freeing their slaves. Possibly out in the far west or deep in the mountains?
This article from People magazine reports on a white family that semi-secretly kept slaves up until the 1960s.