I have traced maternal ancestors back to those who've had slaves, and found the names of enslaved in wills, etc.

Have not found that on my paternal line, which makes sense, as most of those ancestors stayed in the north. Still trying to go beyond the 1790 Census, which is the first Census and when these ancestors first show up. No luck yet. But one of their ancestors definitely had to have been either enslaved or a free servant, if not multiple.