Lewis and his wife, Barbara, were listed as enslaved under Oliver Phelps’ 1790 census record. When Lewis and Barbara Butler later moved to Canandaigua, New York, they helped their daughter Patience and her husband Austin Steward establish deep ties to the Underground Railroad network in the Rochester area, a community that later assisted Frederick Douglass with his abolitionist work in the region.