The Daughters of Jacob Home and Hospital was built on land that had been the William E. Morris estate. The grounds included a large mansion and a smaller stone structure used supposedly as a schoolhouse. The stone building was said to have been constructed in 1792, while the mansion was erected in 1816 by James Morris. His son William was a Civil War major general. According to various sources, former President of the Confederacy, Jefferson Davis, was a frequent visitor to the home following his release from prison in 1869, though the connection to the house or the Morris family (who fought on the side of the Union) is unclear.