In 1904 Robert F. Maddox bought 73 acres of James L. Dickey's Paces Ferry Road property. Maddox named the property Woodhaven and built a summer home, stable, servants' quarters, and other outbuildings. In 1911 William and Lucy Kiser purchased the eastern portion of the property. They commissioned the architectural firm of Hentz, Adler & Shutze to build their home on the site of Maddox's summer home, which they named Knollwood after the knoll it sits on, in 1929. Shutze built Knollwood in the English Georgian style. The home's address was originally on West Paces Ferry Road, but it changed to 3351 Woodhaven Rd NW after Maddox sold the western half of his estate to the State of Georgia for the Governor's Mansion in 1964. Knollwood remained in the Kiser family until 1952, when the family sold it to the Wolff family. The property remained primarily unchanged and was sold again by Barbara Morgan and Atlanta Fine Homes Sotheby's International Realty in 2012.