Kennedy and his inspirational author wife, Lauren Scruggs Kennedy, purchased the Agoura Hills abode for $2.4 million in 2018 and remodeled it.