“Following his (George Washington’s) death in 1799, under the ownership of several successive generations of the family, the estate progressively declined. In 1858, the house’s historical importance was recognized and it was saved from ruin by the The Mount Vernon Ladies’ Association; this philanthropic organization acquired it together with part of the Washington estate.”

Wikipedia

Well, there was Mrs. Washington and the slaves…