Do you mean other than being looted and burned down in 1814?
Dolly Madison totally stole a portrait of George Washington from the White House.