Hi there! While there's always room for more discussion, there have been a couple of recent threads on the topic which you might find useful:
and
The tl;dr is that yes, slave labor was used in the building of the White House and in its rebuilding after 1814; and that after the British burned it in 1814, all that was left is the shell of the building.
