Washington, D.C. is located in what was roughly the center of the nation at that time.

National capitals should be accessible not isolated, Washington DC is located where it is to make sure no state truly held more power then the others, in addition because the city has sea access it enables it to be open for diplomacy, also Washington is unique in the sense that it was built for the purpose of being the capital, if need be congress and the president could relocate.