The building was completed in 1858 as the Richmond Customs House. It was the only major Main Street building to survive the evacuation fire of 1865 at the close of the Civil War. It served the Confederate States of America during the Civil War; Jefferson Davis was indicted for treason in this building.