Born in Brookline, Massachusetts. Married Sarah Adelia Thayer in 1841. He was admitted to bar in 1862 but never practiced law. Served in Massachusetts legislature 1842 to 1851. Elected Governor of Massachusetts 1851 to 1852. In 1855 he helped organize the Republican Party in Massachusetts.

Appointed by President Lincoln as the first Commissioner of the Department of Internal Revenue 1862 to 1863. Elected to the House of Representatives March 4, 1863, to March 12, 1869. He was one of seven managers of the Johnson impeachment trial. Appointed Secretary of the Treasury by President Grant and served March 11, 1869, to March 17, 1873. On September 24, 1869, he authorized the release of Treasury gold and broke up an attempt by speculators Jay Gould and Jim Fisk to corner the market. The ruined speculators called it "Black Friday." Elected Senator from Massachusetts and served 1873 to 1877. Served as U.S. Consul to Haiti in 1885, to Hawaii in 1886, and to Chile in 1893 to 1894. He opposed annexation of the Philippines in the period following the Spanish American War. He was the first president of the Anti-Imperialist League and served from 1898 until his death. He died in Groton, Massachusetts. bio: ApCAB; BDC; BDEB; DAB; Drake; NCAB 1; TCBDA; WAB; WWWA-1