Born in Philadelphia, Pennsylvania, son of William Ledyard Hodge, Assistant Secretary of the Treasury. . Valedictorian for his class of 1853 at Princeton University. Attended law school at the University of Virginia. Licensed to practice law in Philadelphia.

He served as Major and paymaster with the Union Army during the Civil War. Married Susan Savage Wilson. They had five children.

He was one of the founding members of the Philadelphia Numismatic Society and librarian in 1861. Co-author of Catalogue of American Store Cards &c… with a long title.

He was convicted of embezzlement and his coin collection was seized by the government on October 23, 1871, and sold at auction. The two bidders were John Jay Knox and Ebenezer Locke Mason, Jr.