James Smith Lithgow (November 29, 1812 — February 21, 1902) was an American politician, and the sixteenth Mayor of Louisville, Kentucky from January 2, 1866 to February 14, 1867. He was born in Pittsburgh, Pennsylvania and apprenticed as a coppersmith there.

He moved to Louisville in 1832 and worked various jobs before starting Wallace & Lithgow, a metals company on Market Street in 1836. The business was successful, and made Lithgow wealthy. After the death of Wallace in 1861, the company became J.S. Lithgow and Co. and built its headquarters at what became the Board of Trade Building, initially one of the largest and most expensive buildings in Downtown Louisville. This building was designed by Henry Whitestone, a prominent Louisville architect whose firm exists today as Luckett & Farley, who also still possess the original drawings. Lithgow lost both the building and his business in the Panic of 1873, but he regained his fortune with a new company, Lithgow Manufacturing Co..