Rep. Brad Sherman has declined support of a push to replace the illustration of Ulysses S. Grant with Ronald Reagan’s image on the $50 bill.

The 40th president remains too controversial a figure to be canonized on a currency note, Sherman told the Los Angeles Times.

“Our currency ought to be something that unites us,” Sherman was quoted in the Times.