Rebhorn brought many memorable characters to life including Claire Danes' father on the series Homeland.
Rebhorn was born in Philadelphia and died at in his New Jersey home at the age of 65.
TMZ reports he died after a long fight with melanoma.
Fellow actor Patton Oswalt tweeted "James Rebhorn, RIP." He went on to say “on behalf of all film buffs; we took for granted you'd always be there & be great, 'cause you always were."
Rebhorn’s career lasted more than 50 years and included appearances on “Seinfeld,” “Boston Legal,” and “My Cousin Vinny.”
Many will remember him as the snarky Secretary of Defense who was fired in the Will Smith hit “Indepance Day.”
Rebhorn’s wife says even as he grew more and more sick, he wanted to continue working. He did just that, playing a man with Alzheimer’s in “Too Much, Too Much, Too Many,” as well as “12 Angry Men.” Rebhorn leaves a wife and two daughters.