Tonight on “The Factor,” Bill O’Reilly took on former KKK leader David Duke, who claimed he has never been a white supremacist.

Duke was on the show to discuss the controversy surrounding House Majority Whip Steve Scalise over reports that Scalise gave a speech to the European-American Unity and Rights Organization, which was founded by Duke.

Duke repeatedly claimed that he was never a white supremacist and has always condemned violence.

“Don’t sit there and tell me that you’re not trying to promote the cause of white people because you are,” O’Reilly fired back.

"The Factor" host told Duke, “We’re all in it together and skin color shouldn’t matter.”

Watch the fiery exchange above.