Rep. Sean Duffy (R-Wis.) said on "America's Newsroom" that the intense media focus on the deadly Charlottesville, Virginia, white supremacist rally is hurting the GOP's chances of passing its agenda. 

Duffy agreed that President Trump's comments on the "alt-left" and his initial blaming of "many sides" has fueled wall-to-wall media coverage of the event. 

Graphic Video Shows Aftermath of Barcelona Vehicle Terror Attack

Gettysburg Stands Firm: Battlefield Says All Monuments Staying Put

"If you want to talk about infrastructure, then talk about infrastructure. Let that be the story. Don't take the questions about Charlottesville," he said, referring to Trump's combative news conference on Tuesday. 

He said that the people who voted for Trump want to see follow-through on the agenda they supported: lower taxes, a stronger military, a secure border, job creation and deregulation. 

Bill Hemmer asked whether Duffy's constituents - in northwest and central Wisconsin - are still behind President Trump. 

"Absolutely. They haven't left him yet," Duffy responded, acknowledging that some are getting frustrated with his tweets and statements distracting from the agenda.

"Donald Trump was elected because he's imperfect, but he's fighting for middle Americans, the forgotten men and women who haven't had a raise in 10 years."

He said Republican lawmakers are getting an "earful" from constituents right now because they failed to repeal ObamaCare, as promised.

Duffy said he believes his colleagues will return to D.C. with a renewed energy to pass tax reform.

"It's one thing for a Republican to have the left mad at you. But when you come home and the right is angry at you, the people who helped you since the very beginning? That really shakes them in their boots," said Duffy.

Watch the discussion above.

'Like a Slot Machine Junkie': Tucker Rips Bill Kristol For Saying He 'Rationalized Slavery'

Red Sox Ceremonial First Pitch Nails Photographer Right in the Groin

Hannity: Media's 'Alternative Universe' on Trump is 'Beyond Despicable'