Rep. Darrell Issa (R-Calif.) said Tuesday on "Outnumbered Overtime" that Special Counsel Robert Mueller's team is "out of rabbit holes" to go down after accusing Paul Manafort of violating his plea agreement.

Mueller's office said that after Manafort signed the agreement, he lied to the FBI and the Special Counsel's office, though Manafort denied the claims through his lawyers.

"He's prosecuted people on unrelated crimes, but he hasn't been able to create one indictment for something done by the Trump campaign," Issa said on Tuesday.

Issa added that he believes Mueller's team is now "moving on" after accusing Manafort of the plea deal violations.

"They've gotten whatever they're gonna get from him and they don't like it," he said. "I think their not liking it tells you that they don't have anything left."

Judge Nap on Mueller Accusing Manafort of Lying: 'It's Probably About the President'

Issa said that the special counsel's team doesn't want to hear Manafort say that he knows of no crimes by the Trump campaign.

"Unless they've got some other rabbit hole to go down, they're out of rabbit holes," he said.

He also said that he wouldn't expect the president to pardon Manafort right away, if at all, since he's facing a slew of state charges. 

"In spite of the president's belief that Manafort has been mistreated. ... He can only pardon for a federal crime."

Issa said that Mueller may be challenged in trying to find crimes committed by the president.

"He was supposed to find the 'there' there, and he hasn't done it," he said.

Watch more of Rep. Issa's interview with Harris Faulkner above.

'Leaders Have to Build Support Over Time': Fiorina Says Trump Agenda 'At Risk'

Dershowitz Urges Trump Team to 'Be Ready': Mueller Won't Release 'Balanced, Fair Report'

Hannity: 'Demonization' of Border Patrol, Comparing Caravan to Holocaust Is 'Predictable But Sad'