A federal appeals court has refused to allow the implementation of President Obama's executive action that could shield as many as five million illegal immigrants from deportation.

The White House responded to the setback by stating that the president has exclusive authority to enforce immigration laws and can adjust policies to fix a "broken immigration system."

"I cannot tell you how rare this is in American history for a succession of federal judges to stop the president of the United States from doing what he says he has the authority to do," Judge Andrew Napolitano said on "Your World." "But we saw it happen today."

"The president is breaking the law. That's what two judges said in the United States Court of Appeals," Judge Napolitano said, adding that he thinks the White House will have to appeal this to the Supreme Court, where the initial appeal would be in front of Judge Antonin Scalia.

"It would be up to the president if he wants to dispatch his lawyers there," Judge Napolitano said. "This does not look good for him."

Get more insight from Judge Napolitano in the clip above.

You might also be interested in ...

Judge Nap: DOJ 'Twisted the Arm of' Cleveland Police Department

Judge Nap: 'Rand Paul Is the Only Candidate Who's Faithful to the Constitution'

2 Officers Resign After Being Forced to Choose Between Their Faith and Jobs

'Wasting Their Time and Squandering Our Safety': Judge Nap Slams NSA