Rep. Ted Poe (R-TX) resigned Sunday from the House Freedom Caucus in protest over the group's opposition to the Republican-backed health care bill.

House leaders pulled the bill from consideration Friday after it became clear Republicans did not have enough votes to pass the legislation, in part due to strong opposition from the Freedom Caucus.

On "Fox & Friends" today, Poe said that House Speaker Paul Ryan was willing to work with the caucus on making changes to the bill, but he was never going to get their votes.

"The goalposts kept getting moved," Poe said. "And no matter what, at the end of the day, 'no' was the answer."

He said now that the Republican Party is in power, it's time to learn to say "yes" and lead.

Because that didn't happen with this health care bill, Poe said, ObamaCare is now "the law of the land," which is a disaster.

He said we must come together to find solutions to move this country forward, and he believes leaving the House Freedom Caucus will make him better able to do that.

"I think it's best for me - and even for the caucus - that I not be a member of the Freedom Caucus."

Watch more from Poe above.

Vet Speaks Up at VA After Spotting 'Disrespectful' Blank Space for Trump Pic

Afghanistan Vet Becomes First Full-Time Double-Amputee Police Officer

LOOK: FL Man Ticketed for Eating Pancakes in Middle of Street

Tucker Battles Dem Strategist Over Alleged Spying on Trump Team