Mike Pence is already in hot water with the White House, but now the The View panel is coming after him, too. The former Vice President is under fire for joking about Transportation Secretary Pete Buttigieg’s paternity leave at the annual Gridiron Club dinner in Washington over the weekend.

Pence quipped, “He took two months ‘maternity’ leave whereupon thousands of travelers were stranded in airports, the air traffic system shut down, and airplanes nearly collided on our runways. Pete is the only person in human history to have a child and everyone else gets postpartum depression,” per ABC News, which reports that the White House has demanded an apology from the former VP for his “homophobic joke” about Buttigieg, who shares two children with his husband, Chasten.

The joke didn’t go over too well at the Hot Topics table, who all agreed it simply wasn’t funny, but also criticized Pence for taking a low blow at Buttigieg.

Whoopi Goldberg scoffed at Pence’s comments, claiming he wasn’t “smart enough to think of a new joke” and describing his words as “sloppy and very lazy,” before later adding, “he should have known better.”

Joy Behar agreed, telling the panel, “Besides the fact that the joke was not funny, it’s coming from someone who has a history of homophobia, and that’s what the problem is. Here’s a guy who’s always been against gay marriage, he was against repealing Don’t Ask, Don’t Tell, and even more egregious, as governor of Indiana, he exacerbated an HIV epidemic in South [Bend], Indiana…he should be ashamed of himself.”

Behar continued, “I also have to say, this is a very , very craven attempt to appeal to the MAGA base, yet again,” adding, “they’ve got to get this deplorable base on their side in order to win the primary.”

Alyssa Farah Griffin told the co-hosts she’d been to the Gridiron dinner herself in the past and described it as her “favorite” event in Washington, but even she failed to see the humor in her former boss’s remarks.

“It was a joke that did not land,” she said, before citing stats showing wide support across the country for the LGBTQ community.

“This country has made huge strides with regard to the LGBTQ community,” Griffin said. “If you’re not with them, you’re never gonna win nationally.”

And the criticism didn’t stop there. Sunny Hostin said she had “a problem” with Pence’s words too, recalling her own experience living in South Bend, where she said Pence was not popular because of his anti-LGBTQ politics.

Goldberg closed out the conversation by hammering the point home, repeatedly calling Pence’s joke “terrible” as Behar recommended a “joke writer” for the former VP’s next event.

The View airs weekdays at 11/10c on ABC.