
The People Building AI Say They're Worried. One New Listener Noticed.
Om avsnittet
In early September, after Anthropic researcher Jacob Coxon announced he was leaving the company, his colleague Evan Hubinger replied that Coxon was right. Hubinger wrote, “We really do earnestly believe AI could kill all humans!”, put his own estimate at more than 10 percent within the next decade, and said Anthropic has no plan to solve alignment for superintelligence. ABC News: Around the same time, a Cincinnati machinist named Dewayne Moore picked up an audiobook on the same subject. Six weeks later, he sat down with John Sherman to describe what it is like to learn this as a regular person. His main takeaway concerned the people building AI: they say so openly.
The 60-second version
* Jacob Coxon left Anthropic and wrote that AI builders “earnestly believe it could kill us all by the end of the decade.” TechCrunch
* Colleague Evan Hubinger replied that he personally puts the risk above 10 percent within a decade. ABC News
* Dewayne Moore, new to the topic, says hearing builders say this openly is what got through to him: “that’s enough for me.”
* He plans to call his elected officials for the first time and ask others to do the same.
What did a first-time listener notice first?
Dewayne first came across the topic through the audiobook of *If Anyone Builds It, Everyone Dies* by Eliezer Yudkowsky and Nate Soares, about six weeks before the recording. After that, he listened to many For Humanity episodes. What stuck with him wasn’t a technical argument. It was the sense that the people closest to the work “are, they’re not running from it.” He started to wonder if they might be “sincerely scared.”
That concern is there in what they’ve said publicly. In his resignation post, Coxon wrote that the people building these systems believe the risk is real. Hubinger’s reply added that Anthropic “do[es] not have a plan to solve alignment for superintelligence and [is] not clearly on track to.” TechCrunch
Dewayne’s takeaway is simple: if the people building it say it could cause that much harm, “there’s no excuse to keep doing it.” And the argument that someone else will build it anyway doesn’t convince him: “So just stop.” John adds that leaders should model the behavior they want others to follow. Dewayne also questions whether companies can be trusted to regulate themselves, given what history has shown.
Sources for this section: TechCrunch: “Gambling with our lives”: Anthropic researcher quits - ABC News (Australia): Anthropic researcher quits saying AI developers believe “it could kill us all” - If Anyone Builds It, Everyone Dies
What happens when you tell the people close to you?
Dewayne says he brought it up with his wife the day after he finished the book. “I think I was just trying to make her aware of the risk,” he says. She “just wanted no part of it,” and he let it go. His parents and other relatives told him they had heard about it in the news. He does not describe any of this as disagreement: “It was more avoidance.” He adds that he doesn't spend every waking moment worrying about it either.
John calls that a rational response and offers his oven metaphor. Touch a 200-degree oven, and you pull back at once, but “these ideas are like a 5 million degree oven,” and the human body has no matching reaction.
Dewayne’s own view is that telling people is right, whatever comes back. “It’s bad to not tell somebody,” he says. You do not have to push: “You just make them aware of it, and then they can decide.” John cites a line he's heard: people believe their neighbors more than experts because a neighbor puts their own credibility behind the claim. We could not find research behind that line, so we treat it as John’s observation. He describes the kind of “telephone tree” he wishes existed for AI risk, the way schools once passed along snow-day news.
What does he plan to do, and does the tone need to change?
Dewayne says he wants to stay informed, make sure his family and friends know what’s going on, and contact his elected officials. He’s never done that before. John asks if the AI safety community—which he describes as brilliant academics who come across “like a college class”—should speak up more loudly. Dwayne says, “Maybe I need to be an alarmist.” He compares it to yelling “Fire!” in a theater when you see smoke in the hallway, and says people have “the attention span of a gnat.”
He ends on a hopeful note about people, but not institutions. “I’m hopeful we’ll figure it out, I really am,” he says. “I’m not hopeful that the CEOs are going to wake up and decide to do the right thing.” John wraps up by pointing listeners toward volunteer groups and urging them to call their elected leaders, donate, and tell a friend.
The AI Risk Network is a reader-supported publication. To receive new posts and support my work, consider subscribing for free or paid access.
What to watch next
Whether more frontier-lab researchers make public statements like Coxon and Hubinger's. In July, more than 1,300 employees of frontier AI companies signed a statement warning of a “real risk” that capabilities could outpace human control, and Anthropic and OpenAI each said pacing tools may be needed. ABC News: Coxon himself said pacing agreements between US labs are more viable after recent incidents. TechCrunch: Whether any lab publishes a concrete response is the open question.
The takeaway
This conversation is one person’s account of how the message lands with someone with no background in the field! Dewayne’s two data points are avoidance at home and conviction from the builders’ own words. That is a single experience, not a survey. It suggests that first-hand statements from people inside the labs persuade more than any argument we add.
The AI Risk Network is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.
This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit theairisknetwork.substack.com/subscribe
For Humanity: An AI Risk Podcast med The AI Risk Network finns tillgänglig på flera plattformar. Informationen på denna sida kommer från offentliga podd-flöden.