Abstract:
- We already know enough to act. I wish we were in a world where research was the bottleneck, but the main constraint on AI safety is no longer a shortage of clever policy ideas: best practices already exist and are not being applied or enforced, and a serious international (or even just national) regulatory regime would probably cut most of the risk.
- They are not applied because awareness is low. The people who narrate and enforce AI policy mostly do not believe in the problem. I estimate that a majority of the top ~100–1,000 most influential policymakers worldwide have never had a single serious conversation about catastrophic risk, and this is the main reason they are not worried[1]. Even among the civil-society organizations that showed up to the UN Global Dialogue, exactly one of the 1,534 written submissions mentions "takeover", and less than 1% mention x-risks.
- They've never had the conversation because our field under-invests in having it. Status rewards research over advocacy (~3.6 researchers per advocate in US AI safety); many organizations self-censor; funders treat repetition as redundancy, even though repetition is how anyone actually gets convinced. Meanwhile, the industry secured 7× as many meetings with the European Commission [...]
---
Outline:
(03:29) 1. -- The bottleneck is political will, not research
(03:44) What do I call "political will"?
(05:10) The best practices we already have are not being applied
(07:28) We need to go from plan D to plan A: more seriousness and coordination
(09:09) Winning requires a large fraction of the top ~100-1,000 to understand the problem, and we're far from that.
(11:27) 2. -- Almost nobody realizes how bad the situation is - hence no political will
(11:43) What the people in charge don't believe
(13:33) The NGOs are wildly misprioritizing
(14:23) The public is still apathetic, and when prompted, mis-prioritizes
(15:30) 3. -- Why is awareness so low?
(16:58) We're not in enough rooms
(17:31) If we won't name the risks, who will?
(20:42) Status rewards research; the work that moves policy goes unrewarded
(22:22) One exposure is not enough; repetition is how you convince
(24:30) The field is comically small
(26:28) The main objection: Let's just wait for a warning shot? I don't think this works.
(30:40) Other potential objections
(34:03) 4 -- What to do
(34:14) A. Do the direct work
(34:18) The bottom line: talk to more people!
(35:24) Contribute to open consultations
(35:47) Advocacy aimed at AI lab employees
(36:22) Explain what you truly believe instead of just making a brittle recommendation
(37:00) B. Build the credibility infrastructure
(37:04) Prepare to own the next crisis
(37:44) Pre-register what you expect to see
(38:18) Track the skeptics' predictions
(38:58) C. Communication at scale
(39:02) Viral communication
(39:32) Break the "sci-fi" stigma
(39:59) Invest in coordination mechanisms between AI safety advocates
(41:32) D. An opinionated list of research directions that I find most useful
(44:55) Addendum
(45:04) Political will is (or will be) the bottleneck for nearly every cause, not just AI safety
(46:09) We can automate the research, but not the consensus necessary for political will
The original text contained 35 footnotes which were omitted from this narration.
---
First published:
July 11th, 2026
---
Narrated by TYPE III AUDIO.
---
Images from the article:
Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.
Fler avsnitt av LessWrong (30+ Karma)
Visa alla avsnitt av LessWrong (30+ Karma)LessWrong (30+ Karma) med LessWrong finns tillgänglig på flera plattformar. Informationen på denna sida kommer från offentliga podd-flöden.
