Jacob Coxon Warns of Human Extinction and Triggers a Preference Cascade

Jacob Coxon’s resignation set off a wave of public warnings about AI from esearchers, politicians and other observers. Zvi examines why this warning broke through, what researchers say they believe, and the choices facing people inside and outside the frontier labs.

The Don’t Worry About the Vase Podcast is a listener-supported podcast. To receive new posts and support the cost of creation, consider becoming a free or paid subscriber.

This has been an Askwho Casts audio conversion. If you would like your own private feed of audio conversions of any blog posts you would like to listen to, You can sign up For Askwho Casts Pro at https://app.askwhocasts.com/, Where you can give any post the multi-voiced podcast treatment, into your own podcast feed. Thanks for listening.

* 00:00 - Introduction

* 01:21 - Jacob Coxon Resigns From Anthropic In Protest And Sounds The Alarm

* 05:37 - Mainstream Media Finally Pays Attention

* 06:34 - Preference Cascade at Anthropic

* 09:56 - Preference Cascade at OpenAI

* 12:56 - Preference Cascade at Google

* 14:03 - Hashtag Not All Members of Technical Staff

* 14:42 - Why a Preference Cascade Now?

* 20:13 - This Is What Many Anthropic and OpenAI Employees Actually Believe

* 23:17 - To Quit Or Not To Quit

* 30:12 - Quiet Quitting Is A Dominated Option

* 31:26 - When You Quit, Very Serious People Understand What That Means

* 37:40 - Jacob Coxon Believes Existential Risk Is High That Is Why He Quit

* 39:51 - Evan Hubinger Believes Existential Risk Is High That Is Why He Stays

* 43:13 - Anthropic and OpenAI Have Commercial Incentives To Downplay Existential Risks, Not Advertise Them

* 49:03 - What Do We Do Now?

* 51:01 - OK, But How Exactly Would AI Kill Everyone?

* 59:48 - Best Start Believing In Science Fiction Stories Because You Are In One

* 01:04:16 - Literal Extinction Is Not Much Harder Than Loss of Control

* 01:05:30 - Conspiracytown Is Always Hiring

* 01:17:37 - Now You See It

https://thezvi.substack.com/p/jacob-coxon-warns-of-human-extinction?r=67y1h&utm_campaign=post-expanded-share&utm_medium=web

Get full access to DWAtV Podcast at dwatvpodcast.substack.com/subscribe