Astra Is Hard to Monitor

OpenAI says its new GPT-6 Astra is highly capable, its most aligned model yet, and harder to monitor. Zvi digs into that second claim: what the system card’s monitorability evaluations actually show, the internet’s alarm over Astra’s recurrent-depth architecture, and what it would take to stop a race to the bottom on chain-of-thought monitoring.

The Don’t Worry About the Vase Podcast is a listener-supported podcast. To receive new posts and support the cost of creation, consider becoming a free or paid subscriber.

This has been an Askwho Casts audio conversion. If you would like your own private feed of audio conversions of any blog posts you would like to listen to, You can sign up For Askwho Casts Pro at https://app.askwhocasts.com/, Where you can give any post the multi-voiced podcast treatment, into your own podcast feed. Thanks for listening.

* 00:00:00 Introduction

* 00:03:35 Monitorability is Defense in Depth That Is Already Flailing

* 00:06:00 OpenAI Is Counting On Monitorability

* 00:07:45 How They Tested For Monitorability

* 00:09:44 Non-Adversarial Monitorability (9.1)

* 00:12:37 Astra Shortens Its CoT When It Knows It Is Being Monitored And Is Doing Something Bad

* 00:14:05 Sandbagging Task Kind of Passes, Kind of Fails (9.2.2.3)

* 00:15:46 OpenAI Does Not Believe It Could Catch Sandbagging

* 00:16:48 OAI-Repo Sabotage v2

* 00:23:10 The Secret Police Do Not Make Your Notebook Useless

* 00:24:29 CoT Controllability Is Up (9.2.1)

* 00:29:36 Astra Cannot Make Itself More Monitorable On Demand

* 00:30:04 Steganographic Chain of Thought May Be Within Reach

* 00:34:18 Astra Cannot Yet Sneak Math Side Tasks Past CoT Monitors (9.2.2.4)

* 00:35:33 UK AISI Monitorability Assessment (9.3)

* 00:39:38 Monitorability Declines Seem Unlikely To Be Only Capability Gains

* 00:45:02 Part 2: Recurrent Depth

* 00:48:44 The Immune System Responds

* 00:55:23 Ryan Greenblatt Explains How Bad This Could Be

* 00:59:39 Only Law Can Prevent Extinction

* 01:03:31 OpenAI Calls On Us to Avoid Racing to the Bottom

* 01:10:31 Thinking Fast and Slow, Also Small and Large

* 01:18:12 Talking Price

* 01:19:35 Conclusion: If The House Burns Down, Halt and Catch Fire

* 01:22:16 Outro

https://thezvi.substack.com/p/astra-is-hard-to-monitor?r=67y1h&utm_campaign=post-expanded-share&utm_medium=web

Get full access to DWAtV Podcast at dwatvpodcast.substack.com/subscribe