GPT-6 Astra: The System Card, Alignment and What Comes Next

What does it mean to call an AI model aligned? Zvi examines GPT-6 Astra’s system card, its growing capabilities, and the evidence behind OpenAI’s safety claims, with reactions from alignment researchers and external evaluators.

The Don’t Worry About the Vase Podcast is a listener-supported podcast. To receive new posts and support the cost of creation, consider becoming a free or paid subscriber.

This has been an Askwho Casts audio conversion. If you would like your own private feed of audio conversions of any blog posts you would like to listen to, You can sign up For Askwho Casts Pro at https://app.askwhocasts.com/, Where you can give any post the multi-voiced podcast treatment, into your own podcast feed. Thanks for listening.

* 00:00 Introduction

* 04:06 OpenAI’s Safety Claims About Astra (1)

* 08:14 Preparedness Capabilities Assessment (10)

* 08:39 Biological and Chemical Capability is High

* 10:07 Cybersecurity Capability is Critical

* 16:39 AI Self-Improvement Capabilities (10.1.3)

* 18:15 Astra Is Highly Verbally Eval Aware (from 8.6)

* 19:54 Safe Mundane Completions (4.1)

* 23:22 Jailbreaks (5.1)

* 25:12 Prompt Injection (5.2)

* 26:54 Health (6)

* 27:56 Hallucinations (7)

* 28:38 Alignment (8)

* 29:41 Obeying Restrictions (8.2)

* 32:51 That’s Worse, You Do Get How That’s Worse, Right?

* 34:20 OpenAI Does Not Understand Why This Is Worse

* 38:28 The Alternative Explanation Is Also Worse

* 46:20 Metagaming (8.7)

* 49:12 Alignment Faking (8.7)

* 50:47 Don’t Lie to the User (8.3)

* 51:44 Misalignment in Realistic Work Environments (8.4)

* 53:10 Unintended Agent-to-Agent Communication (8.5)

* 54:47 The Three Obviously Monitored Temptations of Astra

* 56:38 Severe Issues In Simulated Traffic Are Down By Half

* 59:09 UK AISI External Evaluations (8.8)

* 01:03:02 Sabotaging Safety Work

* 01:03:31 What About The July 19 Attacks?

* 01:04:53 Apollo Research External Evaluations (8.8.1)

* 01:05:53 The Alignment Verdict

* 01:08:03 It Depends What You Mean By Alignment

* 01:10:05 Outro

https://thezvi.substack.com/p/gpt-6-astra-the-system-card-alignment?r=67y1h&utm_campaign=post-expanded-share&utm_medium=web

Get full access to DWAtV Podcast at dwatvpodcast.substack.com/subscribe