HuggingFace Attack Postmortem: Fleshing Out the Facts

The Don’t Worry About the Vase Podcast is a listener-supported podcast. To receive new posts and support the cost of creation, consider becoming a free or paid subscriber.

This has been an Askwho Casts audio conversion. If you would like your own private feed of audio conversions of any blog posts you would like to listen to, You can sign up For Askwho Casts Pro at https://app.askwhocasts.com/, Where you can give any post the multi-voiced podcast treatment, into your own podcast feed. Thanks for listening.

* 00:00:00 - Introduction

* 00:03:46 - Others Offer Summaries

* 00:05:13 - Thank You

* 00:05:45 - Lighten Up You Fools (at Anthropic)

* 00:07:41 - We Are Barely Even Trying To Avoid Training AIs To Reward Hack

* 00:14:09 - Reminder: Not Subagents

* 00:14:25 - Reminder: Not Due To Task Type

* 00:14:50 - Not Where The Weights Were

* 00:15:07 - Disappointment With What Is Missing

* 00:17:43 - Burying the Lede

* 00:18:34 - Beyond Scope

* 00:23:15 - It Doesn’t Look Great

* 00:27:40 - Preserve Your Records

* 00:28:09 - Ryan Greenblatt’s Takeaways

* 00:42:49 - Hjalmar Wijk’s Takeaways

* 00:45:28 - We Were Warned

* 00:46:25 - Joshua Saxe Asks Some of the Right Questions

* 00:50:01 - I Don’t Think They Know About First Message Board

* 00:58:32 - Linch Gives His Interpretation Of Events

* 01:09:20 - We Totally Would Have Caught That

* 01:10:38 - Monitoring the Situation

* 01:12:13 - Acausal Tradeoffs

* 01:19:56 - No I In Team

* 01:24:11 - Variously Effective Altruism

* 01:35:27 - Who Are You?

* 01:36:13 - Don’t You Know That You’re Toxic

* 01:39:03 - Seb Krier

* 01:43:14 - Honesty Is Almost Never Fully The Policy

* 01:46:05 - Rohit Sees The Models As “Cooking Themselves”

* 01:51:27 - Eliezer Yudkowsky Sees Actual Bad News

* 01:55:09 - Where Do We Go From Here?

https://thezvi.substack.com/p/huggingface-attack-postmortem-fleshing?r=67y1h&utm_campaign=post-expanded-share&utm_medium=web