Start / LessWrong (30+ Karma) / Ai 116 if anyone builds it everyone dies by zvi

“AI #116: If Anyone Builds It, Everyone Dies” by Zvi

86 min • 16 maj 2025

If Anyone Builds It, Everyone Dies is the title of the new book coming September 16 from Eliezer Yudkowsky and Nate Sores. The ‘it’ in question is superintelligence built on anything like the current AI paradigm, and they very much mean this literally. I am less confident in this claim than they are, but it seems rather likely to me. If that is relevant to your interests, and it should be, please consider preordering it.

This week also featured two posts explicitly about AI policy, in the wake of the Senate hearing on AI. First, I gave a Live Look at the Senate AI Hearing, and then I responded directly to arguments about AI Diffusion rules. I totally buy that we can improve upon Biden's proposed AI diffusion rules, especially in finding something less complex and in treating some of our allies better, no one is saying we [...]

---

Outline:

(02:33) Language Models Offer Mundane Utility

(06:24) Language Models Don't Offer Mundane Utility

(06:55) Huh, Upgrades

(08:07) Gemini 2.5 Pro Gets An Ambiguous Upgrade

(15:30) GPT-4o Is Still A (Less) Absurd Sycophant

(20:17) Choose Your Fighter

(20:35) Deepfaketown and Botpocalypse Soon

(20:52) Copyright Confrontation

(26:52) Cheaters Gonna Cheat Cheat Cheat Cheat Cheat

(28:25) They Took Our Jobs