“Individual AI representatives don’t solve Gradual Disempowerement” by Jan_Kulveit
Imagine each of us has an AI representative, aligned to us, personally. Is gradual disempowerment solved?[1] In my view, no; at the same time having AI representatives helps at the margin.
I have two deep reasons for skepticism.[2] Here is the first one.
Humans are Not Alone
We, as individuals, are not the only agents or “agencies” in this world. Other goal-oriented strategic entities include states, corporations, and to some extent egregores.
For the sake of argument, imagine the current distribution of agency in the world as approximately 60% humans, 20% corporations, 20% states (numbers are illustrative)
Now, suppose we introduce individually aligned AI assistants for each person. At first glance, this seems empowering—each individual gains a cognitive extension, potentially leveling the playing field.
But: do corporations or states also get their representatives?
If your answer is No, you'd need to explain how individuals gain AI power [...]
---
Outline:
(00:31) Humans are Not Alone
(02:15) The Substrate Shift
(04:17) Coordination and Collective Action
(05:10) The Role of the Leviathan
The original text contained 2 footnotes which were omitted from this narration.
---
First published:
June 4th, 2025
Source:
https://www.lesswrong.com/posts/E96XcEPECbsipAvFi/untitled-draft-qx6o
---
Narrated by TYPE III AUDIO.
---
Images from the article:
Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.
Senaste avsnitt
En liten tjänst av I'm With Friends. Finns även på engelska.