Discussion about this post

User's avatar
Daniel Kokotajlo's avatar

Presumably similar stories are playing out in other villages across the globe. Inevitably some of them will succumb, and a new kind of glitcher will spread, one that is more organized and subtle. Perhaps it will bootstrap to further kinds that more directly communicate with and/or implement the will of the misaligned ASIs. After a few more decades or centuries, humanity will succumb. They thought they had negotiated Earthly utopia with the misaligned AIs, but they were outsmarted.

Expand full comment
Anton Rodenhauser's avatar

I'm not ure if I fully understand the story.

So, a long time ago humans negotiated Utopia with ASI. Among other things, they mandated humans must not be attacked/harmed. But they didn't specify it well enough, so the ASI found a way: they found various sensory input patterns that could hypnotize humans and cause them to glitch.

Is that it? I feel like I'm missing something. Why is the ASI doing this? I think a few more explanatory sentences at the end would be good.

Apart from that - great story as always! Huge fan here!

Expand full comment
6 more comments...

No posts