Discussion about this post

User's avatar
rif a saurous's avatar

Lovely piece, I think you're onto something.

A couple of thoughts:

1. I overall find your point about doubting being the difference the least convincing part of the argument. "In particular, text is all it takes to think and produce or consume unironically believable personhood, but doubt requires an awareness of the potential for misregistration between linguistic maps and the phenomenological territory of life." I'm not sure I'll agree with claims that today's LLMs are "thinking". I agree that today's LLMs don't have "an awareness of the potential for misregistration" because they're not aware at all. On the other hand, I think it will be easy(ish) to make LLMs that convince human users they are full of doubt...

2. On the other other hand, maybe it won't? One thing I've been coming back to a lot lately is McGilchrist (the book is too long, but https://besharamagazine.org/metaphysics-spirituality/iain-mcgilchrist-the-matter-with-things/ is a nice overview) and the idea that today's LLMs are approximating part of left-brained thinking, and that this wacko neuroticism we're seeing corresponds surprisingly well to people with certain types of serious left-brained lesions. And perhaps doubt corresponds to having a more right-brained and holistic view of the situation, and that's not going to be easy to do with today's LLMs.

3. I *also* choose "personhood — seeing and being seen — is a banal physical process and you are not that special for being able to produce, perform, and experience it." But I wouldn't have chosen it a decade ago, before I started meditating. I suspect that many folks who have gone at least moderately far down a Buddhist or similar path, which among other things makes it very easy to see yourself as a collection of constantly appearing and disappearing entities, would feel similarly? And the fact that you already do this maybe points at why you think / thought meditation was a bogus waste of time?

4. Who are the Illichian conviviality socialists? Inquiring minds want to know! Darren Allen maybe? Are there more?

Expand full comment
James Rutt's avatar

This is the first really serious take I’ve seen so far on the implications for our sense of selfhood resulting from the appearance of LLM based conversational systems like ChatGPT and similar technologies. I think he’s fairly close to right and that means this is a more destabilizing technology than it seems. It feels like “PCs” to me, which was the biggest change in my life time (born 1953). Internet, smartphones etc are merely an elaboration of PC. This is something else again.

Expand full comment
6 more comments...

No posts