저자(코리 닥터로우)는 AI가 생성한 텍스트나 이미지가 '의도(intention)'를 담고 있지 않다고 지적합니다. 인간은 모든 창작물에 의도를 읽어내는 본능이 있어, AI 산출물에서도 마치 다른 정신의 의도가 있다고 착각하게 됩니다. 이것이 AI가 논쟁적이고 매혹적이며 섬뜩하게 느껴지는 근본 이유라는 분석입니다.
번역된 본문
무신론자가 되는 것의 덜 주목받는 측면 중 하나는 일몰을 바라보는 방식이 어떻게 변하는가입니다. 전능하고 편재하는 신을 믿는다면 일몰은 신의 의도적인 창조물 중 하나이며, 어스름 하늘에 굴절되는 아름다운 색들은 그 효과를 내도록 선택된 것입니다. 종교적 신앙을 가지고 일몰을 바라보는 것은 또 다른 마음의 의도적인 행위와 마주하는 것입니다. 신앙 없이 같은 일몰을 바라보는 것은 인상적이고 아름답지만 '공허한' 것을 보는 것입니다. 경이나 아름다움이 없는 게 아니라 '목적'이 없는 것입니다. 그 태양을 하늘에 걸어둔 사람은 없고, 지는 태양의 색을 선택한 사람도 없습니다. 여전히 아름다울 수 있지만, 그것은 근본적으로 다른 종류의 아름다움입니다.
종교적 일몰과 무신론적 일몰의 중간쯤에 있는 일몰이 있습니다. 화가가 그린 일몰입니다. 이것은 또 다른 사람, 또 다른 마음의 선택을 나타내며, 최소한 그 마음은 '자기 자신과 대화하며', 마음속에 있는 무언가를 꺼내 마음 밖에 놓으려 했습니다. 아주 자주, 일몰을 담도록 이끈 그 마음은 다른 사람들에게, 어쩌면 당신에게 무언가를 말하고 싶어했습니다(사랑하는 사람이 카메라폰으로 찍은 일몰 사진을 보내는 것을 생각해 보세요). 그 그림이나 사진은 신성하지 않을지언정 분명히 '의도적'입니다. 일몰 그림을 바라보는 것은 누군가 만들기를 '선택한' 것을 바라보는 것입니다. 미끄러져서 우연히 일몰 그림을 만들 수는 없습니다. 일몰 그림은 사고가 아닙니다. 일몰 그림은 할 말이 있습니다.
의도를 파악하는 것은 우리 마음의 반사적인 몰두입니다. 그것이 우리를 교통사고로부터 지켜주고, 포커에서 이기게 해줍니다. 사랑과 양육, 효과적인 관리와 '상급자 관리'의 핵심입니다. 사람에게 화가 나는 이유이자 용서하는 이유입니다. 책이나 화면 속 인물들과 함께 심장이 뛰는 이유입니다. 시, 노래, 책, 조각을 만날 때마다 자동적이고 거부할 수 없는 출발점입니다. 나무 조각과 나무의 가장 근본적인 차이입니다. 나무는 스스로 자란 것이고, 조각은 다른 사람, 다른 마음에 의해 '의도적으로' 만들어진 것입니다.
이러한 의도를 돌리는 반사작용이 AI가 왜 그토록 논쟁적이고, 매혹적이며, 섬뜩한지를 설명합니다. 마크 피셔는 섬뜩함을 '무언가 있어야 할 곳에 아무것도 없거나, 아무것도 없어야 할 곳에 무언가가 있을 때'라고 정의합니다.
AI가 생성한 텍스트나 이미지를 바라보는 것은 '선택된' 것이 아니라 '짜내어진(extruded)' 것을 바라보는 것입니다. 실수로 미끄러져 AI에 일몰 이미지를 생성하도록 프롬프트할 수도 있고, 그 이미지는 아무런 의도도 담고 있지 않습니다.
->->->->->->->->->->->->->->->->->->->->->->->->->->->->-> Top Sources: None --> Today's links The Claude Delusion : What if we're the ones having hallucinations? Hey look at this : Delights to delectate. Object permanence : 9/11 v sex; 9/11 v flags; US customs v diplomatic Vegemite; CIA torture survivors speak; HP's inky timebomb; "The Raven" pop-up; Forex v Zimbabwe's internet; Shirky v "expert Wikipedia": McSweeney's v RIAA; Italy's internet disconnection law; Facehugger mask; "Goliath"; Netzpolitik v German surveillance; Ted Cruz v internet founders; Epipencil; Framework laptops; "The Actual Star;" Pilots tell passengers to tackle suspected terrorists; $2000 rotary phone; French DRM activists demand arrest; US child rearing costs up 40%; Calyx beats telcos; Wells Fargo whistleblower retaliation; David Graeber's "Mutual Aid"; Still censorship (even if it's not a First Amendment violation). Upcoming appearances : Berkeley, Edmonton, Boston, South Bend, Hudson, Calgary, Winnipeg, Paris, Vancouver, Victoria, Ottawa, Kilkenny, Montreal. Recent appearances : Where I've been. Latest books : You keep readin' em, I'll keep writin' 'em. Upcoming books : Like I said, I'll keep writin' 'em. Colophon : All the rest. The Claude Delusion ( permalink ) One of the less remarked-upon aspects of becoming an atheist is how it changes the way you see a sunset. If you believe in an almighty, omnipresent God, then sunsets are one of God's intentional creations, which means that the beautiful colors refracting through the darkling sky were chosen to produce that effect. To gaze upon a sunset with religious faith is to encounter the intentional act of another mind. To gaze upon that same sunset without faith is to look upon something striking, beautiful, and yet empty ; not empty of wonder or beauty, but empty of purpose . No one hung that sun in the sky, no one chose its colors as it sank. It may still be beautiful, but that's a fundamentally different kind of beauty. There's a sunset that sits halfway between a religious sunset and an atheist sunset: an artist's depiction of a sunset. This represents the choices of another person, another mind, and at the very least, that mind was talking to itself , trying to take something from inside the mind and put it outside of the mind. Very often, the mind that directed the capturing of the sunset wanted to say something to other people , perhaps even you (think of a loved one sending you a cameraphone picture of a sunset). That painting or photo may not be divine , but it is certainly intentional . To look upon a painting of a sunset - or even a photo of a sunset - is to look upon something someone chose to make. You don't slip and accidentally create a sunset painting. Sunset paintings aren't accidents. The sunset painting has something to say. Figuring out intentions is our minds' reflexive preoccupation. It's what keeps us from dying in traffic, it's what lets us win at poker. It's the key to love and parenting, to effective management and "managing up." It's why we get mad at people, and why we forgive them. It's why our hearts race in sympathy with the characters in a book or on a screen. It's the automatic and irresistible starting point for every encounter with a poem, a song, a book or a sculpture. It's the most fundamental difference between a sculpture of a tree and a tree: the tree grew all on its own, while the sculpture was made, on purpose, by another person with another mind. This reflex to attribute intention explains why AI is so controversial, so compelling, and so eerie . Mark Fisher defines eeriness as "when there is something present where there should be nothing, or if there is nothing present when there should be something": https://www.programmablemutter.com/p/large-language-models-are-uncanny To look upon an AI-generated text or image is to look upon a thing that was extruded , not chosen. You can slip and prompt an AI-generated image of a sunset, and it will embody no intentionality on anyone's part. This isn't something we have any experience with. When we see a painting, we reflexively interpret it as having a painter. When we read a book, we reflexively impute auctorial intent to its words. When we converse, we reflexively form a theory about the mind directing the other half of the conversation. But we can't do this with AI. Anyone who understands how the theory-free statistical inference systems we call "AI" (at this time) work will understand that they are systems that cannot form intent, that have nothing to form intent with : https://pluralistic.net/2026/09/18/surprise/#wow-signal Even so, it's hard (or perhaps impossible) to avoid the reflex to impute intention to things that seem to have intenders. Think of your autonomic, unavoidable emotional response to the fictional characters you encounter in literature. Feeling sorrow or joy for imaginary people is weird . They aren't real, and you know they aren't real, and yet you may find yourself moved to tears by their plight. That aesthetic experience of literature arises from a consensual hack to our reflex to impute human minds to things that are typically the product of human intention. When we experience another person's will - their words or deeds - we try to figure out who they are, and how they feel, and why they act the way they do: https://genius.com/David-byrne-and-ghost-train-orchestra-she-explains-things-to-me-lyrics We do this even when we are confronted with just the evidence of others' words or deeds, as when a friend describes an encounter with a stranger. For your reflexive, intention-seeking mind, the author who describes the deeds of imaginary people is an irresistible signal to fire up the old empathy machine and start trying to put yourself in the skins of the people of the tale: https://locusmag.com/feature/cory-doctorow-stories-are-a-fuggly-hack/ To "converse" with an AI is to carry on a dialog with a fictional character, who is no more real than the imaginary people in a novel. Indeed, the chatbot is less real than the character, because the character is the product of another mind, while the chatbot's words are the product of complex mathematical operations conducted over a massive database of all the words humans have uttered, arranged by their frequency in relation to one another. When that math makes something beautiful or striking, it's like a sunset: no matter how striking it is, it's empty. No one chose those colors. No one chose those words. In other words, when we interact with an AI, we hallucinate the person on the other side of the interaction. Those hallucinations are far more common and far more consequential than any AI-generated "hallucinations" (these are more properly called "errors" or "defects"). Fortunately, for most of us, the intensity of these hallucinations fades over time, and as that intensity drops off, the character of those hallucinations changes, too. Just as most of us find it easy to set aside the emotions evoked by the plight of imaginary literary figures as having less salience and "realness" than the emotions we feel over the plight of real people we know, for most of us, the experience of AI-generated material has dimmed through repetition. My first encounters with AI-generated text and images invoked wonder, arising from the tension between the part of my mind that knew this was the product of mathematical operations, and the part of my mind that insisted that a painting must have a painter, a paragraph must have a writer, and a conversation must have an interlocutor. Looking back on the wonder I felt then, I realize that it was largely driven by how good the output was relative to my expectations about how good mathematically-derived sentences and images could be . The novelty of that experience drove me to grade the machine's output on a curve: "The wonder is not that the dancing bear dances well, it is that the bear dances at all." But with repetition, the stimulus has regressed t