해커뉴스에 올라온 에세이로, 현재의 생성형 AI가 환경·지적·인적 측면에서 순수익이 되지 않는다고 주장하며 개발자와 모든 이가 AI 확산에 적극 저항해야 한다고 촉구합니다. AI 데이터센터의 막대한 전력·물 소비, AI에 의존할 때 발생하는 학습 능력 퇴화, 노동자 대체 위험을 구체적 사례와 함께 제시합니다.
번역된 본문
--> 그렇다, 'AI 1세대 지니'는 실제로 유용해 보인다. 하지만 동시에 유혹적이며, 선택적으로 해롭고, 중요한 방식에서 우리 모두에게 해롭다. 경영진, 관리자, 컨설턴트, 개발자, 평범한 사람 모두에게: 저항하라!
TL;DR: 'AI 지니'는 당신의 친구가 아니다.
자성(Mea Culpa)
나는 프로그래밍용 'AI'를 전혀 사용하지 않는다. JetBrains IDE에 내장된 것조차도 사용하지 않으며, 사용할 생각도 없다. 하지만 내 손이 완전히 깨끗한 것은 아니다. Kagi/DuckDuckGo를 시도해 본 후 나는 검색은 다시 구글로 돌아갔고, 'AI 개요(AI Overview)'가 유용하다고 솔직히 인정한다. 그것은 자주 정확하며 내가 찾던 답을 제공한다. 나는 깨끗한 손으로 독자 앞에 서 있는 것이 아니다.
목적
나는 도덕을 설파하려는 것이 아니라, 현재의 'AI'가, 그리고 그것이 나아가는 방향이 개인으로서, 조직으로서, 사회로서, 세계로서 우리에게 순수익(net good)이 아니라는 논증을 하려는 것이다. 나는 우리 각자가 세상에서 맡은 역할이 무엇이든, 일반적으로 'AI'에 강력히 저항하고, 이미 파괴적이며 앞으로 더욱 파괴적이 될 기술에 직면하여 모두가 좋은 삶을 유지할 방법을 찾는 데 도움을 주어야 한다고 믿는다. 나의 목적은, 적어도 그 심각한 해악이 제거·완화·보상될 때까지, 커져야 할 'AI' 저항 운동의 능동적인 일부가 되는 것이다.
초점
여기서 나의 주된 초점은 넓은 의미의 소프트웨어 개발이다. 이 글의 독자 대부분은 소프트웨어 개발자지만, 전 세계와 다양한 직업군에서 온 다른 독자들도 의외로 많다. 그리고 각 독자는 물론 삶의 모든 측면에서 온 많은 사람들과 연결되어 있다. 나는 우리 모두가 'AI'의 성장에 저항할 수 있는 일을 해야 한다고 생각한다. 사람과 지구에 대한 해악이 처리되기 전까지는 말이다.
해악
환경적 해악
개별 'AI' 쿼리 하나가 몇 센트와 소량의 물과 전력만 소모한다는 것은 사실일 수 있다. 하지만 현재 'AI' 시스템을 '학습(training)'시키는 데 최대 1억 달러가 들어가며, 막대한 양의 CO2를 배출하고 10억 와트시 이상의 전력과 100만 리터의 물을 소비한다는 것도 사실이다. 전형적인 'AI' 데이터센터의 지속적인 전력 소비량은 약 10만 가구에 해당한다. 일일 물 소비량은 약 5만 가구 수준이다. 과장하는 것이 아니다. 우리는 'AI'가 우리의 세계를 망치지 않도록 저항해야 한다.
지적 해악
관심사 중 일부는 일시적인 것들이다. '헝거 게임 2'에 나온 그 배우가 누구인지 궁금해한다. 목소리가 익숙하다. 아, 맞다, 스탠리 투치. 좋았어. 하지만 우리 대부분에게는 직업이나 취미, 관심사에서 중요한 전문 분야가 있으며, 거기서는 진짜 이해가 필요하다. 진짜 이해는 우리의 주제 영역의 재료와 아이디어를 능동적으로 다루는 데서 나온다. 읽거나 영상을 보면서 조금 배울 수는 있지만, 결국 우리는 그 일을 해보고, 그 일에 대해 생각해야 하며, 정말 능숙해지기 전까지 아마 여러 번 반복해야 한다.
'AI'에게 질문에 답하게 하면, 물론 우리가 그 답을 꼼꼼히 검토할 수도 있다. 개발자라면 그것이 얼마나 잘 되는지 이미 알고 있을 것이다. 우리가 실제로 생각하고 작성한 코드는 그렇지 않을 때에도 옳아 보인다. 때로는 미묘하게, 때로는 노골적으로. 우리가 검토하는 코드는? 오타나 들여쓰기 위반 같은 쉬운 것을 찾아 지적하고, 그다음 하던 일로 돌아간다. 'AI'에게 질문에 답하게 하면 우리는 학습하지 못한다. 우리는 항상 그 오류를 잡아내지 못한다. 우리는 우리가 만들 책임이 있는 바로 그것에 대한 전체 그림을 잃는다. 과장하는 것이 아니다. 우리는 'AI'가 우리가 하는 일을 훼손하지 않도록 저항해야 한다.
인간에 대한 해악
기업들은 이미 'AI'로 인간 노동자를 대체하려 시도하기 시작했다. 'AI' 개발자들 스스로도 프로그래머와 다른 노동자들을 감원하고 있다. 아마도 'AI'가 그들을 대체할 수 있다고 생각하기 때문일 수도 있고, 더 가능성 높게는 'AI' 모델을 만드는데 지나치게 과도하게 지출했고 그 비용을 수익으로 상쇄하지 못했기 때문일 것이다. 만약 우리가 희소성 이후(post-scarcity) 사회에 살고 있다면, 'AI'로 인해 직업을 잃는 것도 (원문 중략)
--> Yes, the “AI 1 Genie” seems actually to be useful. But it is also seductive, selectively harmful, and in important ways harmful to us all. Executive, manager, consultant, developer, ordinary person: Resist! TL:DR The “AI Genie” is not your friend. Mea Culpa I do not use any of the programming “AIs”, not even whatever is built into JetBrains IDEs, and I do not intend to. However, my hands are not squeaky clean. After trying Kagi/Duck Duck Go, I have gone back to Google for search and I freely grant that I find the “AI Overview” to be useful. It is frequently correct and offers the answer I’m looking for. I do not come to you with clean hands. Purpose I am not here to dictate morality, but only to make the argument that “AI”, as it stands, and as it is tending, is not a net good for us as individuals, as organization, as society, as a world. I believe that each of us, in whatever roles we have in the world, should generally be strongly resisting “AI”, and helping to find ways to maintain good lives for everyone in the face of a technology that is already disruptive and will only become more so. My purpose here is to be an active part of what should be a growing resistance to “AI”, at least until its very significant harms have been eliminated, mitigated, or compensated for. Focus My primary focus here will be software development, but in a broad sense. My readership here is mostly software developers, but there are a surprising smattering of others from all over the world and the map of professions. And each reader, of course, connects to many people from all aspects of life. I think we all need to do what we can to resist the growth of “AI”, unless and until its harm for people and the planet is dealt with. Harms Environmental Harm It may be true that an individual “AI” query costs just a few cents and a small amount of water and power. It is also true that “training” that current “AI” systems code up to $100 million, producing huge quantities of CO 2 and consuming over a billion Watt-hours of electricity and a million liters of water. The ongoing power consumption of a typical “AI” data center is about equal to 100,000 households. Daily water consumption is around 50,000 households. I am not exaggerating: We need to resist “AI” so that it doesn’t ruin our world. Intellectual Harm Some matters of interest are ephemeral. We wonder who that actor is in Hunger Games 2 : his voice sounds familiar. Oh, right, Stanley Tucci. Cool. But for most of us, there are areas of expertise that are important to us, in our profession or our hobbies or interests, and here we need real understanding. Real understanding comes from actively working with the materials and ideas of our subject area. We can learn a bit by reading, or watching a video, but when it comes down to it, we have to do the thing, thinking about the thing, probably many times before we’re really good at it. When we let the “AI” answer the question, sure, we might check it over carefully. If you’re a developer you already know how well that works. Code we actually thought about and wrote seems right even when it isn’t, sometimes subtly, sometimes blatantly. Code we’re reviewing? We look for something easy, like a typo or violation of indentation, call that out, and then return to whatever we were really doing. When we let the “AI” answer the question, we do not learn. We do not always catch its errors. We lose the picture of the very thing we are responsible for building. I am not exaggerating: We need to resist “AI” so that it doesn’t damage the work we do. Human Harm Corporations have already begun to try to replace human workers with “AI”. The “AI” creators themselves are even shedding programmers and other workers, conceivably because they think “AI” can replace them, more likely because they have vastly overspent creating the “AI” models and have not been able to offset those costs with revenue. If we lived in a post-scarcity 3 society, having your job eliminated by “AI” could be a good thing, freeing your time to be spent on things more pleasant than work. You would still have full access to all the good things of life, food, health care, transportation, the Internet, education, recreation, and so on. In our current society, you’ll lose your income, be unable to support yourself and your family, and there is no effective social system to keep your life style where it was. I am not exaggerating: We need to resist “AI” so that thousands, perhaps millions of people do not die. Seductive The “AI” is programmed to seem polite, to seem friendly and accepting, to seem willing to help, to be open to your every idea, to be happy to try to please you. “You’re absolutely right!”, it says. Get serious, you might be somewhat right at best. The “AI” is seducing you. It is telling you things you want to hear, it is pretending that it will respect you in the morning. It will not. If you don’t remind it, it won’t even remember you in the morning. It does not contain respect. It does not contain good cheer. It does not contain willingness. It does not admire your thinking. It contains none of those positive feelings that it expresses to you. Look up the “Eliza effect” . Even the weakest conceivable program like this was seductive. These new ones are masters of seduction. I am not exaggerating: We need to resist “AI” because it is inherently far more seductive than it is valuable, and we are poorly defended against seduction. Resistance Advice What forms can resistance take? There are many, from complete refusal to touch “AI”, to careful honest study, to outright sabotage. Here are some ideas for folx with various roles in the world. They’re just my current quick thoughts: I have more concerns thus far than advice that goes much beyond “Resist”. Executives Resist. You’d be foolish not to get on top of “AI”: it’s here, and will only proliferate. However, because it is far from uniformly good for you or your company, I’d advise a very judicious approach to it. Don’t just send out the memo saying that everyone has to be 35% AI by next fiscal year. Instead, form a working group of smart people from all areas, some who favor “AI” and some who do not. Have them devise and propose experiments with “AI”. Not the BS kind of experiment: “Do an experiment showing how to save 30% in your department”. A real experiment: “Devise an honest AI experiment in your department, measuring real costs and real benefits. Try, honestly, to find all the flaws with this AI stuff.” Your first experiments should be designed to find out how bad “AI” is, and from those you can then have your working group work to find ways to use the stuff well—if that is even possible. Keep in mind, if you can, the overall costs to your company, to your people, and to the world. Work to understand. Then, later, to do. Managers Resist. My advice here is essentially the same as to executives, at the scale of your area. It’s almost certainly more important to understand how “AI” will fail you than to understand how it will help. Don’t demand that it work: they’ll just lie to you. Ask for the truth, the nitty gritty dirty truth. And, I suspect, you should be considering how much of your own work can be done by, or using, “AI”. Someone is going to be tempted to use it to write your quarterly reports. Keep in mind that the “AI” just averages its inputs and that it often gets it wrong. Keep in mind, if you can, your people, the ones who will be harmed by over-use of “AI”, perhaps by any use at all. Developers Resist. If you don’t have to use it, do not. If you do have to use it, use it as sparingly as possible. Try to use it well, and try to track more than just the times when it seems to be really good. Track all the times it’s wrong, all the times it goes down the wrong track. Track the time lost as well as the time saved, if any time is saved. Try to work, with your colleagues, sometimes with the “AI” and sometimes without. Try to keep track of how things go