캘리포니아 데이비스 대학(UC Davis) 연구진이 뇌-컴퓨터 인터페이스(BCI)를 루게릭병(ALS) 환자의 뇌에 이식해 환자의 생각을 소리로 변환해 내는 데 성공했습니다. 환자는 연구진 없이도 집에서 3,800시간 이상 기기를 독립적으로 사용하며 웹 서핑과 업무를 수행하는 등 일상을 되찾았습니다. 이는 BCI 기술이 실험실을 벗어나 환자의 실제 삶의 질을 혁신적으로 향상시킬 수 있음을 증명한 중요한 사례입니다.
번역된 본문
경영 요약: 케이시 하렐(Casey Harrell)은 거의 3년 동안 뇌에 전극을 이식한 채 생활하고 있습니다. 루게릭병(ALS)으로 인해 전신 마비가 된 하렐은 2023년 연구팀의 도움을 받아 처음으로 뇌-컴퓨터 인터페이스(BCI)를 이용해 문장을 '말'했습니다. 그 이후로 하렐은 수천 시간 동안 기기를 사용해 왔습니다. 이제 그는 요양보호사의 도움을 받아 시스템에 '연결'하기만 하면 대부분의 기능을 독립적으로 사용할 수 있습니다. 연구팀은 기기에 새로운 기능을 추가했으며, 하렐은 이를 활용해 웹을 서핑하고 자신의 업무를 수행하고 있습니다.
"ALS와 같은 질병을 안고 살아가면 꿈이 줄어들 것이라 생각합니다. 하지만 저는 그렇지 않습니다." 하렐은 MIT 테크놀로지 리뷰와의 인터뷰에서 이렇게 말했습니다. "이러한 혁신 중 하나만 생겨도 절대적인 축복일 텐데, 이 모든 것과 그 이상을 얻게 된 것은 정말 혁명적입니다."
연구팀은 오늘자 '네이처 메디신(Nature Medicine)' 저널을 통해 기기 이식 후 처음 22.6개월 동안 연구원의 동행 없이 자택에서 3,800시간 이상 기기를 사용했다고 보고했습니다. 캘리포니아 데이비스 대학(UC Davis)의 신경공학자이자 연구팀의 일원인 세르게이 스타비스키(Sergey Stavisky)는 "그는 음성 BCI의 첫 번째 파워 유저(power user)입니다"라고 말했습니다.
음성 디코딩
3년 전 하렐은 자신의 뇌를 캘리포니아 데이비스 대학의 신경외과 부교수인 데이비드 브랜드만(David Brandman)과 그의 동료들에게 맡겼습니다. 당시 45세였던 하렐은 근육 사용 능력을 상실하게 만드는 퇴행성 질환인 ALS 진단을 이미 받은 상태였습니다. 하렐은 휠체어를 움직이거나 옷을 입고 먹는 일 등을 온전히 타인에게 의존해야 했습니다. 말하는 데에도 큰 어려움이 있어 사람들은 그의 말을 알아듣기 힘들어했습니다.
그러던 중 브랜드만 교수와 동료들은 그가 의사소통하는 데 도움을 줄 수 있는 뇌 임플란트 임상 시험에 참여할 의향이 있는지 물었습니다. 하렐은 "업계는 혁신적인 변화의 문턱에 있었고, 저는 그 일부가 되고 싶었습니다"라고 말하며 참여를 결심했습니다.
2023년 7월, 5시간에 걸친 수술을 통해 의사들은 그의 뇌에 64개의 전극이 달린 어레이(array) 4개를 이식했습니다. 한 쌍의 어레이는 '페데스탈(pedestal, 기저부)' 연결 지점에 연결되어 두개골 외부에 전극을 컴퓨터에 연결할 수 있는 두 개의 도킹 지점을 형성했습니다. 연구팀은 오랫동안 뇌 활동을 음성으로 해독하는 알고리즘을 개발해 왔습니다. 이 시스템은 말을 할 때 필요한 움직임을 담당하는 뇌 영역인 '음성 운동 피질(speech motor cortex)'의 활동을 기록하는 방식으로 작동합니다.
팀의 일원인 UC Davis의 신경공학자 니콜라스 카드(Nicholas Card)는 "미국 영어를 구성하는 모든 소리는 39개의 음소(phonemes)로 이루어져 있습니다"라고 설명했습니다. 각 음소를 내는 것과 관련된 신경 활동을 매핑하면 팀은 맞춤형 음성 디코더와 해당 단어를 '말'할 수 있는 소프트웨어를 만들 수 있습니다. 그는 "먼저 뇌 데이터를 음소로 변환한 다음, 음소를 단어로 변환합니다"라고 덧붙였습니다.
수술 약 한 달 후인 8월, 그들은 기기 사용을 시작했습니다. 카드는 하렐의 음성 디코더가 첫날 바로 작동했다고 밝혔습니다. 그날 하렐은 50개의 어휘를 사용하여 기기로 말을 했으며, 그중 99.6%가 그의 의도대로 정확히 출력되었습니다. 이후 어휘는 12만 5,000개로 확장되었고 정확도 역시 97.5%에 달했습니다.
당시만 해도 기기가 얼마나 오래 지속될 수 있을지는 불분명했습니다. 뇌-컴퓨터 인터페이스는 여전히 초기 단계였으며, 장기간 이식한 사례가 많지 않았습니다. 예를 들어 뇌의 전극 주위에 반흔 조직(scar tissue)이 형성되어 신경 활동을 감지하는 능력을 방해할 수 있습니다. 하지만 하렐의 경우 그런 일은 일어나지 않는 것으로 보입니다.
파워 유저(Power User)
또 다른 발전으로, 하렐은 이제 기기를 훨씬 더 독립적으로 사용할 수 있게 되었습니다. 2023년에는 하렐이 기기를 사용하고 싶은 날에 연구팀원이 그의 집을 방문하여 기기를 직접 연결하고 해제해야 했습니다. 하지만 지금은 다릅니다. 연구팀은 시스템의 상당 부분을 자동화하여 오늘날 하렐의 요양보호사가 손쉽게 기기를 착용 및 탈거할 수 있게 했습니다. 스타비스키는 "그는 아침에 일어나면 기기에 연결하고 바로 일상을 시작합니다"라고 말했습니다. 이는 매우 중요한 일이라고 네덜란드 위트레흐트 대학(Utrecht University)의 BCI 연구원인 마리스카 반스틴켈(Mariska Vansteensel)이 말합니다.
EXECUTIVE SUMMARY Casey Harrell has had a set of electrodes embedded in his brain for almost three years. Harrell, who has amyotrophic lateral sclerosis (ALS) and is paralyzed, first used his brain-computer interface (BCI) to “speak” sentences with the help of a research team in 2023. Since then, Harrell has clocked thousands of hours of use. He can use the device largely independently, once he’s been “plugged in” with the help of a carer. His team has added new features to it, and Harrell also uses it to surf the web and perform his job. “Living with a disease like ALS, you are supposed to have diminished dreams. I do not,” Harrell tells MIT Technology Review . “Any one of these things would be an absolute godsend of improvement. To have all of them, and many, many more, is truly revolutionary.” Within the first 22.6 months after the device was implanted, Harrell had used it for more than 3,800 hours at home without any researchers present, the team reported today in the journal Nature Medicine . “He’s the first power user of a speech BCI,” says team member Sergey Stavisky, a neuroengineer at the University of California, Davis. Decoding speech Three years ago, Harrell entrusted David Brandman, an associate professor of neurological surgery at the University of California, Davis, and his colleagues with his brain. Harrell, who was 45 at the time, had already been diagnosed with ALS, a degenerative disease that robs people of the use of their muscles. Harrell was dependent on others to control his wheelchair and to dress and feed him. He had difficulty speaking; people struggled to understand what he was saying. Then Brandman and his colleagues asked if he’d like to trial a brain implant that might help him communicate. “The industry was [on the] cusp of a transformation, and I wanted to be part of it,” says Harrell. He signed up. In July 2023, during a five-hour operation, doctors implanted four arrays of 64 electrodes each into his brain. Each pair of arrays was wired to a “pedestal” connection point—creating two docking locations on the exterior of his skull to connect the electrodes to a computer. The team had long been working on developing algorithms to decode brain activity into speech. Their system works by recording activity from the speech motor cortex—a region of the brain responsible for the movements that allow us to speak. “There are 39 phonemes that make up all the sounds in the [American] English language,” says Nicholas Card, a neuroengineer at UC Davis and member of the team. Mapping neural activity related to producing each of those phonemes can allow the team to create a personalized speech decoder and software that can “speak” those words. “We first go from brain data to phonemes, and then from phonemes to words,” he says. They started using the device around a month after the surgery. The team got Harrell’s speech decoder working on the first day , says Card. On that day in August, Harrell used the device to speak with a 50-word vocabulary, and 99.6% of the words were as he’d intended. That vocabulary was later expanded to 125,000 words with 97.5% accuracy. At the time, it was unclear how long the device might last. Brain-computer interfaces are still new—not many people have had them implanted for long periods of time. Scar tissue can form around electrodes in a person’s brain, interfering with their ability to pick up neural activity, for example. But that doesn’t seem to be the case for Harrell. Power user In another advance, Harrell is now able to use the device more independently. In 2023, members of the research team would have to visit Harrell at his home and physically connect and disconnect him from the device on the days he wanted to use it. Not anymore. The team has since automated more of the system—today, Harrell’s care partner can don and doff it for him. “He’ll wake up, get plugged in, and just get going,” says Stavisky. This is important, says Mariska Vansteesel, a BCI researcher at Utrecht Medical Center who was not involved in the trial. “For these technologies to be relevant for patients, we really need to test them in settings in which they will eventually be used … to demonstrate that it has value, that it’s usable, and that it functions well without the constant involvement of a research team,” she says. The team has also worked to improve the system itself. It is now 99% accurate, says Stavisky. Harrell can also control a cursor—a game changer that enables him to use his personal computer to send text messages and emails, surf the web, and keep up with his job as an environmental activist. Over the years, the team has updated the system to accommodate specific requests from Harrell. He is now able to switch on a “privacy mode”—when active, any decoded text will be automatically deleted. He can also opt to use a “profanity filter” while he’s talking to his young daughter. “We have been able to add on to the software side of the device … improving the accuracy and adding more bells and whistles to enable me to be more independent when using the device,” says Harrell. “We are making the road as we walk it, or roll it, so to speak.” Nothing short of revolutionary Vansteesel cautions that while the device is working well for Harrell, there’s no guarantee it will work as well, or as long, for other people with ALS. Over the last decade, she has worked with a woman with ALS who used a fully implanted device to communicate using “brain clicks”—cursor clicks made using brain activity. The woman used her BCI for seven years, but it stopped working toward the end of that period, apparently due to brain degeneration . At any rate, not everyone with ALS will be willing to undergo invasive brain surgery, says Jane Huggins, who is developing noninvasive BCIs at the University of Michigan and was not involved in the trial. “Long-term, independent use with efficient and accurate communication is kind of the holy grail of BCI,” she says. “But we have been finding a consistent aversion to hospital stays among people with progressive conditions like ALS.” Harrell, however, calls the device “nothing short of revolutionary.” “This has allowed me to keep working and earn money and insurance for my family. This is reconnecting me with friends and family who are too shy or too afraid to come over and not be able to understand me,” Harrell says. “With my seven-year-old daughter, I am able to create a bond that I wasn’t before able to forge. Now I can read to them and help them sharpen their own reading skills. By doing so, I am able to share the responsibility of parenting with my wife, who does so much caregiving for me and also our daughter.” Stavisky and his colleagues hope to improve the device further still. “We’re never satisfied,” he says. One aim is to eventually restore Harrell’s “full voice.” They are working on a “brain-to-voice” system that could directly decode brain activity to a speaking voice, complete with natural-sounding cadence, inflection and intonation—a voice that could sound happy, angry, or sarcastic, for example. “I was quietly confident that I could get some personal benefit from the system,” says Harrell. “Never in a million years would I think that I would achieve this much.” Deep Dive Biotechnology and health China has approved the world’s first invasive brain-computer chip—here’s what’s next The country wants to become a global leader in brain implants. Strong government support is expected to help accelerate that process. By You Xiaoying archive page Colossal Biosciences is growing chickens in a 3D-printed artificial eggshell In an early step towards artificial wombs, a biotech company claims it’s developed a “fully artificial” chicken egg. By Antonio Regalado archive page The “steroid olympics” were a circus—and a window into our culture Dozens of athletes on performance-enhancing drugs competed in the Enhanced Games. Organizers hope it'll sell a lot of peptides and other supplements. By Amit