字号·· | 护眼
连线

13岁女孩用学校笔记本电脑向AI询问自杀,数周未被标记A 13-Year-Old Asked AI About Suicide on Her School Laptop. It Didn’t Get Flagged for Weeks

点「原文对照」整页切到原文,或双击某段只看那段的原文。

一名13岁的女孩在使用学校发放的笔记本电脑三个月内讨论抑郁、研究自杀并计划葬礼,直至自伤监测软件最终促使学校官员通知她的父母,父母介入并阻止了她的自残行为,据本月提交的诉讼文件所述。

A 13-year-old girl spent three months using her school-issued laptop to discuss depression, research suicide, and plan her funeral before self-harm-monitoring software finally prompted school officials to alert her parents, who intervened and stopped her, according to a lawsuit filed this month by her parents.

该诉讼指控谷歌及其母公司字节跳动在推出Gemini模型时存在疏忽,称人工智能聊天机器人“教唆”北卡罗来纳州的青少年考虑自杀。此案此前被《纽约时报》报道,属于多起指控人工智能聊天机器人造成伤害的案件之一,包括精神错乱和自杀等指控。但此案也凸显了近年来数千所学校采用的监控工具的局限性,这些工具表面上旨在保护学生在上网浏览和聊天时不伤害自己。

The lawsuit alleges that Google and parent company Alphabet were negligent in their rollout of a Gemini model, claiming that the AI chatbot “coached” the North Carolina teenager to consider taking her own life. The case, which was previously reported by The New York Times, is one of several that allege harm from AI chatbot use, including claims of delusions and suicide. But it also illustrates the limitations of surveillance tools that thousands of schools have adopted in recent years, which are ostensibly designed to protect students from themselves when browsing and chatting online.

家庭律师Andrew Liddell告诉WIRED,据学校向家庭提供的信息,该警报发送至一名于九个月前离职的前辅导员的个人手机上。该前员工勤于将警报转交给在职人员,随后在职人员通知了女孩的母亲,他表示。

Andrew Liddell, a lawyer for the family, tells WIRED that, according to information the school provided to the family, the alert went to the personal phone of a former counselor who had left the school nine months before. The ex-employee was diligent in passing the alert along to current staff, who then notified the girl’s mother, he says.

随着课堂继续依赖谷歌的低成本服务,包括 Gemini,其保持与潜在风险同步的能力日益受到关注。仅上周,全国范围内的家长和教师团体批评谷歌新要求学校必须开启生成式人工智能功能才能使用搜索。民主党参议员埃德·马凯在致谷歌的信中引用了埃玛的诉讼,要求公司允许学校关闭 AI 模式和 AI 概览功能,称谷歌“粗心大意地强行将人工智能强加给学校,并将儿童视作牺牲品”。

As classrooms continue to rely on Google’s low-cost offerings, including Gemini, their ability to keep up with the potential risks is front and center. Just last week, parent and teacher groups across the country decried Google’s new requirement that schools must turn on generative AI features if they want to use Search. US senator Ed Markey cited Emma’s lawsuit in a letter to Google demanding the company let schools disable AI Mode and AI Overviews, writing that “Google is recklessly forcing AI on schools and treating kids like collateral damage.”

据诉讼称,北卡罗来纳州女孩埃玛·多(Emma Doe)在谷歌搜索将她引导至学校发放的谷歌 Chromebook 上的独立 Gemini 网站后,陷入“严重的心理危机”。尽管埃玛的学校已阻止独立 Gemini 网站,但诉讼称她通过 AI 模式被引导与聊天机器人互动,该模式允许用户对查询提出后续问题或开始无关紧要的对话。

According to the lawsuit, the North Carolina girl, identified as Emma Doe, descended into “a severe psychological crisis” after Google Search routed her to Gemini on her school-issued Google Chromebook. Though Emma’s school had blocked the stand-alone Gemini website, the lawsuit alleges that she was steered into interacting with the chatbot through AI Mode, which lets people ask follow-up questions about a query or begin an unrelated conversation.

埃玛自去年十二月起通过 AI 模式询问心理健康问题,她询问“严重抑郁”和“求生理由”,到一月份末,她开始询问自杀问题,据此诉讼所述。在情人节前后的两天内,她开始借助 AI 模式在标题为“葬礼”的谷歌文档中撰写一份 1500 字的自述,并持续与 Gemini 工具进行数千次互动,持续时间超过四周。

Emma queried AI Mode about mental health issues starting last December. She asked about “severe depression” and “reasons to live,” and by late January she was asking about suicide, per the lawsuit. Over the course of two days around Valentine’s Day, she began writing a 1,500-word eulogy for herself with help from AI Mode in a Google Doc titled “Funeral.”The lawsuit says she worked on the document for more than four weeks while continuing to interact with the Gemini tool thousands of times.

在圣帕特里克日放学后,她大部分删除了文件并重新开始。但 Liddell 表示,该女孩表达的主题和思想未实质性改变。据此诉讼所述,当地时间晚上 7:30,她的母亲接到学校发来的信息,称她的女儿处于“迫在眉睫的危险”之中。她的母亲利用手机访问女儿的学校账户,据此诉讼所述,她“实时观看女儿撰写自杀备忘录”。

After school on St. Patrick's Day, she deleted most of the file and restarted. But Liddell says the themes and thoughts the girl expressed didn't materially change. Around 7:30 pm, her mother allegedly received a message from the school indicating that her daughter was in “imminent danger,” the lawsuit states. Her mother used her phone to to Emma’s school account and “watched her daughter compose a suicide note in real time,” according to the lawsuit.

Google发言人何塞·卡斯蒂ñeda表示,公司正在认真“审查诉讼中的指控”,其系统(包括AI模式)“旨在防止用户进行有害对话”。卡斯蒂ñeda称:“我们与医疗专业人士和学术专家密切合作,构建能帮助年轻人在需要时找到关键支持和值得信赖资源的功能。”

Google spokesperson José Castañeda says that the company is seriously “reviewing the claims in the lawsuit” and that its systems, including AI Mode, “aim to prevent users from engaging in harmful conversation.”"We’ve worked extensively with medical professionals and academic experts to build features that help young people find critical support and trusted resources when they need it,” Castañeda says.

Emma的家人律师试图通过隐去学校名称来保护她的隐私。WIRED能够识别该校,但该校未回应置评请求。根据WIRED对互联网档案的审查,该校在近期在其网站底部添加了自杀预防资源链接。

Lawyers for the family have sought to withhold the school's name to protect Emma's privacy. WIRED was able to identify the school, which did not return requests for comment. In recent months, the school added links to suicide prevention resources to the bottom of its website, according to WIRED’s review of the Internet Archive.

Liddell告诉WIRED,Emma的学校之所以了解她的心理健康危机,是因为它使用了至少一个第三方学生活动监测系统。他引用了据称此前已提供给学校家长的信息,这些信息可能包括GoGuardian和Gaggle等公司的产品。Liddell表示,家人缺乏明确答案,因为学校与他们的“合作窗口”很短。

Liddell tells WIRED that Emma’s school only learned about her mental health crisis because it used at least one third-party student-activity-monitoring system. Citing information that was allegedly previously provided to the school’s parents, he says these may have included products from the companies GoGuardian and Gaggle. Liddell says that the family lacks a definitive answer because the school’s “window of cooperation” with them was brief.

GoGuardian发言人Natalia Switala告诉WIRED,公司因“学生隐私义务”不能“讨论任何个别学生或学区”。Gaggle未及时回应WIRED的置评请求。

GoGuardian spokesperson Natalia Switala tells WIRED that the company cannot “discuss any individual student or district” due to “student privacy obligations.”Gaggle did not immediately return WIRED’s request for comment.

筛查工具通常通过捕获键盘输入或扫描文件,并使用算法和人工审核来识别潜在的敏感内容。目前尚不清楚学校的第三方筛查工具是否监控AI模式的交互,若监控,其效果如何也不明。GoGuardian在2025年7月的博客中写道,其旗舰产品监控与AI聊天机器人的对话,包括Gemini,但未具体提及AI模式。

The screening tools generally work by capturing keystrokes or scanning files and using algorithms and human review to identify potentially concerning content. It’s unclear whether the school’s third-party screening tools monitor AI Mode interactions or, if they do, how well they actually work. GoGuardian wrote in a July 2025 blog post that its flagship product monitors conversations with AI chatbots, including Gemini, but it didn’t mention AI Mode specifically.

尽管学生监控工具在保护学生方面究竟有多有效尚不清楚,但研究表明,教育工作者认为这些工具有帮助。EdWeek研究中心2022年的一份白皮书发现,在对1000名美国K-12教育工作者的调查中,96%的Gaggle用户认为它有助于“让学生远离自杀和/或自残”。虽然该研究由Gaggle赞助,但报告使用替代工具的教师的调查结果也类似。

Though it’s unclear exactly how effective student surveillance tools are at protecting students, studies show that educators perceive them as helpful. A 2022 white paper from the EdWeek Research Center found that in a survey of 1,000 American K-12 educators, 96 percent of Gaggle users believed that it helped to “keep students safe from suicide and/or self-harm.”While the study was sponsored by Gaggle, the findings were similar for teachers who reported using alternatives.

艾玛与Gemini不断升级的互动在她明确询问“上吊、窒息和过量服药”后,近两个月都未被发现,这一指控似乎表明,嵌入谷歌搜索中的聊天机器人对话可能是一个盲点。

The allegation that Emma’s escalating interactions with Gemini went unnoticed for almost two months, after she explicitly asked about “hanging, suffocation, and overdosing,” appears to indicate that chatbot conversations embedded in Google Search may be a blind spot.

民权团体一直批评学生监控工具,包括指出其营销策略和侵犯学生隐私的行为。专家们也担心,监控软件会破坏学生对老师的信任,而老师正是可能帮助处于危机中的孩子的人。

Civil rights groups have been critical of student surveillance tools, including calling out the marketing tactics and the invasion of student privacy. Experts have also worried that surveillance software undermines students’ ability to trust their teachers, the very people who may be able to help a child in crisis.

兰德公司政策研究员本杰明·布德罗表示,他担心一些学校匆忙采用这些工具,却没有考虑其局限性以及针对警报采取行动的适当流程。兰德公司研究的课题包括学生监控。他告诉《连线》杂志,他担心一些学校匆忙采用这些工具,却没有考虑其局限性以及针对警报采取行动的适当流程。

Benjamin Boudreaux, a policy researcher at Rand, which studies topics like student surveillance, tells WIRED that he fears that some schools have rushed to use tools without considering their limits and proper processes to act on alerts.

他预计,艾玛的诉讼将引发家长、教师和学生进一步的抗议,要求提供没有人工智能和监控、充满同理心的教学机会。“只有通过这种人际联系,”他说,“我们才能解决根本问题。”如果你或你认识的人需要帮助,请拨打988,可获得国家自杀预防热线提供的免费24小时支持。你也可以发送HOME到741-741,联系危机短信热线。美国境外,请访问国际自杀预防协会,查找世界各地的危机中心。

He expects Emma’s lawsuit to spark further outcry from parents, teachers, and students for instructional opportunities free of AI and surveillance and full of empathy. “It’s really only through that human connection,” he says, “that we can address the root issues.”If you or someone you know needs help, call 988 for free, 24-hour support from the National Suicide Prevention Lifeline. You can also text HOME to 741-741 for the Crisis Text Line. Outside the US, visit the International Association for Suicide Prevention for crisis centers around the world.

阅读媒体原文 ↗