字号·· | 护眼
CNBC

科技公司在将AI引入学校之际面临日益增多的儿童安全诉讼Tech companies face mounting child safety lawsuits while pushing AI into schools

点「原文对照」整页切到原文,或双击某段只看那段的原文。

科技公司多年来一直在告诉家长,他们正在努力让自己的产品对儿童而言更加安全。然而,针对Meta、谷歌和Snap等公司的持续陪审团审判、和解以及相关诉讼表明,他们的做法还远远不够。

Tech companies have spent years telling parents they're working to make their products safer for children. But ongoing jury trials, settlements and related litigation against the likes of Meta, Google and Snap suggest that they're not doing enough.

最新的例子在本周出现。Snap秘密达成了一起诉讼的和解,该诉讼指控其技术给两名青少年用户造成了严重的心理困扰。Meta、TikTok和YouTube此前已与同一诉讼中的原告达成和解。而谷歌本周则被一名儿童的父母起诉,该儿童据称在谷歌教室(Google Classroom)中与Gemini人工智能聊天机器人聊天后遭遇了心理危机。

The latest examples landed this week. Snap confidentially settled a case claiming that its technology caused severe psychological distress to two teenage users. Meta, TikTok and YouTube previously settled with the plaintiffs in the same suit. And Google was sued this week by the parents of a child who allegedly suffered a psychological crisis after chatting with the Gemini AI chatbot in Google Classroom.

随着人工智能公司竞相追求数万亿美元的估值,以及老牌互联网巨头投入资金开发先进的人工智能模型并将其推向课堂,各方担忧正在加剧。发展心理学家凯特·布洛克(Kate Blocker)表示,旨在最大化用户粘性的产品和功能可能会对用户产生有害影响,因此有必要“对科技设计进行更广泛的系统性变革,特别是当儿童在使用这些产品时”。

Concern is intensifying as artificial intelligence companies pursue trillion-dollar valuations, and established internet giants pour money into developing advanced AI models while pushing them into the classroom. Products and features intended to maximize engagement can have detrimental effects on users, thus warranting "broader systemic changes in tech design, particularly when children are using them," said developmental psychologist Kate Blocker.

非营利组织“儿童与屏幕”(Children and Screens)的研究与项目主任布洛克说:“我认为,在设计这些产品(人工智能、社交媒体等)时,就必须考虑到儿童的安全,而不是在问题出现之后才去考虑,这一点极其重要。”

"I think it's so so important that children's safety is being considered when these products — AI, social media, et cetera — are being designed, and not after the fact as these problems emerge," said Blocker, the director of research and programs for the nonprofit Children and Screens.

McNicholas & McNicholas律所的新兴诉讼主任约瑟夫·麦克纳利(Joseph McNally)表示,Snap本周达成的和解使首席执行官埃文·斯皮格尔(Evan Spiegel)免于在洛杉矶法庭作证,这延续了科技公司试图在今年各种备受瞩目的儿童安全相关审判中保护自己免受公众监督的总体趋势。案是今年早些时候Meta和YouTube输掉的一系列与社交媒体人身伤害审判相关的诉讼之一。更多审判预定于3月开始。

Snap's settlement this week, which spared CEO Evan Spiegel from testifying in a Los Angeles court, continues a general trend of tech companies attempting to shield themselves from public scrutiny due to the various high-profile child-safety related trials this year, said Joseph McNally, the director of emerging litigation at McNicholas & McNicholas. The case was one of several lawsuits related to the social media personal injury trial that Meta and YouTube lost earlier this year. More trials are slated to commence in March.

前美国加利福尼亚州中区代理联邦检察官麦克纳利表示:“我认为这起和解案以及该领域的其他和解案,是科技公司试图扭转局面的努力,不仅是因为我认为存在真正的法律挑战,还因为其产品的声誉、公司的声誉确实受到了打击。”

"I view this settlement and the other settlements in this space as an effort by tech companies to turn a corner, not only because I think that there were real legal challenges, but also the reputation of their products, the reputation of their companies has really been hit," said McNally, a former acting U.S. attorney for the Central District of California.

Snap的一位发言人在一份声明中表示:“各方很高兴能够以友好方式解决此事。”

"The parties are pleased to have been able to resolve this matter in an amicable manner," a Snap spokesperson said in a statement.

这位Snap发言人表示:“我们已经建立了防护措施,推出了安全教程,并与专家进行了合作;由于安全工作永无止境,我们仍然致力于不断加强我们社群的安全、隐私和福祉。”

"We've built safeguards, launched safety tutorials, and partnered with experts and because safety is never finished, we remain committed to continually strengthening the safety, privacy, and well-being of our community," the Snap spokesperson said.

但仍有一起联邦诉讼涉及Meta、TikTok、Snap、YouTube以及全美的一系列学区,此外还有各州总检察长提起的各种诉讼。今年8月,Meta同意支付近170亿美元,在一桩儿童心理健康诉讼中与一组州总检察长达成和解。一些州总检察长仍在对Meta的竞争对手提起类似诉讼。

But there remains a federal case involving Meta, TikTok, Snap and YouTube and a litany of nationwide school districts, along with various state attorneys general suits. In August, Meta agreed to pay nearly $17 billion to settle with a group of state AGs in a child mental health case. Some AGs are still pursuing similar suits against Meta's rivals.

麦克纳利表示,这些社交媒体诉讼有助于让家长和公众了解该行业如何设计供青少年和儿童使用的产品。

The social media lawsuits have helped inform parents and the public about how the industry designs products used by teenagers and children, McNally said.

“这是一场持续进行的技术军备竞赛,”他说。“往往缺失的是如何在参与这场军备竞赛与实用性之间取得平衡,进而保障产品安全。”

"It's the technology arms race that continues," he said. "What is oftentimes missing is how you balance that participation in the arms race with utility and then product safety."

课堂面临更多审视 因行动过快,谷歌本周遭遇更多批评。《纽约时报》周二报道,不允许学生使用谷歌 AI 工具的 K-12 学校(注:美国基础教育阶段,即幼儿园至 12 年级)将失去搜索功能的使用权。谷歌教育业务副总裁克里斯·菲利普斯对《纽约时报》表示:“搜索与 AI 深度融合。”这与针对谷歌的新诉讼时间重合,诉讼核心指控一名青少年据称经历自杀危机,其父母将此归咎于公司的 Gemini AI。

More scrutiny in the classroom Google ran into more criticism this week for moving too fast. The New York Times reported on Tuesday that K-12 schools that don't allow use of Google's AI tools for students will lose access to search. Chris Phillips, vice president for education at Google, told the Times that, "Search and AI are deeply integrated." That coincided with the new lawsuit against Google centering on a teen's alleged suicidal crisis that the parents attributed to the company's Gemini AI.

原告律师指控:“尽管 Gemini 存在已知风险,谷歌仍仓促将 Gemini 集成到供学童使用的 Chromebook 电脑中。”

The plaintiff's attorneys allege that "despite Gemini's known risks, Google hastily integrated" Gemini into Chromebook computers for school children.

“我们正在审查诉讼中的指控,并对此高度重视,”谷歌发言人在一份声明中表示。“我们广泛与医疗专业人士和学术专家合作,构建功能以帮助年轻人在需要时找到关键支持和可信资源。”数十年来,谷歌及其互联网同行一直能够依赖《第 230 条》。联邦立法于 1996 年通过,保护社交媒体公司免因用户发布的内容而被起诉。因此,原告律师和州检察长将重点放在科技平台设计涉嫌造成的危害上,而非其内容。

"We are reviewing the claims in the lawsuit and we take this very seriously," a Google spokesperson said in a statement. "We've worked extensively with medical professionals and academic experts to build features that help young people find critical support and trusted resources when they need it." Google and its internet peers have for decades been able to rely on Section 230. Passed in 1996, the federal legislation has protected social media companies from being sued over content posted by their users. That's why plaintiffs' attorneys and state AGs have been focused on alleged harms stemming from the design of the tech platforms as opposed to their content.

一些原告正对 AI 公司采取相同策略。OpenAI 面临多起来自州检察长和原告律师的诉讼,他们借鉴社交媒体诉讼的思路,指控 ChatGPT 的设计可能对儿童构成风险。

Some plaintiffs are using the same tactics against AI companies. OpenAI faces several lawsuits from state AGs and plaintiff attorneys, taking cues from the social media suits in alleging that the design of ChatGPT can pose risks to children.

随着该公司正计划进行一场潜在的重量级首次公开募股(IPO),该诉讼可能会成为日益增加的财务风险。OpenAI的竞争对手Anthropic正计划于本月上市,并在其招股说明书中重点提到了这个问题,尽管这款Claude的开发者禁止儿童使用其产品。

The litigation could become a growing financial risk as the company plans for a potential blockbuster IPO. OpenAI competitor Anthropic, which is planning to go public this month, highlighted the issue in its prospectus, even though the Claude creator prohibits children from using its product.

旧金山大学法学院教授米歇尔·奈茨(Michele Neitz)表示:“这清楚地表明,科技公司预料到的诉讼风险比十年前要多。”

"This is a clear indication that tech companies anticipate more litigation risks than they did a decade ago," said Michele Neitz, a professor at the University of San Francisco School of Law.

布洛卡(Blocker)表示,当前人工智能驱动的聊天应用程序具有高度个性化的特质,这使得确定这些应用究竟会对孩子们说些什么变得“有点难以预测”。她强调了从一开始就对这些产品进行测试和评估以保障儿童发展安全的重要性,“而不是在伤害开始发生之后”。布洛卡说,这起集体诉讼有助于让公众认识到糟糕的产品设计选择所带来的潜在隐患,它可能成为推动科技行业变革的催化剂。

Blocker said that the highly personalized nature of current AI-powered chat apps makes it "a little bit unpredictable" to determine exactly what the apps will say to kids. She stressed the importance of testing and evaluating these products for children's developmental safety from the start, "not after harms start happening." This collective litigation has helped educate the public on the potential pitfalls of poor product design choices, Blocker said. And it could be a catalyzing force for change in the tech industry.

布洛卡表示:“当然,人们希望这将促成真正的系统性变革,无论从监管的角度还是从公司内部决策的角度来看都是如此。”

"Certainly there's a hope that this will motivate real systemic change, both from a regulation standpoint and internal company decision-making standpoint," Blocker said.

如果您有自杀倾向或感到痛苦,请拨打“自杀与危机生命热线”988,以获得受过培训的心理咨询师的支持和帮助。

If you are having suicidal thoughts or are in distress, contact the Suicide & Crisis Lifeline at 988 for support and assistance from a trained counselor.

阅读媒体原文 ↗