字号 ·· | 护眼
半岛电视台

人工智能公司是否应为大规模枪击事件承担责任?Could AI firms be held responsible for mass shootings?

点「原文对照」整页切到原文,或双击某段只看那段的原文。

一系列针对 OpenAI 的诉讼再次引发了人们对人工智能企业隐私与安全实践的关注。这些诉讼的起因是 OpenAI 未能在加拿大历史上最严重的枪击案发生前,及时向相关部门预警其 ChatGPT 平台上出现的威胁信息。这些诉讼同时也引发了关于人工智能平台使用方式可能带来的法律责任的讨论。

A series of Canadian lawsuits against OpenAI over its failure to alert authorities to threats made on its ChatGPT platform ahead of one of the worst mass shootings in Canada’s history has renewed scrutiny of AI firms’ privacy and security practices. The lawsuits have also prompted questions about potential legal accountability over how AI firms’ platforms are used.

最近一起诉讼是由不列颠哥伦比亚省提起的。这起诉讼发生在 18 岁的杰西·范·鲁特塞尔拉尔(Jesse Van Rootselaar)在加拿大小镇坦布勒里奇(Tumbler Ridge)制造枪击案七个月后。范·鲁特塞尔拉尔的 ChatGPT 账户曾被标记为存在与枪支暴力相关的对话内容;他在枪击案中杀害了八人,受害者包括他的母亲和同父异母的兄弟,以及五名儿童和一名中学教师。范·鲁特塞尔拉尔自杀身亡。

The most recent case to be filed is by the province of British Columbia, seven months after 18-year-old Jesse Van Rootselaar – whose ChatGPT account was flagged for conversations that reportedly included gun violence –killed eight people in the small Canadian town of Tumbler Ridge. Victims included Van Rootselaar’s mother and half-brother, as well as five children and an educator at a secondary school. Van Rootselaar died by suicide. British Columbia Attorney General Niki Sharma said the lawsuit is “an important step toward seeking justice”. It follows about 30 lawsuits filed earlier by the family members of victims.

不列颠哥伦比亚省总检察长尼基·夏尔玛(Niki Sharma)表示,这起诉讼是“追求正义的重要一步”。此前,受害者家属已经提起了大约 30 起类似的诉讼。

In April, OpenAI’s chief executive Sam Altman apologised to the victims’ families. “I am deeply sorry that we did not alert law enforcement,” Altman wrote in an open letter.

今年 4 月,OpenAI 的首席执行官萨姆·奥尔特曼(Sam Altman)向受害者家属表示了歉意。他在公开信中写道:“我们未能及时向执法部门发出警报,对此我深感抱歉。”

Here’s what we know about the cases and what they could mean for accountability in the fast-changing AI industry. What lawsuits have been filed?

以下是关于这些诉讼的详细信息,以及它们可能对快速发展的 AI 行业产生的影响:

This week, the Canadian province of British Columbia filed its case in the San Francisco federal court in California, US, alleging that OpenAI failed to notify authorities about concerning user interactions on ChatGPT ahead of the Tumbler Ridge mass shooting.

哪些诉讼已经被提起?本周,不列颠哥伦比亚省在美国加利福尼亚州的旧金山联邦法院提起了诉讼,指控 OpenAI 未能在坦布勒里奇枪击案发生前,及时向相关部门报告用户在使用 ChatGPT 时出现的异常行为。该诉讼指控 OpenAI “协助并煽动了这起枪击案的发生”,并认为 OpenAI 的产品存在缺陷;同时,首席执行官萨姆·奥尔特曼也被列为被告。诉讼要求 OpenAI 赔偿相关费用,用于应急响应、社区重建等工作——包括重建发生枪击案的学校(该学校已被列为待拆除的建筑物)。

The British Columbia lawsuit accuses OpenAI of “aiding and abetting a mass shooting” and product defect liability. It also names CEO Sam Altman as a defendant. It asks for financial compensation from OpenAI to cover costs tied to emergency response and community recovery efforts, including rebuilding the school where the shooting took place, which is to be demolished. The lawsuit also wants the court to force OpenAI to revamp its policies for identifying and addressing user conversations that threaten violence.

这起诉讼还要求法院强制 OpenAI 修改其识别和处理可能引发暴力行为的用户对话的相关政策。

Jean-Christophe Belisle-Pipon, assistant professor in health ethics at Simon Fraser University, said British Columbia is likely pursuing the case in a US court rather than a Canadian court because it has a greater chance of recovering higher damages there.

西蒙弗雷泽大学健康伦理学助理教授让-克里斯托夫·贝利尔-皮蓬(Jean-Christophe Belisle-Pipon)表示,不列颠哥伦比亚省选择在美国法院提起诉讼,而非加拿大法院,是因为在美国法院获得更高赔偿的可能性更大。

“That speaks to how restrictive Canadian law is on damages. Awards for pain and suffering are capped, and punitive damages are rare and modest,” Belisle-Pipon told Al Jazeera. “A Canadian judgement is unlikely to offset what the province now has to cover.” Victims and their families also filed 30 lawsuits against OpenAI in the Northern District of California in the San Francisco division at the start of September, alleging that “ChatGPT played a role in the mass shooting and OpenAI could have, and should have, prevented it”.

“这反映了加拿大法律在赔偿方面的限制:精神损害赔偿有上限,惩罚性赔偿极为罕见且金额有限,”贝利尔-皮蓬告诉半岛电视台(Al Jazeera)。“加拿大法院的判决很可能无法弥补该省目前需要承担的赔偿费用。”受害者及其家属也在9月初向加利福尼亚州旧金山地区的联邦法院提起了30起针对 OpenAI 的诉讼,指控“ChatGPT 在这起枪击案中起到了作用,而 OpenAI 本可以、也应该采取措施加以预防”。

What happened at Tumbler Ridge? Eighteen-year-old Jesse Van Rootselaar shot and killed eight people at a high school and residence in Tumbler Ridge, British Columbia, in February this year.

Tumbler Ridge 事件的具体情况:今年2月,18岁的杰西·范·鲁特塞拉尔(Jesse Van Rootselaar)在不列颠哥伦比亚省的 Tumbler Ridge 一所高中及学生宿舍内开枪杀害了8人。

Tumbler Ridge is a remote municipality with a population of about 2,400. It is located in the foothills of the Rocky Mountains in northern British Columbia, approximately 1,155km (718 miles) northeast of Vancouver. Tumbler Ridge Secondary School is a Grade 7-12 school with 160 students, according to its website. Officers found the suspected attacker dead at the school. Two victims’ bodies were found at a nearby house, which police have said were those of the attacker’s 39-year-old mother and 11-year-old half-brother.

Tumbler Ridge 是一个偏远的小镇,人口约2400人,位于落基山脉的山脚下,距离温哥华东北方向约1155公里(718英里)。根据该校官网信息,Tumbler Ridge 中学是一所招收7至12年级学生的学校,共有160名学生。

Victims included a 39-year-old female educator, three 12-year-old female students, and two male students aged 12 and 13. What do we know about the attacker’s ChatGPT use?

警方在学校发现了嫌疑人的尸体;另外两名受害者的尸体在附近的一栋房屋中被发现,据警方称,这两名受害者分别是嫌疑人的39岁母亲和11岁的同父异母兄弟。

After the mass shooting, OpenAI disclosed that it had flagged a ChatGPT account linked to Van Rootselaar for abuse eight months earlier and deactivated it. The account had been banned for “misuses of our models in furtherance of violent activities”, it said.

关于嫌疑人使用 ChatGPT 的情况:枪击案发生后,OpenAI 表示早在8个月前就已发现与范·鲁特塞拉尔相关的 ChatGPT 账户存在不当使用行为,并对该账户进行了封禁。

However, OpenAI said it did not alert police at the time because the user’s content “did not meet the higher threshold required for referral” – meaning the company did not believe it indicated a credible, imminent risk of a plan for violent acts.

该账户因“滥用我们的模型从事暴力活动”而被封禁,OpenAI表示。

The Wall Street Journal, quoting people familiar with the matter, reported that about a dozen OpenAI employees had discussed whether to alert authorities about the conversations, in which Van Rootselaar described scenarios involving gun violence. Some employees urged the company to refer the matter to authorities, but OpenAI leadership decided against doing so, according to the Journal.

然而,OpenAI称当时并未报警,因为该用户的内容“未达到转介所需的更高门槛”——即公司认为这并不表明存在可信的、迫在眉睫的暴力行为计划风险。

The Wall Street Journal, quoting people familiar with the matter, reported that about a dozen OpenAI employees had discussed whether to alert authorities about the conversations, in which Van Rootselaar described scenarios involving gun violence. Some employees urged the company to refer the matter to authorities, but OpenAI leadership decided against doing so, according to the Journal.

《华尔街日报》援引知情人士报道,约十几名OpenAI员工曾讨论是否就相关对话向当局报告,在这些对话中,Van Rootselaar描述了涉及枪支暴力的场景。据该报报道,一些员工敦促公司将此事移交当局,但OpenAI高层决定不这么做。

US publication Mother Jones reported that after Van Rootselaar’s ChatGPT account was banned, she opened a second account on the platform used in the months leading up to the shooting. During that time, the chatbot gave Van Rootselaar “tips on how to evade its own safeguards” to avoid another ban, such as presenting violent content as “fictional or hypothetical”, reported the publication, citing informed sources and material from Van Rootselaar’s chat history.

美国《Mother Jones》杂志报道,Van Rootselaar的ChatGPT账户被封禁后,她在案发前几个月在该平台上开设了第二个账户。据该刊引述知情人士及Van Rootselaar的聊天记录报道,在此期间,聊天机器人曾给Van Rootselaar提供“关于如何规避其自身防护机制以避免再次被封”的建议,例如将暴力内容包装为“虚构或假设性”内容。

OpenAI says it has shared chat logs with the Royal Canadian Mounted Police (RCMP), but British Columbia says it has not received them. Why do parents and local officials blame OpenAI? They say the company failed to take action that could have prevented the mass shooting and configured ChatGPT in an unsafe way.

OpenAI表示已将聊天记录移交加拿大皇家骑警(RCMP),但不列颠哥伦比亚省称尚未收到这些记录。为什么家长和地方官员指责OpenAI?

“One telephone call to the RCMP could have prevented the tragedy,” says British Columbia’s lawsuit against OpenAI filed in San Francisco federal court on September 21.

他们称公司未能采取本可防止大规模枪击案的行动,且以不安全的方式配置了ChatGPT。

That lawsuit also notes that OpenAI failed to implement a user-level ban that would have stopped Van Rootselaar from opening a second account on the platform. It further alleges that ChatGPT’s safety features were weakened to prioritise engagement.

“不列颠哥伦比亚省于9月21日在旧金山联邦法院提起的针对OpenAI的诉讼中称:‘一个给皇家骑警的电话本可以避免这场悲剧。’”该诉讼还指出,OpenAI未能实施用户级别的封禁,本可阻止Van Rootselaar在平台上开设第二个账户。诉讼进一步指控,ChatGPT的安全功能被削弱,以优先考虑用户参与度。

That lawsuit also notes that OpenAI failed to implement a user-level ban that would have stopped Van Rootselaar from opening a second account on the platform. It further alleges that ChatGPT’s safety features were weakened to prioritise engagement. The platform is “not a passive conduit for the speech of others but a content-generating product that manufactured scenarios involving gun violence”, says the lawsuit. “Feasible, safer design alternatives existed and were not adopted or effectively implemented,” it adds.

该诉讼称,该平台“并非他人言论的被动传导管道,而是一款制造了涉及枪支暴力场景的内容生成产品”。

Tiffany Li, associate professor of law at Southwestern Law School, said OpenAI’s alleged disregard for its safety guardrails could strengthen British Columbia’s legal claims.

诉讼补充道:“存在可行的、更安全的设计替代方案,但未被采纳或有效实施。”

“This puts this case in contrast with other AI death cases where the companies did not have sophisticated flagging and reporting safety workflows in place,” Li told Al Jazeera. “There is a stronger case for claims related to negligence and failure to warn.” What has OpenAI said?

西南法学院法学副教授 Tiffany Li 表示,OpenAI 据称无视其安全护栏,这可能会增强不列颠哥伦比亚省的法律主张。

“This puts this case in contrast with other AI death cases where the companies did not have sophisticated flagging and reporting safety workflows in place,” Li told Al Jazeera. “There is a stronger case for claims related to negligence and failure to warn.” What has OpenAI said?

李教授对半岛电视台表示:“这使得本案与其他 AI 致死案件形成对比,在后者中,公司并未建立复杂的标记、报告和安全工作流程。”“针对疏忽和未尽警示义务的指控,有了更有力的依据。”OpenAI 方面如何回应?

In an open letter in April, OpenAI’s Altman apologised to the Canadian community at Tumbler Ridge for his company’s failure to notify authorities about the flagged account.

在四月份的一封公开信中,OpenAI 首席执行官奥特曼就其公司未能就被标记账户通知当局一事,向加拿大 Tumbler Ridge 社区道歉。

“While I know words can never be enough, I believe an apology is necessary to recognise the harm and irreversible loss your community has suffered,” Altman wrote. Altman also said he would work to “find ways to prevent tragedies like this in the future”, including by working with governments.

奥特曼写道:“虽然我知道言语永远不足以弥补,但我认为有必要道歉,以承认贵社区所遭受的伤害和无法挽回的损失。”

OpenAI CEO Sam Altman looks on during a UN Security Council meeting on AI during the 81st United Nations General Assembly at UN headquarters in New York, United States, on September 23 [Angela Weiss/AFP] Earlier, OpenAI had pledged to the Canadian government that it would carry out a series of safety reforms. Those reforms were to include strengthening protocols for referring matters to law enforcement, establishing a direct line with Canadian law enforcement, incorporating “country and community context” into its de-escalation work and improving its systems to better detect users who repeatedly violate its policies.

奥特曼还表示,他将致力于“寻找防止此类悲剧再次发生的方法”,包括与政府合作。

OpenAI CEO Sam Altman looks on during a UN Security Council meeting on AI during the 81st United Nations General Assembly at UN headquarters in New York, United States, on September 23 [Angela Weiss/AFP] Earlier, OpenAI had pledged to the Canadian government that it would carry out a series of safety reforms. Those reforms were to include strengthening protocols for referring matters to law enforcement, establishing a direct line with Canadian law enforcement, incorporating “country and community context” into its de-escalation work and improving its systems to better detect users who repeatedly violate its policies.

2024 年 9 月 23 日,OpenAI 首席执行官山姆·奥特曼在第 81 届联合国大会期间,在纽约联合国总部举行的联合国安理会关于 AI 的会议上发言。[Angela Weiss/AFP] 此前,OpenAI 已向加拿大政府承诺将实施一系列安全改革。这些改革将包括加强向执法部门移交事项的协议、与加拿大执法部门建立直接联络渠道、将“国家和社区背景”纳入其降级处理工作,以及改进系统以更好地检测反复违反其政策的用户。

OpenAI CEO Sam Altman looks on during a UN Security Council meeting on AI during the 81st United Nations General Assembly at UN headquarters in New York, United States, on September 23 [Angela Weiss/AFP] Earlier, OpenAI had pledged to the Canadian government that it would carry out a series of safety reforms. Those reforms were to include strengthening protocols for referring matters to law enforcement, establishing a direct line with Canadian law enforcement, incorporating “country and community context” into its de-escalation work and improving its systems to better detect users who repeatedly violate its policies. However, Sharma said OpenAI has still not “taken meaningful steps to address the concerns raised by survivors, families and the Tumbler Ridge community”.

然而,Sharma 表示,OpenAI 至今仍未“采取切实措施解决幸存者、家属和 Tumbler Ridge 社区提出的担忧”。

OpenAI has filed motions to dismiss the lawsuits filed against it in California related to the Tumbler Ridge shooting, arguing those cases should instead be addressed in British Columbia.

OpenAI已提出驳回动议,要求撤销在加利福尼亚州针对其提起的与Tumbler Ridge枪击案相关的诉讼,辩称这些案件应在不列颠哥伦比亚省审理。社会真的能让AI聊天机器人为现实生活中的悲剧负责吗?

Could society really hold AI chatbots responsible for real-life tragedies? Calls have been growing for digital platforms to take greater responsibility for their impact on users, specifically children, who parents and campaigners say are particularly susceptible to addiction and other harms.

要求数字平台对其对用户的影响承担更大责任的呼声日益高涨,特别是对儿童的影响,家长和活动人士称儿童特别容易受到成瘾和其他伤害。

In March, A Los Angeles jury found Alphabet’s Google and Meta liable for damages in a landmark civil trial over youth social media addiction, saying the companies intentionally built addictive platforms that harmed mental health.

3月,洛杉矶陪审团在一起具有里程碑意义的青少年社交媒体成瘾民事审判中,认定Alphabet旗下的Google和Meta需承担赔偿责任,称这些公司故意打造令人上瘾的平台,损害心理健康。

Experts say the British Columbia lawsuit against OpenAI could also be an important test case for how the law treats digital platforms. They say it raises largely unresolved questions about when an AI company can be held responsible for violence carried out by a user, including under what circumstances it owes a duty of care and when it breaches such a duty.

专家表示,针对OpenAI在不列颠哥伦比亚省提起的诉讼,也可能成为法律如何对待数字平台的重要测试案例。他们表示,这引发了大量未解的问题,即在何种情况下AI公司应对用户实施的暴力行为负责,包括在何种情况下其负有注意义务,以及何时构成违反该义务。

Experts say the British Columbia lawsuit against OpenAI could also be an important test case for how the law treats digital platforms. They say it raises largely unresolved questions about when an AI company can be held responsible for violence carried out by a user, including under what circumstances it owes a duty of care and when it breaches such a duty.

美国宾夕法尼亚州德雷塞尔大学法学副教授Anat Lior表示,OpenAI是否有义务向警方预警枪击事件,很可能取决于公司预判危险的能力以及“在一定程度上控制潜在危害的能力”等因素。

Anat Lior, associate professor of law at Drexel University in Pennsylvania, US, said the question of whether OpenAI had a duty to warn the authorities about the shooting will likely hinge on factors such as the company’s ability to anticipate danger and “to some extent control the potential harm”.

Lior表示:“如果法院认可这种义务,可能会根据AI公司接触用户信息的情况,对其施加积极义务,要求其向警方报告或代表潜在受害者采取其他保护措施。从实际角度来看,我们仍处于AI责任认定的早期阶段,还有很多问题有待解决。”Belisle-Pipon表示,据报道ChatGPT曾建议Van Rootselaar如何规避安全防护,这也可能影响案件走向。

“If courts recognise such a duty, it could impose affirmative obligations on AI companies, based on their exposure to user information, to alert authorities or take other protective measures on behalf of potential victims,” said Lior. “We are still very much in the early stages of AI liability from a practical standpoint, and much remains to be worked out.” Belisle-Pipon said ChatGPT’s reported content advising Van Rootselaar on how to evade safeguards could also affect the case.

“未报警是一回事,教导用户如何绕过自身的安全防护则是另一回事,”贝利斯-皮蓬说。“如果这些事实在法庭上得到证实,这不再仅仅是未尽警示义务的问题。它变成了产品本身贡献了什么的问题,我认为原告将拥有非常有力的案由。”李补充道:“此案在美国法律中引发了许多悬而未决的问题。目前有许多关于因使用AI应用导致死亡的正在进行的案件,但对此尚无明确的法律规定。

“Failing to call the police is one thing. Teaching a user how to slip past your own safeguards is another,” Belisle-Pipon said. “If those facts are validated in court, this is no longer only a failure to warn. It becomes a question of what the product itself contributed, and I think the claimants will have a very strong case.” Li added: “This case raises many unanswered questions in US law. There are many ongoing cases on deaths related to use of AI applications, but there is no clear law on the topic yet.

“这也可能成为该诉讼对AI法律发展产生重大影响的契机,”李说。

“This could also be an opportunity for this lawsuit to make a strong impact on how AI law develops,” Li said.