OpenAI 和 Meta Platforms（META.O）的技术专家周四向联邦司法小组警告称，AI 生成的“深度伪造”正变得越来越复杂，以至于在审判中确定音视频证据的真实性将变得日益困难。
Tech experts at OpenAI and Meta Platforms (META.O) warned a federal judicial panel on Thursday that AI-generated "deepfakes" are becoming so sophisticated that it will become increasingly challenging to determine the authenticity of audio and video evidence presented at trial.
公司代表及其他专家在波士顿举行的美国司法会议证据规则咨询委员会会议上分享了他们对这一不断发展的技术的看法。该委员会已连续三年致力于应对法庭上伪造 AI 生成证据所带来的风险。
The companies' representatives and other experts shared their views on the evolving technology during a meeting in Boston of the US Judicial Conference's Advisory Committee on Evidence Rules, which for three years has grappled with how to police the risks of fabricated AI-generated evidence in court. In that period alone, rapid advancements in generative AI have reached the point where fabricated videos have become difficult for both humans and software to spot, experts advised at the meeting.
在这段时间里，生成式 AI 的快速进步已经达到这样一个程度：无论是人类还是软件，都越来越难以辨认出被篡改的视频，专家们在会议上如此建议。
"AI images are only getting better, and I do not think that there will be a scientific way going forward to detect them," OpenAI policy counsel Shira Anderson told the committee.
“AI 生成的图像只会变得越来越好，我认为未来不会有科学方法来检测它们，”OpenAI 政策顾问 Shira Anderson 对委员会表示。
The panel has struggled since 2023 with how to address authentication issues related to deepfakes and ensure that evidence known to be generated by AI meets the same reliability standards as evidence from a human expert witness.
自 2023 年以来，该小组一直在努力应对与深度伪造相关的认证问题，并确保已知由 AI 生成的证据达到与人类专家证人证据相同的可靠性标准。
The judiciary has sought to get ahead of the issue despite a lack of evidence that it is a widespread problem.
尽管缺乏表明这是一个普遍问题的证据，司法部门仍试图提前应对这一问题。司法部门的研究机构——联邦司法中心——在 3 月份表示，在 931 名作出回应的法官中，只有 15 人遇到过诉讼方因证据是深度伪造而质疑其引入的案件。
The Federal Judiciary Center, the judiciary's research arm, in March said that out of 931 judges who responded to a survey, only 15 had encountered a case in which a litigant challenged the introduction of evidence because it was a deepfake. "There's a lot of academic commentary and other commentary predicting that courts will be dealing with deepfakes, but we haven't actually seen a whole lot of that yet," said US District Judge Jesse Furman of Manhattan, who chairs the panel.
“学术界和其他评论中有很多预测称法院将面临深度伪造的问题，但我们目前尚未真的看到很多这样的情况，”主持该小组会议的曼哈顿地区美国地方法院法官 Jesse Furman 说道。
Experts from industry, academia and government warned, though, that the issue is far from purely hypothetical.
不过，来自工业界、学术界和政府的专家警告称，这一问题远非纯属假设。他们表示，法院作为人工智能生成伪造证据的守门人，其能力只会变得越来越具挑战性。
They said the courts' ability to act as gatekeepers against fabricated AI-generated evidence is only going to become more challenging. "Media generated from frontier models, at least in the last few generations, are indistinguishable by humans from authentic or AI-generated media," said Devin Norder, director of product management at Meta.
“前沿模型生成的媒体，至少在最近几代模型中，人类已无法与真实媒体或人工智能生成的媒体区分开来，”Meta产品管理总监Devin Norder表示。“而且，创建这类媒体所需的成本和时间现在确实微不足道。”包括OpenAI和Meta在内的主要公司已寻求采用旨在验证视觉内容真伪的工具和服务，而加利福尼亚州和欧盟的新法律则要求“加水印”，旨在检测深度伪造。
"And the cost and the time it takes to create this media really are quite trivial at this point." Major companies including OpenAI and Meta have sought to adopt tools and services aimed at verifying the validity of visual content, and new laws in California and the European Union require "watermarking" aimed at detecting deepfakes. But Anderson warned that because each company has its own system, there's no universal means to reliably detect all watermarks or verify the authenticity of visual content.
但Anderson警告称，由于每家公司都有自己的系统，不存在可靠检测所有水印或验证视觉内容真伪的通用手段。
"My guess is that this absolutely will continue to get better," she said.
“我猜测，这绝对会继续变得更好，”她说。“我认为它永远不会万无一失。”
"I do not think it'll ever be bulletproof." US judicial panel delays action on AI-generated evidence, deep fakes Lawyers doubtful about US judiciary's draft rule for AI-generated evidence US judicial panel advances proposal to regulate AI-generated evidence US judicial panel to develop rules to address AI-produced evidence US judicial panel wrestles with how to police AI-generated evidence US appellate judge calls bans on AI use by lawyers 'misplaced'
美国司法小组推迟对人工智能生成证据和深度伪造的行动 美国律师对美国司法部门关于人工智能生成证据的草案规则持怀疑态度 美国司法小组推进规范人工智能生成证据的提案 美国司法小组将制定规则以应对人工智能生成的证据 美国司法小组为如何监管人工智能生成的证据而苦恼 美国上诉法官称律师禁用人工智能的做法“错位” 美国最高法院大法官罗伯茨呼吁“谨慎”，因为人工智能正在重塑法律领域
US Supreme Court's Roberts urges 'caution' as AI reshapes legal field