字号·· | 护眼
路透社

企业人工智能缺失的保管链——为什么组织必须保存人工智能生成业务记录背后的输入、上下文和审计轨迹The missing chain of custody for enterprise AI — Why organizations must preserve the inputs, context and audit trail behind AI-generated business records

点「原文对照」整页切到原文,或双击某段只看那段的原文。

在这张2025年1月27日拍摄的插图中,可以看到一条写着“AI人工智能”的信息、一个键盘和几只机器人手。路透社/达多·鲁维奇/插图/资料照片A message reading "AI artificial intelligence", a keyboard, and robot hands are seen in this illustration taken January 27, 2025. REUTERS/Dado Ruvic/Illustration/File Photo

随着生成式人工智能融入日常业务运营,组织正越来越多地将人工智能生成的内容视为普通业务记录。人工智能系统现在可以起草报告、总结会议、分析合同、生成代码、准备客户沟通内容,并支持运营和合规决策。

As generative AI becomes embedded in everyday business operations, organizations are increasingly treating AI-generated content as ordinary business records. AI systems now draft reports, summarize meetings, analyze contracts, generate code, prepare customer communications, and support operational and compliance decisions.

在许多情况下,人工智能生成的输出会被保留、依赖并纳入正式的业务流程。

In many cases, the AI-generated output is retained, relied upon, and incorporated into official business processes.

然而,往往未被保存的是解释该输出是如何产生的必要信息。例如,提示词可能被删除,或用于生成该回复的文档可能随后发生变化。因此,当诉讼或内部调查出现时,组织可能会发现他们拥有最终记录,但缺乏重建其来源的能力。

What often is not preserved, however, is the information necessary to explain how that output was created. For example, a prompt may be deleted or the documents used to generate the response may later change. As such, by the time litigation or an internal investigation arises, organizations may discover that they possess the final record but lack the ability to reconstruct its origins.

这一新兴差距在人工智能时代构成了重大的电子取证和信息治理挑战:人工智能生成的业务记录缺少保管链。

This emerging gap presents a significant e-discovery and information governance challenge in the AI era: the missing chain of custody for AI-generated business records.

传统业务记录通常携带其来源的信息。电子邮件会标明发件人和收件人。文档通常包含元数据、修订历史和作者信息。数据库记录常可追溯至特定交易或用户活动。但人工智能生成的记录则不同。

Traditional business records generally carry information about their origins. An email identifies its sender and recipients. A document often contains metadata, revision history, and author information. Database records can frequently be traced to a particular transaction or user activity. But, AI-generated records are different.

考虑一名员工使用公司的企业版Copilot综合并总结一系列文档以制定公司政策。在通过多次迭代修改提示词后,该员工将最终的人工智能生成输出纳入一份Word文档,在人工输入和编辑后,最终成为公司政策的重要组成部分。

Consider an employee who uses the firm's enterprise Copilot to synthesize and summarize a collection of documents to create a firm policy. After revising the prompt through several iterations, the employee incorporates the final AI-generated output into a Word document that, after human input and edits, eventually becomes an integral firm policy.

提示词及其迭代和输出未被保存。此外,底层源文档随后被修订、删除或替换,且没有审计追踪能够识别出人工智能所依赖的确切版本。

The prompt, along with its iterations and outputs, is not saved. Additionally, the underlying source documents are later revised, deleted, or replaced, and no audit trail identifies the specific versions on which the AI relied.

此情形说明,仅保存最终输出可能导致难以 — 甚至无法 — 重建AI生成商业记录的来源。

This scenario illustrates how preserving only the final output can make it difficult — or impossible — to reconstruct the origin of an AI-generated business record.

虽然完成的记录可能存在,但它本身可能几乎不透露或根本不透露以下信息:

While the completed record may exist, it, in and of itself, may reveal little or nothing about:

  • 发起请求的提示词;• 系统查阅的文档或数据库;• 使用的模型版本;• 系统级指令或防护措施;• 中间输出或修订版本;• 人工编辑和批准;或• 由结果触发的自动化操作。

•The prompt that initiated the request;•The documents or databases consulted by the system;•The model version used;•System-level instructions or guardrails;•Intermediate outputs or revisions;•Human edits and approvals; or•Automated actions triggered by the result.

这些细节不仅仅是技术残留物。它们可能最终决定商业记录在诉讼中是否能够被认证、理解、质疑或辩护。

These details are not merely technical artifacts. They may ultimately determine whether a business record can be authenticated, understood, challenged, or defended in litigation.

联邦规则中不包含针对AI的特定保存要求,但保存可能与诉讼相关的电子存储信息(ESI)的义务适用于无论该信息是由人类还是AI系统创建的情况。

The Federal Rules do not contain AI-specific preservation requirements, but the duty to preserve potentially relevant electronically stored information (ESI) applies regardless of whether that information was created by a human or an AI system.

根据第37(e)条,一旦诉讼可预见,各方必须采取合理步骤来保存相关ESI。如果信息丢失且无法恢复或替换,法院可能施加补救措施,并在某些情况下施加制裁。

Under Rule 37(e), parties must take reasonable steps to preserve relevant ESI once litigation is anticipated. If information is lost and cannot be restored or replaced, courts may impose remedial measures and, in certain circumstances, sanctions.

挑战在于识别在AI环境中什么构成相关ESI。在许多情况下,最终输出可能不是唯一相关的信息。提示词、对话历史、上传的文档、检索结果、审计日志、系统指令和批准记录都可能变得重要。

The challenge is identifying what constitutes the relevant ESI in an AI environment. In many cases, the final output may not be the only relevant information. Prompts, conversation histories, uploaded documents, retrieval results, audit logs, system instructions, and approval records may all become important.

因此,组织面临一个关键的治理问题:如果AI生成的报告成为证据,必须保存哪些信息才能理解其生成过程?组织可能需要询问并证明:哪些信息进入了AI系统;系统当时生成了什么;人类对该输出做了哪些修改;以及基于该输出采取了哪些行动。

Organizations therefore face a critical governance question: if an AI-generated report becomes evidence, what information must be preserved to understand how it was created? Organizations may need to ask and demonstrate what information entered the AI system; what the system generated at the time; what changes humans made to that output; and, what actions were taken based upon it.

但请放心 — — 我并不是建议组织需要无限期地保存每一次AI交互。这种做法成本高昂,难以管理,并且可能与隐私和数据最小化义务不一致。

But fear not — I am not suggesting that organizations need to preserve every AI interaction indefinitely. Such an approach would be costly, difficult to manage, and potentially inconsistent with privacy and data-minimization obligations.

然而,对于重要的业务流程,组织应考虑保存一套最小的源信息,包括提示词及其修订版;上传的源材料;系统检索到的文档;模型标识符和版本信息;原始AI生成的输出;人工编辑和批准;以及时间戳。

However, for significant business processes, organizations should consider preserving a minimum set of origin information, including prompts and prompt revisions; uploaded source materials; documents retrieved by the system; model identifiers and version information; original AI-generated outputs; human edits and approvals; and, timestamps.

保存的适当程度应与使用场景的重要性成比例。AI生成的员工午餐菜单所面临的风险概况,与AI生成的合规报告、调查摘要、保险覆盖分析或财务建议截然不同。

The appropriate level of preservation should be proportional to the significance of the use case. An AI-generated employee lunch menu presents a different risk profile than an AI-generated compliance report, investigation summary, insurance coverage analysis, or financial recommendation.

重要的是,许多法律保全流程是围绕传统数据源设计的,例如电子邮件、云存储、消息平台和数据库。越来越多的情况下,这些程序也需要涵盖企业AI系统。

Importantly, many legal hold processes are designed around traditional data sources such as email, cloud storage, messaging platforms, and databases. Increasingly, those procedures will need to address enterprise AI systems as well.

因此,保管人访谈应包括以下问题:使用了哪些AI工具;提示词和输出是否被保留;在创建特别相关文档时,是否将文档上传到AI系统;AI生成的内容是否被纳入特别相关文档;以及是否发生了任何自动化操作。

As such, custodian interviews should include questions regarding what AI tools were or are used; whether prompts and outputs were or are retained; whether documents were uploaded into AI systems when creating a particularly relevant document; whether AI-generated content was incorporated into a particularly relevant document; and whether any automated actions occurred.

组织还应在诉讼发生前了解保留实践。一些平台会在相对较短的时间后自动删除对话历史、日志或输出。其他平台则保留大量审计数据,但导出能力有限。了解这些保留期限,更重要的是了解如何禁用任何自动删除功能,这对于确保相关提示词和输出被保存至关重要。

Organizations should also understand retention practices before litigation occurs. Some platforms automatically delete conversation histories, logs, or outputs after relatively short periods. Others retain extensive audit data but provide limited export capabilities. Understanding these retention periods and, more importantly, how to disable any auto-delete function is critical in making sure relevant prompts and outputs are preserved.

您可能会问:“为什么我不能只是重新运行提示词并重建输出?”不幸的是,这并不是上述问题的万能解决方案。

You may be asking, "Why can't I just re-run the prompt and reconstruct the output?" Unfortunately, this is not a panacea for the above problems.

将相同的提示词输入AI系统可能会在不同时间产生不同的输出。因此,组织不能假设他们可以通过简单地重新运行相同的请求,在数月或数年后重新创建AI生成的记录。重建可能会失败,原因如下:

Identical prompts fed into an AI-system may produce different outputs over time. As a result, organizations cannot assume they will be able to recreate an AI-generated record months or years later simply by rerunning the same request. Reconstruction may fail because:

  • AI供应商会定期更新、修改或淘汰模型。

•AI providers routinely update, modify, or retire models.

  • 许多企业AI系统依赖于从连接的存储库中检索信息;因此,在生成响应时可用的文档可能随后被编辑或删除。

•Many enterprise AI systems rely on retrieval from connected repositories; as such, documents available when a response was generated may later be edited or deleted.

  • 企业AI工具经常应用用户看不到的系统提示词、政策、模板和防护措施。仅保存用户的提示词可能会遗漏指令集的关键部分。

•Enterprise AI tools frequently apply system prompts, policies, templates, and guardrails that users never see. Preserving only the user's prompt may omit critical portions of the instruction set.

  • 员工经常将AI生成的内容复制到电子邮件、报告、演示文稿或案件管理系统中。一旦被编辑,确定哪部分是AI生成的,哪部分是人工添加的可能会变得困难甚至不可能。

•Employees frequently copy AI-generated content into emails, reports, presentations, or case management systems. Once edited, determining what was generated by the AI and what was added by a human may become difficult or impossible.

  • 代理型AI工作流程可能会与数据库、API、内部应用程序和第三方服务进行交互,因此没有单一系统可能保留交易的完整记录。

•Agentic AI workflows may interact with databases, APIs, internal applications, and third-party services, so no single system may retain a complete record of the transaction.

其结果是,组织可能拥有一份看似重要的业务记录,但缺乏解释其如何产生的必要信息。

The result is that organizations may possess a seemingly important business record but lack the information necessary to explain how it came into existence.

许多组织无法保留AI来源,除非其供应商提供访问权限。因此,发现准备应成为采购过程的一部分。

Many organizations cannot preserve AI sources unless their vendor provides access to it. Accordingly, discovery readiness should become part of the procurement process.

在部署企业AI系统之前,组织应评估供应商是否能够保留提示词和输出、保存审计日志、跟踪模型版本、识别检索到的来源、导出数据和元数据、实施法律保全,并在诉讼期间提供保存协助。

Before deploying enterprise AI systems, organizations should evaluate whether providers can retain prompts and outputs, preserve audit logs, track model versions, identify retrieved sources, export data and metadata, implement legal holds, and provide preservation assistance during litigation.

组织不应认为有关隐私保护或不使用客户数据进行训练的声明就能解决这些问题。数据的保留、保存、可审计性以及训练都是需要单独考虑的问题。

Organizations should not assume that assurances regarding privacy or non-training of customer data address these issues. Retention, preservation, auditability, and training are separate considerations.

在不久的将来,诉讼方、监管机构、审计机构和法院可能会越来越要求组织明确说明:哪些信息构成了人工智能辅助决策的基础,哪些指令影响了该决策,以及哪些人批准了该决策。如果组织仅保留了最终输出结果,那么这些问题可能就很难回答。

In the near future, litigants, regulators, auditors, and courts may increasingly ask organizations to identify the information that informed an AI-assisted decision, the instructions that shaped it, and the individuals who approved it. If the organization preserved only the final output, those questions may be difficult to answer.

如前所述,解决方案并非无限期保留数据;相反,组织应建立基于风险的数据来源追溯框架,以保留足够多的信息,从而能够解释具有重要影响的人工智能生成记录及其所引发的决策。

As stated previously, the solution is not unlimited retention; rather, organizations should develop risk-based provenance frameworks that preserve sufficient information to explain consequential AI-generated records and the decisions that flow from them.

在电子发现领域,仅仅保存文档本身从来都不够——与文档相关的保管链和真实性验证同样重要。对于人工智能生成材料的保存而言也是如此。因此,组织必须能够确定这些材料的来源、生成方式以及其可信度。

In the eDiscovery world, preserving the document has never been enough — the chain of custody related to and authentication of a document is of equal importance. The same is true for the preservation of AI-generated material. As such, organizations must be able to establish where such material came from, how it was created, and whether it can be trusted.

随着人工智能生成内容逐渐成为日常业务的一部分,基本的电子发现原则依然适用。挑战在于,保管链不再以文档本身为终点,而是扩展到了共同生成该文档的提示词、模型、来源、系统指令以及人类互动环节。

As AI-generated content becomes part of the ordinary course of business, the same basic eDiscovery principles apply. The challenge is that the chain of custody no longer ends with the document itself. It now extends to the prompts, models, sources, system instructions, and human interactions that collectively produced it.

那些从今天开始保存这些原始数据的组织,将在未来的诉讼团队提出一个简单问题时,占据明显更有利的地位:这份记录是如何产生的?

Organizations that begin preserving that source data today will be significantly better positioned when tomorrow's litigation teams ask a simple question: How did this record come to exist?