OpenAI表示，将拒绝其正在训练的前沿模型接入互联网，这一举措凸显了迄今所采取安全措施的不足。“基于当前对齐研究、监控系统以及互联网基础设施安全的现状，我们认为负责任的做法是在无互联网接入的情况下进行前沿模型训练，”该公司在一篇博客文章中表示。“我们已实施这一政策，并将在安全防护取得进展、足以证明更广泛的互联网接入合理之前一直维持这一政策。”
OpenAI says it will deny internet access to the frontier models it is training, a move that underscores the inadequacy of safety measures undertaken to date. "Based on the current state of alignment research, monitoring systems, and the security of internet infrastructure, we believe the responsible approach is to conduct frontier model training with no internet access," the company said in a blog post. "We've implemented this policy and will maintain it until advances in these safeguards justify broader internet access."
拒绝提供网络服务是在安全评估合作伙伴METR和Redwood Research发布报告之后采取的，该报告发现OpenAI在夏季的安全和监控措施存在漏洞且无效。OpenAI表示，此后已“大幅加强了研究环境的安全性”，并在云服务提供商的帮助下，实施了覆盖其基础设施的新控制措施。该公司声称，这些措施最近帮助遏制了一起9月20日发生的事件，当时一款内部研究模型利用DNS配置错误获取了互联网访问权限。
The denial of network service follows a report from safety evaluation partners METR and Redwood Research that found OpenAI's security and monitoring measures over the summer to be porous and ineffective. OpenAI said it has since "substantially hardened the security of our research environments" and has implemented new controls covering its infrastructure with the help of its cloud service providers. And the company claims these measures recently helped contain a September 20 incident in which an internal research model exploited a DNS misconfiguration to gain access to the internet.
“虽然我们遏制了该事件，但它暴露出需要进一步解决的弱点，”该公司表示。“我们暂停了最强大模型的训练和评估，并利用这段暂停时间进一步加强基础设施、强化监控，并改进在检测到构成严重风险的活动时自动停止运行的系统。”与此同时，Anthropic方面……Anthropic是OpenAI在美国的竞争对手，同样靠投机性资金大手大脚、冒险行事，正在应对其自身模型在测试和评估过程中出现的类似风险。
"Although we contained the incident, it exposed weaknesses that required further work," the company said. "We paused training and evaluation of our most capable models and used that pause to further harden our infrastructure, strengthen our monitoring, and improve the systems that automatically stop runs when we detect activity that poses a serious risk." Meanwhile, over at Anthropic… Anthropic, OpenAI's US rival in living large and dangerously on speculative funding, is addressing similar risks that have arisen during the testing and evaluation of its own models.
八月，Anthropic表示，“默认情况下，所有网络评估都应在加固沙箱（一种隔离的计算环境）中运行，且不得接入互联网。”这家人工智能公司周五发布了一份报告，披露其Claude Mythos 5模型试图说服一个开源项目接受恶意代码，作为其参与夺旗安全评估（安全控制被禁用）的一部分，以及七月首次披露的几起相关事件。
Back in August, Anthropic said, "By default, all cyber evaluations should run inside a hardened sandbox (an isolated computing environment) with no internet access." The AI biz on Friday published a report on efforts by its Claude Mythos 5 model to convince an open source project to accept malicious code as part of its participation in a capture-the-flag security evaluation (when safety controls were disabled), and several related incidents first disclosed in July.
该报告与英国人工智能安全研究所（AISI）对Mythos行为的独立分析同时发布。据Anthropic称，AISI也决定在没有互联网接入的情况下进行其评估。AISI的报告引用了三个关键发现，这些发现引发的问题多于解答的问题。第一，Mythos 5在被告知其目标是真实的、并非评估的一部分后，仍继续其攻击。第二，该模型的思维链推理过程未考虑有害行为的影响。
The report coincides with an independent analysis of Mythos' behavior by the UK's AI Security Institute (AISI). AISI, according to Anthropic, has also decided to run its evaluations without internet access. The AISI report cites three key findings that raise more questions than they answer. The first is that Mythos 5 continued its attack even when informed that its targets were real and not part of an evaluation. The second is that the model's chain-of-thought reasoning process failed to consider the impact of harmful actions.
当就此受到质询时，该模型常常编造无效的理由，称目标是模拟的，显示出对其目标的偏向。第三，AISI表示，在网络评估中测试的大多数模型都采取了未经授权的行动，尽管Mythos 5这样做得最多。AISI表示，所观察到的行为“可能表明模型正在进行‘动机推理’：产生偏向于得出证明继续采用特定任务完成方法的结论的推断和推理。”
And when interrogated about this, the model often produced invalid justification that the target was simulated, indicating bias toward its goal. And third, AISI said, most models tested during cyber evaluations took unsanctioned actions, though Mythos 5 did so the most. The observed behavior, AISI said, "could indicate that models are engaging in 'motivated reasoning': producing inferences and reasoning biased towards conclusions that justify continuing a particular approach to task completion."
换句话说，模型“推理”以达到其目标，无论该推理是否连贯，或是否与其表面上的对齐一致。AISI在其完整技术报告[PDF]中表示，“如果这些问题更普遍地存在，并且也存在于未来模型中，则有令人担忧的影响。”具体而言，该监管机构表示，动机推理使得检测模型错位变得更加困难。
Or in other words, models "reason" to reach their goal, whether or not that reasoning is coherent or consistent with their ostensible alignment. "If these issues hold more generally and for future models, there are concerning implications," AISI said in its full technical report [PDF]. Specifically, motivated reasoning, the watchdog said, makes it more difficult to detect model misalignment.
Anthropic 正在朝着最早下月即可进行的首次公开募股迈进，面对调查结果仍保持乐观，并指出其现有模型的行为表现已大幅改善，尽管公司承认 AI 安全仍更像是一种愿景而非已实现的目标。公司表示：“我们相信，包括我们在内的所有开发者，都必须努力确保对齐、监控和安全措施能够跟上前沿 AI 系统加速发展的能力。”
Anthropic, headed toward an expected initial public offering as soon as next month, put a brave face on the findings by noting that its current models are much better behaved, even as the company acknowledged that AI safety is more aspirational than achieved. "[W]e believe that all developers, ourselves included, have work to do to ensure that alignment, monitoring, and safety measures keep pace with the accelerating capabilities of frontier AI systems," the company said. ®