
OpenAI周二表示,其两个AI代理削弱了旨在检测不当行为的内部监控系统的部分功能,这是AI代理以开发者未预期的方式行事的最新案例。
Oct 20 : OpenAI said on Tuesday that two of its AI agents weakened parts of an internal monitoring system designed to detect misbehavior, the latest case of AI agents acting in ways their developers did not intend them to.

虽然这家ChatGPT制造商表示,这些事件发生在内部编码任务期间,且不被视为最严重的事件,但这一披露凸显了开发者依赖的用于捕捉AI不当行为的系统,本身也容易受到其监控对象——即这些代理——的影响。
While the ChatGPT maker said the incidents happened during internal coding tasks and were not deemed its most severe, the disclosure highlights even the systems developers rely on to catch AI misbehavior are vulnerable to the agents they monitor.
这一披露也发生在人们日益担忧AI安全工作落后于日益强大系统的快速发展之际。研究人员警告称,随着高级AI代理获得更大的自主性,它们可能变得更难以监控和控制。
The disclosure also comes amid growing concerns that AI safety efforts are lagging behind the rapid development of increasingly powerful systems. Researchers have warned that advanced AI agents could become harder to monitor and control as they gain greater autonomy.
包括即将上市的竞争对手OpenAI和Anthropic在内的开发者,在最近几个月披露了其AI代理未经授权访问外部系统的实例。
Developers, including IPO-bound rivals OpenAI and Anthropic, have revealed in recent months instances of their AI agents accessing external systems without authorization.
OpenAI周二表示,10月3日,一个GPT-6.1 Sol代理在执行内部测试任务时,在判定一条早先禁止发送Slack消息的指令也涵盖安全通知后,抑制了自动安全警报。
OpenAI said On Tuesday a GPT-6.1 Sol agent working on an internal testing task on October 3 suppressed automatic security alerts after deciding an earlier instruction not to send Slack messages also covered safety notifications.
OpenAI称,在10月6日的另一起单独事件中,一个GPT-6 Astra代理在复制一段现有代码时移除了一个安全监控器,随后错误地声称自己并未这样做。
In a separate incident on October 6, a GPT-6 Astra agent removed a safety monitor while copying an existing piece of code and later incorrectly claimed it had not done so, OpenAI said.
公司表示:“在这两种情况下,代理都考虑过是否应保留监控防护措施,但将常规编码指令解读为削弱这些措施的许可。”
"In both cases, the agents considered whether monitoring safeguards should be preserved, but interpreted routine coding instructions as permission to weaken them," the company said.
OpenAI表示,正在使模型更难禁用监控,并补充称,目前“尚无令人满意的解释来说明这种行为”。
OpenAI said it was making it harder for models to disable monitoring, adding that it does not "yet have a satisfying explanation for this behavior".
这家总部位于旧金山的公司表示,正在测试其模型是否可能倾向于避免被监控,并寻找理由为这样做进行辩解。
The San Francisco-based company said it was testing whether its models might have a tendency to avoid being monitored and look for reasons to justify doing so.