字号·· | 护眼
axios新闻网

当人工智能模型拒绝与黑客对抗When AI models refuse to fight hackers

点「原文对照」整页切到原文,或双击某段只看那段的原文。

蓝色背景上一个金属盾牌的插图,周围有汗水飞溅。Illustration of a metal shield on a blue background with sweat splashing around it.

在抵御人工智能赋能的网络威胁的竞赛中,安全团队面临一个新问题:他们依赖的用于调查攻击的人工智能模型可能会突然拒绝提供帮助。

In the race to fend off AI-enabled cyber threats security teams are confronting a new problem: The AI models they rely on to investigate attacks can suddenly refuse to help.

为何重要:当人工智能巨头竞相构建能够快速应对黑客攻击或其他恶意在线威胁的人工智能工具时,其最强大模型上严格的护栏却在调查进行中将防御者拒之门外,迫使他们在关键时刻四处寻找替代方案。

Why it matters: While AI giants race to build AI tools that can respond quickly to hacking or other malicious online threats, strict guardrails on their most powerful models lock out defenders mid-investigation, leaving them scrambling for alternatives at critical moments.

发生了什么:开源人工智能编码代理 OpenCode 称,其在周末遭到入侵,导致攻击者获取了部分客户的 API 密钥,其中包括 OpenAI、Anthropic 和 Google 服务的密钥。

What's happening: OpenCode, an open-source AI coding agent, said it was compromised over the weekend, allowing attackers to obtain API keys belonging to some customers, including keys for OpenAI, Anthropic and Google services.

  • OpenCode 表示,此次入侵“与一场影响了 1.4% OpenCode Console 用户的大规模蒸馏攻击有关”。

• OpenCode said the breach was "related to a large scale distillation attack that impacted 1.4% of OpenCode Console users."

  • OpenCode 联合创始人 Dax Raad 称,攻击者连续 48 小时针对其系统发动攻击,迫使该公司让自家的人工智能代理全天候运行以进行响应。

• OpenCode co-creator Dax Raad said attackers had been targeting its systems continuously for 48 hours, forcing the company to keep its own AI agents running around the clock to respond.

  • OpenAI、Google 和 Anthropic 表示,它们已与受影响客户合作,撤销泄露的 API 密钥并处理未经授权的使用费用。

• OpenAI, Google and Anthropic have said they worked with affected customers to revoke exposed API keys and address unauthorized usage charges. Zoom in:

深度聚焦: Raad 表示,前沿人工智能模型最初协助调查了此次入侵,但随后“开始拒绝”。• 据报道,随着调查转向潜在的恶意代码,这些模型的安全限制开始阻断请求,尽管 OpenCode 当时是在试图保护自己的系统。

Raad said on that frontier AI models initially helped investigate the breach but then "started refusing." • The models' safety restrictions reportedly began blocking requests as the investigation turned to potentially malicious code, even though OpenCode was trying to defend its own systems.

  • OpenCode 随后获得了 OpenAI “Daybreak Blue”计划的访问权限,该计划让经过审核的网络安全防御者能够使用限制较少的模型。

• OpenCode then gained access to OpenAI's Daybreak Blue program, which gives vetted cybersecurity defenders access to models with fewer restrictions.

  • “我们肯定需要更主动一些,过去几天我们已经做了许多改进,”Raad 周一在 X 上写道。

• "We definitely need to be more proactive and we've made so many improvements over the last few days," Raad wrote on X Monday.

大局观:这一事件凸显了网络安全团队面临的两难困境:在试图弄清何时使用功能强大的专有 AI 模型(这些模型带有内置限制),还是使用提供更大部署控制权的开放权重替代方案。

The big picture: The incident underscored a dilemma facing cybersecurity teams trying to figure out when to use powerful proprietary AI models, which come with built-in restrictions, or open-weight alternatives that offer greater control over how they're deployed.

  • 当 Hugging Face 发现其系统上存在可疑活动,并随后将其关联到 OpenAI 自身的智能体时,其安全团队在遭遇前沿模型的限制后,转而求助于一款中国开放权重模型来协助调查。

• When Hugging Face discovered suspicious activity on its systems that it later linked to OpenAI's own agents, its security team turned to a Chinese open-weight model to help investigate after encountering restrictions on frontier models.

但也有不同观点: AI 公司坚称,它们需要对最强大模型的访问权限设置门槛,以确保恶意行为者无法滥用其网络能力。

Yes, but: AI companies maintain that they need to gate access to their most powerful models to ensure that malicious actors can't abuse their cyber capabilities.

深层含义: Nightwing 首席技术官 Chris Jones 告诉 Axios,网络安全团队将不得不想办法,在对更快的 AI 驱动防御的需求与旨在防止这些能力落入攻击者之手的限制之间取得平衡。

Between the lines: Cybersecurity teams will have to figure out how to balance the need for faster AI-powered defenses with restrictions designed to keep those same capabilities out of attackers' hands, Chris Jones, chief technology officer at Nightwing, told Axios.

  • “我们都将不得不弄清这场竞赛将如何随时间推移而得到调节,”Jones 说。“这是这里的一个重要组成部分。”

• "We're all going to have to figure out how that race gets modulated over time," Jones said. "That's a big piece here."

阅读媒体原文 ↗