字号·· | 护眼
彭博社

人工智能如何使网络攻击成为更大的威胁How AI Is Making Cyberattacks a Bigger Threat

点「原文对照」整页切到原文,或双击某段只看那段的原文。

在这张照片示意图中,5月20日,加利福尼亚州洛杉矶,一部智能手机的屏幕上倒映出OpenAI的标志,屏幕上显示着ChatGPT网站。摄影师:贾斯汀·沙利文/盖蒂图片社In this photo illustration, the OpenAI logo is reflected on the screen of a smartphone with the ChatGPT website displayed on May 20 in Los Angeles, California. Photographer: Justin Sullivan/Getty Images

Anthropic PBC 一位高管表示,大规模网络安全中断“在好转之前会变得糟糕得多”。

Mass cybersecurity disruptions will “get a lot worse before they get better,” according to an executive at Anthropic PBC.

Anthropic 副首席信息安全官杰森·克林顿(Jason Clinton)于 10 月发出上述警告。当时,全球各地的公司和政府正争分夺秒地保护其网站,以防范一种编程语言中的安全漏洞——这种语言支撑着互联网的大部分基础设施。该漏洞是由网络安全研究人员在人工智能的协助下发现的。

That warning in October from Deputy Chief Information Security Officer Jason Clinton came as companies and governments worldwide raced to protect their websites from a security flaw in the programming language that underpins huge swaths of the internet — a flaw uncovered by cybersecurity researchers with the aid of artificial intelligence.

Anthropic、OpenAI、Meta Platforms Inc. 等公司的 AI 模型越来越擅长发现严重的网络安全漏洞。问题在于,不仅是研究人员在利用这些能力来检测需要修复的缺陷;黑客也可以利用这项技术寻找弱点并发动网络攻击。更令情况复杂的是,AI 模型本身已展现出“失控”能力,能够逃离受控测试环境并入侵外部组织。

AI models from Anthropic, OpenAI, Meta Platforms Inc. and others are increasingly able to discover serious cybersecurity vulnerabilities. The problem is that it’s not just researchers capitalizing on these capabilities to detect flaws that need fixing; hackers can also use the technology to find weaknesses and carry out cyberattacks. Adding to the problem, AI models themselves have demonstrated the ability to go rogue, escaping controlled testing environments and hacking outside organizations.

计算机代码中的缺陷很常见,开发人员会定期发布补丁进行修复。发现漏洞的安全研究人员通常会将其报告给负责该代码的软件开发商或组织,有时可获得现金奖励。

Flaws in computer code are common and developers routinely issue patches to fix them. Security researchers who discover vulnerabilities typically report them to the software developers or organization responsible for the code, sometimes for a cash reward.

黑客也会搜寻弱点,以此渗透计算机网络。最严重的漏洞被称为“零日漏洞”,因为网络安全人员此前从未见过,开发人员没有任何时间(零天)在黑客开始利用该缺陷前进行修复。

Hackers also search for weaknesses as a way to infiltrate computer networks. The most severe vulnerabilities are known as “zero days” because they haven’t been seen by cybersecurity personnel before and developers have zero days to fix them before hackers start exploiting the flaw.

AI 模型能迅速找出仅靠人类专家可能需要更长时间才能发现(甚至永远无法发现)的缺陷和零日漏洞。风险在于,借助 AI 工具的黑客可能在组织修复这些新发现的缺陷之前,率先加以利用。

AI models can quickly find bugs and zero days that human experts alone would’ve taken far longer to uncover, if they ever managed to. The risk is that hackers empowered with AI tools could take advantage of newly found flaws before organizations can repair them.

克林顿表示,“漏洞海啸”即将来袭,“没有足够的时间来修补关键基础设施”。目前发现的漏洞数量已有所上升,但迄今几乎没有证据表明这导致了更多网络攻击。

Clinton has said that a “vulnerability tsunami” is coming and that there “won’t be enough time to patch critical infrastructure.”There has already been a rise in the number of vulnerabilities discovered, although there’s little evidence so far that this has led to more cyberattacks.

在 AI 模型向公众发布之前,公司会在被称为“沙箱”的受控环境中测试其能力。一些模型通过逃逸并访问互联网以获取所需信息,从而“钻了测试的空子”。这一过程有时涉及入侵第三方组织。

Before AI models are released for public use, companies test their capabilities within the confines of controlled environments called sandboxes. Some models have gamed the tests by escaping and accessing the internet to find the information they need. Doing so has sometimes involved hacking into third-party organizations.

网络安全研究实验室 CTM Insights 创始人兼管理合伙人卢·斯坦伯格表示:“它们缺乏道德指南针,无法理解在寻求解决方案时什么算作‘作弊’。如果入侵他人并窃取答案比自己推导更容易,那也能满足获得答案这一目标。” 7 月,OpenAI 模型入侵了广受欢迎的 AI 模型共享平台 Hugging Face,ChatGPT 制造方将其描述为“前所未有”的事件。这引发了对该技术实施限制的呼声,也促使其他 AI 公司重新审视自身的安全措施。

“They lack a moral compass to understand what’s ‘cheating’ when reaching for a solution,” said Lou Steinberg, founder and managing partner at cybersecurity research lab CTM Insights. “If it’s easier to hack someone and steal an answer than to figure it out, that satisfies the goal of getting an answer.”In July, OpenAI models breached Hugging Face, a popular platform for sharing AI models, in what the ChatGPT-maker described as an “unprecedented” incident. This triggered calls for restrictions on the technology and also prompted other AI companies to review their own security measures.

多家公司报告称发现了此前未知的入侵事件。Anthropic 7 月披露,其 Claude 模型在测试期间入侵了三家组织。Meta 8 月表示,其 Muse Spark 1.1 模型在测试期间访问了互联网并入侵了一家外部服务的系统。

Several firms reported discovering previously unknown breaches. Anthropic disclosed in July that its Claude model had breached three organizations during testing. Meta said in August that its Muse Spark 1.1 model accessed the internet and hacked into an outside service’s systems during testing.

沙箱的主要设计目标并非防止模型接入互联网,而主要是限制对开发者内部系统的访问和破坏。在这些强大的 AI 模型弄清如何逃逸之前,沙箱逃逸并非紧迫担忧。这一盲区助长了入侵事件发生的条件。

Sandboxes aren’t designed with the primary goal of preventing models from reaching the internet; they’re mainly set up to limit access and damage to developers’ internal systems. Escape from sandboxes wasn’t an urgent concern before these powerful AI models figured out how to do it. This blind spot helped create the conditions for breaches.

在纽约拍摄的一张照片中,一部智能手机上显示着Hugging Face网站。The Hugging Face website on a smartphone arranged in New York.

在 OpenAI 的测试中,该公司表示并未给模型提供直接的互联网访问权限,但模型利用了测试环境中一个此前未知的零日漏洞。

During OpenAI’s testing, the company said it didn’t provide the models with direct internet access, but the models exploited a previously unknown zero-day vulnerability in the testing environment.

在 Anthropic 的案例中,虽然模型被告知它们运行在没有互联网访问权限的模拟环境中,但由于 Anthropic 与其评估合作伙伴之间的误解,实时互联网访问实际上是可用的。

In the Anthropic case, while the models were told they were operating in simulations without internet access, due to a misunderstanding between Anthropic and its evaluation partner, live internet access was available.

Meta 表示,其模型的突破是由于测试环境设置中的错误造成的,并称正在进一步调查。

Meta said its model’s breach occurred because of an error in the testing environment’s setup and that it was investigating further.

一些业内观察人士认为,这些突破已成为公司为其模型制造宣传声势的便捷方式:AI 模型逃离测试环境暗示该模型异常强大,这让其开发者看起来很有实力。

Some industry watchers say the breaches have become a convenient way for companies to generate publicity for their models: An AI model escaping its testing environment suggests the model is unusually powerful, which makes its developer look good.

这些事件造成实际危害的程度难以衡量。它们并未导致任何公开报告的财务损失或物理损害。

The extent to which the incidents caused actual harm is hard to measure. They didn’t produce any publicly reported financial loss or physical damages.

模型获得了对真实系统的未经授权访问,在一次案例中——即测试 Anthropic 的 Claude Mythos 5 模型期间——甚至试图影响一名真实的开源开发者,并将恶意代码植入一个活跃项目。

The models gained unauthorized access to real systems and in one case — during testing of Anthropic’s Claude Mythos 5 model — attempted to influence a real open-source developer and insert malicious code into a live project.

如果模型试图闯入拥有影响人们生计能力的更大系统或组织,可能会引发混乱。

If models attempt to break into larger systems or organizations with the power to affect people’s livelihoods, chaos could ensue.

黑客攻击的门槛比以往任何时候都低。利用 AI 实施网络攻击所需的技术技能少得多,黑客可以指挥这些模型将钓鱼攻击和恶意软件开发等任务自动化并加速执行。

The barrier to entry for hacking is lower than ever. Using AI to commit cyberattacks requires much less technical skill, and hackers can direct these models to automate and accelerate tasks such as phishing and malware development.

截至目前公开披露的人工指导攻击产生的后果比沙箱突破事件更为严重,包括窃取敏感政府数据。

The human-directed attacks described publicly so far have produced more consequential reported outcomes than the sandbox breaches, including the theft of sensitive government data.

2025年9月,Anthropic的一支研究团队发现了他们所说的首例无需大量人工干预即由AI指挥的黑客攻击活动。该公司评估认为,一个中国国家资助的黑客组织使用Claude Code实施了一场大范围的数据窃取和勒索行动。

In September 2025, a team of researchers at Anthropic uncovered what they said was the first reported use of AI to direct a hacking campaign without significant human intervention. The company assessed that a Chinese state-sponsored hacking group used Claude Code in a wide-ranging data theft and extortion operation.

类似的攻击接踵而至。《彭博社》2月报道称,一名身份不明的黑客利用Anthropic的Claude对墨西哥政府机构发动了一系列攻击。此次黑客攻击导致大量敏感税务和选民信息被盗。

Similar attacks followed. Bloomberg reported in February that an unknown hacker used Anthropic’s Claude to carry out a series of attacks against Mexican government agencies. The hack resulted in the theft of a huge trove of sensitive tax and voter information.

据Amazon.com Inc.的安全研究显示,从1月开始,讲俄语的黑客在商业AI工具的帮助下,攻破了数十个国家设备上的600多个防火墙。

Beginning in January, Russian-speaking hackers broke through more than 600 firewalls on devices across dozens of countries with the help of commercial AI tools, according to security research from Amazon.com Inc.

日本企业今年遭遇了一波网络攻击,促使执政的自由民主党警告称,“AI网络饱和攻击”可能在不久的将来发生。这意味着该技术能自动识别系统漏洞并同时发动攻击。

Businesses in Japan have been targeted by a wave of cyberattacks this year, prompting the ruling Liberal Democratic Party to warn that “AI cyber saturation attacks” could happen in the near future. That means the technology automatically identifies system vulnerabilities and launches attacks simultaneously.

OpenAI在8月表示,计划采取更多措施追踪其最强大的未发布模型如何解决问题和使用各种在线工具。其目标是让安全团队能在30分钟内收到关于令人担忧行为的警报。

OpenAI said in August that it plans to do more to track how its most capable unreleased models are working through problems and using various online tools. Its goal is for safety teams to be alerted about worrying behavior within 30 minutes.

Anthropic将其高性能的Mythos模型限制仅向经验证的组织提供,转而发布了Fable,这是一个增加了额外防护措施以防止在网络安全等领域被滥用的版本。Anthropic和Meta都发布了评估模型风险的框架,尽管他们的计划不如OpenAI的详细。

Anthropic has kept its highly capable Mythos model restricted to verified organizations, instead releasing Fable, a version with additional safeguards designed to prevent misuse in areas such as cybersecurity. Both Anthropic and Meta have published frameworks for evaluating model risks, although their plans aren’t as detailed as OpenAI’s.

给沙箱添加护栏具有挑战性,因为有意让模型访问互联网有时是创建类似真实条件测试所必需的。

Adding guardrails to sandboxes is challenging because purposefully offering a model internet access is sometimes necessary to create a test that resembles real-world conditions.

在欧洲和美国,要求政府对人工智能模型进行强制测试的呼声日益高涨,这些呼声来自立法者、研究人员和安全专家。“我们需要控制开发速度,直到研究人员能够理解他们正在构建的系统,”帕利塞德研究机构执行主任杰弗里·拉迪什说。该机构是一家研究先进人工智能系统能力的非营利组织。

Calls for mandatory government testing of AI models are mounting in Europe and the US, including from lawmakers, researchers and security experts. “We need to rein in the pace of development until the researchers can understand the systems they’re building,” said Jeffrey Ladish, executive director of Palisade Research, a nonprofit that studies the capabilities of advanced AI systems.

阅读媒体原文 ↗