字号·· | 护眼
印度斯坦时报

人工智能今日解围,明日或带来灾难AI Saves the Day—and Could Bring Doom Tomorrow

点「原文对照」整页切到原文,或双击某段只看那段的原文。

美国国家安全局告知各机构,如果无法立即修复其网站,就应当将其下线。不要仔细打补丁,也不要监视可疑活动,而是直接拔掉插头,根据美国国家安全局10月21日的公告显示。

The National Security Agency told organizations that if they couldn’t fix their websites immediately, they should take them offline. Not patch carefully. Not watch for suspicious activity. Pull the plug, according to the NSA’s Oct. 21 advisory.

这些漏洞存在于PHP中,也就是全球大多数网站背后的编程语言,它们允许任何人无需密码就在服务器上运行命令。德国、法国、比利时、荷兰、芬兰和捷克共和国临时关闭了一些政府网站。

The flaws were in PHP, the programming language behind most of the world’s websites, and they would let anyone run commands on a server without a password. Germany, France, Belgium, the Netherlands, Finland and the Czech Republic temporarily took down some government sites.

情况有多严重?日本首相在X.com上发文,要求国内做好打补丁的准备。我在这个行业度过了二十年,包括曾在五角大楼工作,现在则在范德堡大学任职,我的实验室专注于网络安全。我从未见过政府首脑发布这样的补丁通知。这不会是最后一次。

How serious was it? The prime minister of Japan went on X.com to tell her country to get ready to patch. I have spent two decades in this business, including at the Pentagon and now at Vanderbilt University, where my lab specializes in cybersecurity. I have never seen a head of government issue a patch notice like this. It won’t be the last.

以下是应该让你感到担忧的事情:这几乎是最好的情况。这些漏洞是在包括OpenAI在内的人工智能模型的帮助下被发现的,并且处理方式也符合我们的期望。它们在8月被悄悄报告给了PHP的维护者,维护者花费了两个月时间与OpenAI及外部安全研究人员合作修复,然后才公开发布。OpenAI表示,据其所知,人工智能发现这些漏洞的时间早于攻击者。

Here is what should worry you: This was pretty much the best-case scenario. The flaws were found with the help of artificial-intelligence models, including OpenAI’s, and handled the way we would want. They were reported quietly in August to PHP’s maintainers, who spent two months working with OpenAI and outside security researchers on a fix before releasing it publicly. OpenAI says that, to its knowledge, AI found these flaws before attackers did.

那是运气,而不是一个系统。即便是这一次,亚马逊在漏洞公开前四天也发现了有人试图利用这些漏洞。几天之内,攻击者就在利用这些漏洞入侵美国、日本、台湾和韩国的系统。

That is luck, not a system. Even this time, Amazon spotted someone trying to exploit the flaws four days before they were made public. Within days, attackers were using them to break into systems in the U.S., Japan, Taiwan and South Korea.

前沿人工智能实验室并不是这场游戏中的唯一玩家。开源权重模型(任何人都可以下载并在自己的硬件上运行、并剥离其安全控制的模型)仅落后于封闭的前沿模型几个月。这个差距正在迅速缩小。开源模型有其真正的优点,网络安全防御者也在使用它们。但防御者必须找到每一个漏洞,攻击者只需要利用一个。

The frontier AI labs aren’t the only ones in this game. Open-weight models, which anyone can download and run on his own hardware and strip of their safety controls, trail the closed frontier by mere months. The gap is closing fast. Open models have real virtues; defenders against cyberattacks use them too. But a defender has to find every flaw. An attacker needs to exploit only one.

这一迅速缩小的差距很大程度上要归功于中国。深度求索、阿里巴巴的通义千问以及不断增加的中国实验室正在推出功能强大的开源模型,它们是世界上下载量最大的模型之一。每一款发布的产品都是免费的,而且比上一款功能更强。任何人随时随地都可以在无需许可的情况下运行它们。

That swiftly closing gap is thanks in large part to China. DeepSeek, Alibaba’s Qwen and a growing field of Chinese labs are shipping powerful open models that are among the most downloaded in the world. Each release is free and a little more capable than the last. And each can be run without permission by anyone anywhere.

当开源模型能够做到OpenAI在这里所做的事情时,将不会有披露报告,没有从8月到10月的缓冲期,也没有由PHP基金会发布的修复程序。只会有人将模型指向互联网,并询问它能破坏什么。

When an open model can do what OpenAI’s did here, there will be no disclosure report, no August-to-October runway, no fix released by the PHP Foundation. There will just be someone pointing a model at the internet and asking it what it can break.

发现这样一个漏洞过去需要罕见的人才和数月的工作。不久之后,它只需要一个提示词。选择一个目标并点击开始。漏洞发现正从思考变成点击。进入门槛正在崩塌,任何想要点击的人都会点击。这可能是一个犯罪团伙、外国情报机构或一个无聊的青少年。

Finding a bug like this used to take a rare kind of mind and months of work. Soon it will take a prompt. Pick a target and press go. Vulnerability discovery is going from thinking to clicking. The barrier to entry is collapsing, and whoever wants to click, will. That could be a criminal crew, a foreign intelligence service or a bored teenager.

这一现实正向我们飞奔而来,而我们构建的世界尚未为此做好准备。我们的整个数字安全模式都假设发现灾难性漏洞是困难的,且能够做到这一点的少数人是为人所知的,而且大多站在我们这一边。软件制造商可以花几周时间来修复,因为在此期间很少有人能找到这个bug。公司可以按月制定补丁计划,因为攻击者需要时间来赶上。机构可以容忍其架构中的漏洞,因为他们笃信其他人无法找到或利用它。所有这些赌注都建立在人才稀缺的假设之上。这种情况持续了30年,直到上个月。

This reality is racing toward us, and the world we built isn’t ready for it. Our entire model of digital security assumes that finding a catastrophic flaw is hard, and that the few people who can do so are known and mostly on our side. Software makers could spend weeks working on a fix because few people could find the bug in the meantime. Companies could patch on a monthly schedule because attackers needed time to catch up. Organizations could tolerate a vulnerability in their architecture because they bet no one else could find or exploit it. Every one of those bets assumed talent was scarce. That held for 30 years—until last month.

问题不在于这是否会再次发生,而在于谁会率先到达。今天,这仍然是美国的前沿实验室。这种领先地位是我们拥有的最具价值的防御资产,而且它正在缩水。我们应该将世界赖以运行的代码视为关键基础设施,因为它们确实是。每个主要实验室都应该持续用其最好的模型来测试这些代码。华盛顿及其盟友应该为这项工作付费。

The question isn’t whether this will happen again. It is who gets there first. Today, that is still America’s frontier labs. That lead is the most valuable defensive asset we have, and it is shrinking. We should treat the code the world runs on as critical infrastructure, because it is. Every major lab should be running its best models against that code continuously. Washington and its allies should pay for this effort.

每当世界任何地方发布强大的开源模型时,我们的政府都应该在几天内知道它能破坏什么。每个运营网站的公司都应该停止将PHP的紧急情况视为一次性事件。这就是现在的常态。

Every time a powerful open model is released from anywhere, our government should know within days what it can break. And every company running a website should stop treating the PHP emergency as a one-off. It is what normal looks like now.

这一次,警告来自美国国家安全局和一位首相。下一次,警告可能不来自政府,而是来自率先得手的攻击者。

This time, the warning came from the NSA and a prime minister. Next time, it may come not from a government but the attackers who got there first.

戈尔德斯坦先生是范德堡大学国家安全研究所邪恶问题实验室的主任。

Mr. Goldstein directs the Wicked Problems Lab at Vanderbilt University’s Institute of National Security.

阅读媒体原文 ↗