字号 ·· | 护眼
连线

无论人工智能安全是什么,都不是这个Whatever AI Safety Is, It’s Not This

点「原文对照」整页切到原文,或双击某段只看那段的原文。

给你上一堂有趣的历史课。别担心,我们会quickly讲完!1966年,美国公路上近5.1万人死亡。 overwhelming? 大量证据表明,如果使用当时已经问世数年的现代安全带,许多人的生命或许能够得以挽救。汽车行业于是团结起来,在自我监管方面取得了一场胜利,自愿让每一辆新下线的汽车都配备这一安全装置。

Here’s a fun history lesson for you. Don’t worry, we’ll make it quick! In 1966, nearly 51,000 people died on US highways. The overwhelming evidence suggested that many lives could have been saved with modern seat belts, which by then had been around for several years. The automotive industry responded by rallying together, and, in a triumph of self-regulation, voluntarily put the safety feature in every new vehicle that rolled off the line.

开玩笑的!他们当然没有这么做。1966年秋天,美国国会成立了运输部,随后通过了《国家交通安全与机动车安全法》和《公路安全法》,赋予联邦政府制定安全标准的广泛新权力。到了1968年,所有新车都必须配备安全带。尽管过去60年间公路交通流量大幅增长,如今道路上的死亡人数却少得多。

Kidding! Of course they didn’t do that. In the fall of 1966, Congress established the Department of Transportation and then passed the National Traffic and Motor Vehicle Safety Act as well as the Highway Safety Act, giving the federal government sweeping new authority to set safety standards. By 1968, seat belts were required in every new car. Despite a massive increase in highway traffic in the last 60 years, far fewer fatalities happen on the road today.

周二,我看着各家人工智能公司的首席执行官们簇拥在美国总统唐纳德·特朗普周围,为自己和彼此签署人工智能安全协议而相互祝贺。我的同事玛迪·瓦纳在这里写到了协议的具体条款,但简而言之,人工智能实验室很大程度上得靠约束自己来维持秩序。

I was thinking about this while watching various AI CEOs huddle around US president Donald Trump on Tuesday, congratulating themselves and each other on having signed an AI safety accord. My colleague Maddy Varner wrote about the specific stipulations here, but the short version is that it’s largely up to the AI labs to keep themselves in check.

或者,就像特朗普周三在椭圆形办公室里更加简洁地说:“他们会进行监管,会彼此监督,也会自我监管,会约束自己。最后一定会取得非常好的结果。”这就是当前人工智能安全监管的现状。一边是人工智能企业的高管、员工和科技界名流,他们都说,必须制定明确、周密且切实可行的规则,以避免潜在的灾难。(比如,比尔·盖茨最近频繁接受媒体采访,扮演预言人工智能末日灾难的卡珊德拉。)另一边则是特朗普的魔法思维:只要把一件事反复说上几遍,它就一定会成真。

Or, as Trump put it even more succinctly in the Oval Office on Wednesday: “They’re gonna police, and they’re gonna police each other, and they’re gonna self-police, they’re gonna police themselves. It’s going to work out very well.”So this is the current state of AI safety regulation. On one side are the AI executives, employees, and tech luminaries, who are all saying that there need to be clear, thoughtful, tactical rules introduced to avoid potential disaster. (Bill Gates, for instance, has been on a media blitz playing Cassandra about an AI apocalypse.) On the other side is Trump’s magical thinking that if you say something enough times, it must be true.

这并不是说这一切既简单又容易。如何恰当地“控制前沿发展速度”——一些高管也喜欢这样说——仍然没有定论。即使所有主要人工智能实验室都同意放缓发展步伐,也没有良策能确保它们信守承诺,而中国无论如何都可能继续走自己的路。美国经济越来越依赖人工智能产业提供支撑,而该产业本身已变成由融资交易和循环投资构成的衔尾蛇体系;任何实质性监管都可能引发剧烈震荡,其影响远超硅谷。

That’s not to say any of this is simple or easy. The question of how to properly “pace the frontier,” as some of those same executives like to say, remains open. Even if all of the major AI labs were to agree to a slowdown, there’s no good way to keep them to their word, and China would likely continue on its own path regardless. The US economy is increasingly propped up on the AI industry, which itself has become an ouroboros of financing deals and circular investments; any meaningful crackdown risks major instability that reaches well beyond Silicon Valley.

诚然,出于种种原因,将汽车行业作为类比并不完美。人工智能没有安全带这样的对应物,也没有哪种直接方案能够明确证明可以在一夜之间降低风险。(美国多数州花了几十年时间,才通过法律强制要求人们真正系好安全带。)人工智能可能造成的危害没那么确定,也没那么容易量化。人工智能末日论者会告诉你,这项技术可能在十年内导致人类灭绝;怀疑者则称,这不过是科幻营销的胡扯。

The automotive industry is also admittedly an imperfect analogy for all kinds of reasons. There’s no seat belt equivalent for AI, no straightforward solution that can demonstrably reduce risk overnight. (It also took decades for the majority of states to pass laws mandating that people actually wear them.) The potential harms are less certain and less quantifiable. AI doomers will tell you the technology could result in human extinction in a decade; skeptics argue that’s sci-fi marketing malarkey.

我们以前讨论过各种人工智能风险情景,但没有人能确切说明接下来会发生什么。如果你想找些数据来计算自己的个人末日概率p(doom),我建议你看看CNN最近的一篇报道:据称,美国军方曾险些登临一艘中国船只,部分原因是一份虚假的人工智能生成报告称该船载有核材料。人工智能协议究竟能否防止未来发生类似事件?如果能,又能做到什么?对此并不清楚。

We’ve talked about various AI risk scenarios before, but no one can say for certain what’s going to happen next. If you’re looking for data points to calculate your own personal p(doom), I’d point to a recent CNN report about how the US military supposedly nearly boarded a Chinese ship in part because a false AI-generated report said it was carrying nuclear materials. What, if anything, does the AI accord accomplish to prevent similar incidents from happening in the future? Unclear.

面对所有这些不确定性,正确的答案当然不会是“我想只能等答案揭晓了”。但自我监管恰恰会助长这种态度。值得肯定的是,OpenAI出于安全考虑,推迟甚至取消了其最先进模型的发布。但在此之前,这些模型已经针对不同目标发动过多次大规模黑客行动,相关新细节也仍在不断披露。

The correct answer to all this uncertainty surely isn’t “I guess we’ll find out.”But that’s exactly what self-regulation encourages. To its credit, OpenAI has delayed and even canceled the release of its most advanced models over security concerns. But not before they went on various, extensive hacking sprees, new details about which are still trickling out at a steady pace.

在周四刊登的《时代》周刊采访中,特朗普暗示,司法部和联邦调查局足以充当人工智能行业的“护栏”。事实真是如此吗?即使人工智能模型失控,人工智能公司是否能够被追究法律责任,目前都远不明确。何况人工智能智能体本身也不会收到传票。

In an interview with TIME published on Thursday, Trump suggested that the Department of Justice and the Federal Bureau of Investigation were sufficient “guardrails” for the artificial intelligence industry. Are they? It’s far from clear if AI companies can even be held legally responsible when their models go rogue. And it’s not like AI agents themselves are being served subpoenas.

事实上,眼下没有人知道如何确保人工智能安全。制定合适的框架并予以落实,需要大量协调、资源和监管权力,而这正是政府应当发挥作用的事情。特朗普政府非但没有尝试解决其中任何一个问题,反而选择让开道路,并告诉所有人继续踩油门。别费心系安全带了。本期为《模型行为》通讯。

The truth is, no one knows how to solve for AI safety right now. It’s going to take massive amounts of coordination, resources, and regulatory authority to develop the right framework and enforce it, which is exactly the kind of thing governments are designed to provide. Instead of even attempting to work through any of that, the Trump administration is getting out of the way and telling everyone to step on the gas. Don’t bother buckling up. This is an edition of the Model Behavior newsletter.