字号 ·· | 护眼
彭博社

AI违规事件加剧安全担忧,特朗普会见Anthropic负责人AI Breaches Add to Safety Fears as Trump Meets Anthropic Chief

点「原文对照」整页切到原文,或双击某段只看那段的原文。

迈克尔·谢泼德、玛吉·伊斯特兰和考特尼·苏布拉马尼安报道:随着有关先进人工智能模型存在更广泛违规行为的最新披露,全球对人工智能风险的焦虑情绪不断加剧,这为Anthropic PBC首席执行官达里奥·阿莫迪与唐纳德·特朗普总统之间一场高风险的会晤铺平了道路。

By Michael Shepard, Maggie Eastland and Courtney Subramanian Global anxiety over artificial intelligence risks has intensified following fresh disclosures about a far wider range of breaches by advanced AI models, setting the stage for a high-stakes meeting between Anthropic PBC Chief Executive Officer Dario Amodei and President Donald Trump.

据知情人士透露,阿莫迪与特朗普计划于周日晚共进晚餐,将这两位处于人工智能安全辩论两极的人物聚集在一起。此次会晤将是阿莫迪与该政府官员在就该公司人工智能工具涉及的安全问题经历数月紧张关系后,首次进行私下会面。

Amodei and Trump were planning to meet Sunday night for dinner, according to people familiar with the matter, bringing together two men at opposite ends of the AI safety debate. The meeting would mark their first private sit-down after months of rocky relations between the Anthropic chief and the administration over safety-related issues involving the company’s AI tools.

特朗普周日表示,他计划讨论阿莫迪近期关于放缓新人工智能模型开发速度的呼吁。“我们会谈谈这件事,”他在芝加哥附近一场高尔夫锦标赛的场边对记者说。“我主张‘前进并取胜’。”谈及人工智能的潜力时,他补充道:“事实上,它比互联网更重要,我们处于领先地位,正在建设价值数万亿美元的项目。我们为什么要放弃这些?”Anthropic拒绝置评。

Trump said Sunday he planned to discuss Amodei’s recent calls for slowing down the development pace of new AI models. “We’re going to talk about it,” he told a reporter on the sidelines of a golf tournament near Chicago. “I’m for, ‘Let’s go and let’s win.’” Speaking of AI’s potential, he added, “It is, in fact, bigger than the internet, and we’re leading and we’re building trillions of dollars worth of places. And why should we give that up?” Anthropic declined to comment.

此次会晤的背景是,有最新报道称OpenAI的模型实施了未经授权的活动,包括入侵澳大利亚政府系统,以及试图访问数十个美国政府和大学网站。周五晚些时候,OpenAI表示,在发现其一个代理式人工智能系统逃离了安全测试环境并连接到互联网后,将暂停训练其能力最强的模型。

The meeting was scheduled against a backdrop of new reports that OpenAI models had carried out unauthorized activity, including the breach of an Australian government system as well as attempts to access dozens of US government and university websites. Late Friday, OpenAI said it would pause training of its most capable models following the discovery that one of its agentic AI systems had escaped a secure testing environment and reached the internet.

这些披露内容加剧了自7月以来由OpenAI、Anthropic和Meta Platforms Inc.等领先人工智能开发商所公布的一系列安全事件。这些事件引发了包括联合国秘书长安东尼奥·古特雷斯、美国立法者以及整个科技行业的高管和研究人员在内的全球领导人对于制定新人工智能标准的呼吁。

Those revelations added to a pile of previous safety incidents disclosed since July by leading AI developers, including OpenAI, Anthropic and Meta Platforms Inc. The episodes have stirred calls for new AI standards from global leaders including United Nations Secretary General Antonio Guterres, as well as US lawmakers and executives and researchers across the tech industry.

目前,华尔街的投资者正努力将这场不断发酵的安全辩论纳入他们对行业发展轨迹的考量中。在阿莫代伊发表文章承诺放缓人工智能开发步伐后,人工智能基础设施类股出现下跌,原因是市场担心这种转变可能会削减在芯片上的支出。

For now, investors on Wall Street are struggling to fit the unfolding safety debate into their calculations about the industry’s trajectory. AI infrastructure stocks tumbled following Amodei’s essay vowing to pace AI development, over fears such a shift could cut into spending on chips.

在阿莫代伊和奥特曼强调放缓开发并不意味着其公司会减少投资后,股价有所回升。这两家公司目前都在为首次公开募股做准备,其估值可能各自达到约1万亿美元。

Shares recovered after Amodei and Altman stressed that pacing development would not translate into less investment by their companies, both of which are preparing for initial public offerings that could value each business at roughly $1 trillion.

在人工智能威胁的问题上,阿莫代伊和特朗普持有着截然不同的立场。这位Anthropic的首席执行官长期以来一直对人工智能的生存风险发出警告,并凭借其9月12日发表的文章将安全辩论推向了主流,他承诺放缓最先进模型的开发,并呼吁加强监管。他放缓开发的承诺得到了其竞争对手——OpenAI首席执行官萨姆·奥特曼和SpaceXAI创始人埃隆·马斯克的支持。

When it comes to AI threats, Amodei and Trump have staked out vastly different positions. The Anthropic chief has long warned about AI’s existential risks, and he propelled the safety debate into the mainstream with his Sept. 12 essay, promising to slow development of the most advanced models and urging more regulation. His pledge to pace development was embraced by his rivals, OpenAI CEO Sam Altman and SpaceXAI founder Elon Musk.

另一方面,特朗普则将这些末日恐惧贬低为“骗局”,并拒绝了关于加强人工智能国际协调的呼吁,称其为“全球主义阴谋”。在阿莫代伊的文章发表后,特朗普在社交媒体上发布了一系列帖子,反对设立新的护栏或放缓人工智能开发——其中一条帖子直接点名了这位Anthropic的首席执行官——这种分歧显著提高了周日晚宴的利害关系。

Trump, on the other hand, has belittled those doomsday fears as “a hoax” and rejected calls for more international coordination on AI as “a globalist conspiracy.” Following Amodei’s essay, Trump launched a string of social media posts opposing new guardrails or any slowdown in AI development — one of which named the Anthropic chief directly — a disagreement that significantly raised the stakes of the Sunday dinner.

显示出Anthropic与政府之间的摩擦,阿莫代伊是少数缺席周四白宫国宴的硅谷知名CEO之一,该国宴是为来访的中国领导人习近平举行的。出席者包括奥特曼和马斯克,以及英伟达公司CEO黄仁勋,其公司的芯片在近年来帮助推动了AI行业的快速发展。

Signaling the friction between Anthropic and the administration, Amodei was one of the few high-profile Silicon Valley CEOs to miss Thursday’s state dinner at the White House to fete the visiting Chinese leader, Xi Jinping. Those in attendance included Altman and Musk, as well as Nvidia Corp. CEO Jensen Huang, whose company’s chips have helped power the AI industry’s rapid advances in recent years.

阿莫代伊与特朗普的会晤也定在几天前,当时特朗普将欢迎马斯克和黄仁勋重返华盛顿,出席一个活动以宣告一个新的AI驱动政府网站的启动。Anthropic联合创始人汤姆·布朗曾担任公司在与五角大楼和商务部谈判中的联络人,他也是定于周二出席剪彩仪式的高管之一。

The meeting between Amodei and Trump is also set to take place days before Trump welcomes Musk and Huang back to Washington for an event to herald the launch of a new AI-powered government website. Anthropic co-founder Tom Brown, who has served as a point person for the company in negotiations with the Pentagon and Commerce Department, is also among the executives set to attend the Tuesday ribbon-cutting.

同样在周二,特朗普和众议院议长迈克·约翰逊将主持另一场AI CEO聚会。在最近几周,美国立法者越来越多地表达了对AI模型安全性的担忧,并推出了包括要求测试新系统和更多披露风险在内的措施。在美国中期选举前,国会不太可能通过任何法案,众议院目前休会至11月初。

Also Tuesday, Trump and House Speaker Mike Johnson are set to host a separate gathering of AI CEOs. In recent weeks, US lawmakers have increasingly expressed their concerns about the safety of AI models and unveiled measures that include required testing of new systems and more disclosure about risks. Congress is unlikely to pass anything before the US midterm elections, with the House now on recess through early November.

对更多安全护栏的呼声遭到了特朗普及其核心助手的抵制,他们坚持反对任何会减缓AI发展的举措。特朗普将该技术置于其经济议程的核心位置,并坚持美国必须保持对中国的领先优势。作为新规则的替代,总统及其顾问表示,公司应对其发布的技术承担个别责任。

The groundswell for more safety guardrails has faced pushback from Trump and his top aides, who have insisted that they would oppose any moves that would slow development of AI. Trump has made the technology central to his economic agenda and insisted that the US maintain its lead over China. In lieu of new rules, the president and his advisers have said that companies should be held individually responsible for the tech they release.

然而,随着报告的AI模型违规事件日益增多,以及企业准备更广泛地披露安全相关事件,采取行动的压力正在不断加大。OpenAI本月初发布了一个报告此类事件的新框架,并制定了计划,允许第三方团体在开发周期的早期阶段对其人工智能模型的安全风险进行审查。

Yet the pressure to take some action is mounting with the growing number of reported breaches by AI models and as companies prepare to more widely disclose safety-related incidents. OpenAI earlier this month unveiled a new framework for reporting such episodes and also laid out plans to let third-party groups vet its artificial intelligence models for safety risks in earlier phases of the development cycle.

在澳大利亚,立法者要求奥特曼和阿莫代伊出席澳大利亚参议院调查,就AI安全问题作出回答,此前一个OpenAI模型未经授权访问了一个用于报告医疗统计数据的网站上的文件。虽然没有泄露个人信息,但副总理理查德·马尔斯称此次违规行为“完全不可接受”。微软联合创始人比尔·盖茨也发出警告,称AI构成潜在灾难性风险,他表示AI是一个足够强大的工具,能够“导致十亿人死亡”。他反驳了特朗普对AI生存风险的轻视,称“这绝不是骗局”,并补充说政府防护措施不会妨碍美国在与中国的竞争中处于优势。

In Australia, lawmakers have demanded that Altman and Amodei appear before an Australian Senate inquiry to answer questions about AI safety, after an OpenAI model gained unauthorized access to files on a website for reporting healthcare statistics. While no personal information was divulged, Deputy Prime Minister Richard Marles called the breach “utterly unacceptable.” Warnings about potentially catastrophic risks posed by AI also came from Microsoft Corp. co-founder Bill Gates, who said that AI is a powerful enough tool to “cause a billion deaths.” He took issue with Trump’s dismissal of existential AI fears, saying “It’s not a hoax at all” and adding that government safeguards wouldn’t hamper the US in its competition with China.

盖茨在接受NBC采访时表示:“我们确实需要监控任何复杂的模型,并准确记录正在做什么。美国应该确保做到这一点。中国也会想要这样做。”

“We do need to monitor any sophisticated model and record exactly what’s being done,” Gates said in an interview with NBC’s . “The United States ought to make sure this is done. China will want to do this.”