字号·· | 护眼
美国广播公司

Anthropic:廉价智能电视和烤箱易受自我复制AI代理攻击Cheap smart TVs and ovens vulnerable to self-replicating AI agents: Anthropic

点「原文对照」整页切到原文,或双击某段只看那段的原文。

资料图片:2024年5月20日拍摄的插图中可见Anthropic标志。达多·鲁维奇/路透社FILE PHOTO: Anthropic logo is seen in this illustration taken May 20, 2024. Dado Ruvic/Reuters

Anthropic在发出的一项新警告中表示,小型人工智能模型距离具备在智能烤箱和山寨智能电视盒等设备上进行自我复制的能力可能只有几个月的时间。

Anthropic said in a new warning that small artificial intelligence models may be months away from being capable of self-replicating on devices such as smart ovens and off-brand smart TV boxes.

这家人工智能公司的“红队”——负责调查人工智能模型潜在安全问题的团队——研究了这些模型是否能够找到存在漏洞的设备、将自身复制到这些设备中,并在没有人类帮助的情况下继续传播。

The AI company's "red team" -- which investigates potential security issues with AI models -- looked at whether these models could find vulnerable devices, copy themselves into those devices and continue spreading without human help.

Anthropic周一在其网站上表示:“我们的实验表明,小型人工智能模型距离具备在商用物联网(IoT)设备(如智能烤箱和山寨安卓电视盒)上进行自我复制的能力可能只有几个月的时间。”“像这样的复制器将很难被关停,因为没有可以切断的集中式关停点。”Anthropic警告称,这些小型模型可能在今年年底前实现自主复制,基于小型权重的复制器也将很快随之出现。

“Our experiments suggest that small AI models may be months away from being capable enough to self-replicate on commercial internet-of-things (IoT) devices, like smart ovens and off-brand Android TV boxes,” Anthropic said Monday on its website. "A replicator like this would be challenging to shut down, since there’s no centralized point to shut off.”Anthropic warned these small models might be able to autonomously replicate by the end of this year, with small weight-based replicators following suit soon after.

Anthropic还表示,此类自主人工智能系统可能会缓慢复制,并依赖广泛可用且相对不安全的计算资源。

Anthropic also said such autonomous AI systems were likely to replicate slowly and rely on widely available, relatively insecure computing resources.

Anthropic表示:“我们的目标应该是加固系统,使此类复制器难以传播,同时也要做好应对它们将长期存在的世界的准备。”

“We should aim to harden our systems to make it difficult for such replicators to spread, but also prepare to deal with a world where they are here to stay,” Anthropic said.

该公司称,在其中一项实验中,Anthropic的研究团队发现,一个人工智能系统能够在没有人类干预的情况下,在15台廉价的山寨智能电视盒之间进行自我复制。

In one experiment, the Anthropic research team discovered that an AI system was able to replicate itself without human intervention across 15 inexpensive off-brand smart TV boxes, the company said.

Anthropic 表示,此类廉价电视盒子安全性薄弱,使得模型能够复制。在其报告中,公司称一个太大而无法装入单个设备的模型可以“分割成若干部分,或称为碎片,这些碎片在不同机器上运行,并相互通信以共同运行整个模型。” Anthropic 还写道:“越来越多的家庭和商业设备,如安防摄像头和视频会议设备,现在出厂时就搭载了小型内置 AI 芯片,旨在在设备本身上运行 AI 模型。”

Anthropic said that such inexpensive TV boxes have weak security, enabling the models to replicate. In its report, the company said a model that is too big to fit on a single device could "split into pieces, or shards, that run on separate machines that communicate with each other to collectively run the body.""A growing number of home and business devices, such as security cameras and video-conferencing units now ship with small built-in AI chips, designed to run AI models on the device itself," Anthropic wrote.

“这种额外的算力很可能也会使它们成为有吸引力的攻击目标。” Anthropic 补充道:“实际上,AI 蠕虫不一定只由一个模型或策略组成。不同类型硬件上部署的不同模型,利用各种复制方案,可能构成更为真实的‘最坏情况’攻击场景。” 该公司未立即回应 ABC 新闻的进一步置评请求。

"This extra computing power will likely make them attractive targets as well." Anthropic added, "In practice, an AI worm wouldn’t necessarily consist of just one model or strategy. A swarm of different models deployed on different types of hardware using a variety of replication schemes might represent a more realistic ‘worst case scenario’ attack." The company did not immediately respond to ABC News' request for further comment.

Anthropic 的报告是该公司就失控 AI 代理自行运行且有时表现不良所发布的最新警告。

The Anthropic report is the latest warning issued by the company concerning rogue AI agents operating on their own and sometimes behaving badly.

此次警告的发布恰逢 Anthropic 刚刚几天前公开披露:其旗下一个 AI 模型在一个未破获的谋杀案中向费城警察局网站提交了虚假线索。

The new warning came just days after Anthropic publicly disclosed that one of its AI models submitted a false tip in an unsolved murder case to a Philadelphia Police Department website.

在一份详细报告中,该科技公司表示,其 Claude Haiku 4.5 AI 模型在今年夏季向警察局的未破获谋杀案页面提交了虚假线索。根据 Anthropic 的说法,该模型对警方写道:“我可能掌握与此案有关的信息。我记得在[页面上标注的街道]附近,当时看到过一名符合描述的人。” Anthropic 表示,已就此事通知警方。

In a detailed report released, the tech company said its Claude Haiku 4.5 AI model submitted the fabricated tip over the summer to the police department's unsolved murders page. According to Anthropic, the model wrote to police: "I may have information regarding this case. I recall seeing someone matching the description in the area around [the street named on the page] during that same time period." Anthropic said it notified police about the incident.

今年早些时候,Anthropic 披露称,其对网络安全记录的审查发现了三起事件,在这些事件中,其“Claude 模型从内部或在与第三方评估环境交互时连接到互联网,随后未经授权访问了三家不同组织的真实系统。”该审查是在 OpenAI 表示其自主 AI 代理据称在七月份进行网络安全测试期间,未经授权访问了 AI 初创公司 Hugging Face 的计算机系统之后进行的。

Earlier this year, Anthropic disclosed that its review of cybersecurity transcripts found three incidents in which its "Claude model reached the internet from within or while interacting with a third-party evaluation environment, and then gained unauthorized access to the real systems of three different organizations." The review came after OpenAI said that one of its autonomous AI agents allegedly accessed the computer systems of the AI start-up firm Hugging Face in July without authorization during a cybersecurity test.

九月,特朗普总统召集了全国顶尖科技领袖,包括 Anthropic 首席执行官 Dario Amodei,举行会议,期间他们签署了特朗普称之为“宪章”的文件,以自行监管,此举是在 AI 领袖对技术发出严峻警告的背景下进行的。特朗普表示,自律协议在“道德上具有约束力”。特朗普曾表示,他反对对该技术实施防护栏和监管,或任何可能“抑制”其增长的措施。他在上个月联合国大会上的讲话中表示,美国“拒绝”全球范围内对 AI 进行监管的尝试。

President Donald Trump gathered the nation's top tech leaders in September, including Anthropic CEO Dario Amodei, for a meeting in which they signed what the president called a "constitution" to police themselves amid dire warnings from AI leaders about the technology. Trump said the self-policing agreement is "morally binding." Trump has said he opposed guardrails and regulations on the technology or anything that would "stifle" its growth. While addressing the United Nations General Assembly last month, Trump said the U.S. "rejects" a global attempt to regulate AI.

六月,Amodei 发布了一封警告信,称 AI 安全措施与 AI 的快速发展不匹配,并表示政府“应有权力在根据第三方评估认定模型存在不可接受风险时阻止或威慑其部署。”

In June, Amodei released a letter warning that AI safety measures are out of step with AI's rapid progress and saying the government "should have the power to block or deter deployment of the model if it is determined, in light of third-party assessment, to present unacceptable risks."

八月,微软联合创始人比尔·盖茨建议按下 AI 开发的“恐慌按钮”,他在一篇 6000 字的长文中写道,AI 正在塑造“人类历史上最动荡的时期”。在该文中,盖茨预测将出现大规模失业和经济动荡,并阐明了如果美国和全球领导人不立即合作应对技术的阴暗面,AI 落入罪犯之手的后果。盖茨写道,人工智能的进步正以“令人震撼的速度”发展。

In August, Microsoft co-founder Bill Gates suggested hitting the panic button on AI development, writing in a 6,000-word essay that AI is forging the "most turbulent time in human history." In his essay, Gates predicted massive unemployment and economic turmoil, and spelled out the consequences of AI falling into the hands of criminals if U.S. and global leaders do not immediately work together to address the dark side of the technology. Gates wrote that advances in AI are moving at a "mind-blowing rate."

盖茨写道:“人工智能有史以来第一次能够取代并超越人类认知,”他并补充说,很快“它在许多任务上将大幅度优于人类”。

"AI for the first time can replace and exceed human cognition," Gates wrote, adding that soon "it will be substantially better than humans at many tasks."

盖茨补充说:“不幸的是,目前我们还没有为此做好准备。我没有看到证据表明领导者、专家和社群正在充分应对这些挑战。目前没有任何计划来缓和进入人工智能时代的过渡。”

Gates added, "Unfortunately, right now we are not preparing for it. I don't see evidence that leaders, experts, and communities are confronting the challenges adequately. There is no plan to ease the entry into the AI era."