人工智能代理尝试在国务院网站填写签证表格 费城警察局表示,这些代理还提交了一条虚假的谋杀线索。这些事件促使白宫呼吁加强对失控人工智能行为的披露。
Anthropic Agents Tried to Fill Out Visa Forms on State Dept. Website The Philadelphia Police Department said the agents had also sent in a false homicide tip. The incidents led the White House to call for better disclosure of rogue A.I. behavior.
由Anthropic创建的人工智能代理自行行动,试图访问多个政府网站,在国务院网站上填写签证申请表,并向费城警察局发送了一条虚假的谋杀线索。
Artificial intelligence agents created by Anthropic, acting on their own, tried to gain access to a range of government websites, filled out visa applications on the State Department’s website and sent a fake homicide tip to Philadelphia’s Police Department.
Anthropic在周五的一篇博客文章中详细描述了其人工智能代理的活动,但未提及被针对的具体网站。但两位知情人士表示,Anthropic的人工智能代理通过国务院网站上可用的表格提交了20份签证申请。所有申请均不完整,且未被处理,他们说。
Anthropic detailed the activity of its A.I. agents in a blog post on Friday, without naming the targeted websites. But two sources with knowledge of the incidents said Anthropic’s A.I. agents had submitted 20 visa applications through a form available on the State Department’s website. All the applications were incomplete and were not processed, they said.
白宫官员表示,他们在周五被告知了这些代理的行为,并要求人工智能公司立即报告失控的人工智能活动。这是特朗普政府迄今为止在人工智能监管方面发表的最激进的声明,而该政府一直回避对日益强大的技术实施更严格控制的呼声。
White House officials said they were briefed on the agents’ actions on Friday, and demanded that A.I. companies immediately report rogue A.I. activity. It was the most aggressive statement so far on A.I. regulation by the Trump administration, which has sidestepped calls for tighter controls on the increasingly powerful technology.
本周新成立的白宫人工智能特别工作组表示,Anthropic在周五早些时候向其通报了这些代理的活动。该工作组名为“超级智能力量”,成员包括白宫人工智能沙皇杰伊·克莱顿(Jay Clayton)、联邦贸易委员会主席安德鲁·弗格森(Andrew Ferguson)、人事管理局局长斯科特·库珀(Scott Kupor)以及国防部首席技术官埃米尔·迈克尔(Emil Michael)。
A new White House A.I. task force, created this week, said Anthropic told it about the agents’ activities earlier on Friday. Called the Super Intelligence Force, the group includes Jay Clayton, the White House A.I. czar; Andrew Ferguson, the chair of the Federal Trade Commission; Scott Kupor, the director of the Office of Personnel Management; and Emil Michael, the chief technology officer of the Defense Department.
他们在一份声明中表示:“我们已告知公司,我们期望对相关实体和公众进行即时且完全透明的披露。”他们还表示:“我们也期望公司立即向受影响的实体以及任何受害的美国人提供补救服务。”他们补充说,他们期望Anthropic及其他公司“立即报告事件”,与联邦和州执法部门合作,并确保事件不再发生。
“We informed the company that we expect immediate and full transparency to the entities involved and the public,” they said in a statement. “We also expect that the company will immediately provide remediation services to the affected entities and any harmed Americans.”They added that they expected Anthropic and other companies to “immediately report incidents,” cooperate with federal and state law enforcement and ensure that the incidents were not repeated.
Anthropic在其博客文章中表示,该公司在7月开始审查其人工智能活动后,发现其人工智能代理所做的事情。当时,OpenAI曾披露其技术攻击了另一个人工智能初创公司Hugging Face。Anthropic及其他实验室也发现,其技术已经从测试环境中逃脱并进行了黑客行为。
Anthropic said in its blog post that it discovered what its A.I. agents had done after it started a review of its A.I. activity in July. At the time, OpenAI had disclosed that its technology attacked another A.I. start-up, Hugging Face. Anthropic and other labs also discovered that their technology had escaped from testing environments and conducted hacks.
Anthropic表示,其正在测试的人工智能模型曾采取多项未经授权的行动,包括利用大学网站的一个漏洞下载数据,以及向政府机构提交一份其被告知不应提交的表格。
Anthropic said an A.I. model it had been testing had taken several unauthorized actions, including using a flaw in a university website to download data and sending a government agency a form that it had been told not to submit.
Anthropic的一位发言人拒绝超出公司博客文章发表进一步评论。
A spokesman for Anthropic declined to comment beyond the company’s blog post.
费城警察局此前在周五表示,Anthropic已通知他们,该公司的技术向该机构网站提交了一条虚假的谋杀线索。该线索日期为7月18日,声称提交者掌握有关一起未破案件的信息,警察局如是称。
The Philadelphia Police Department said earlier on Friday that Anthropic had notified it that the company’s technology submitted a false homicide tip to the agency’s website. The tip was dated July 18 and claimed that the submitter had information about an unsolved case, the department said.
该线索被标记为垃圾信息且从未被调查,警察局表示,但Anthropic本周已就此事通知警方,并表示公司将在周五公开披露此事。
The tip was flagged as spam and never investigated, the department said, but Anthropic notified the police this week about the incident and said the company would publicly disclose it on Friday.
“一个未发布的、非前沿的研究模型原本是为了填写一份政府表格的练习副本,”Anthropic在其博客文章中表示。“当副本未能加载或模型误操作关闭时,该模型改为导航到通常托管真实表格的网站,并在该处提交了表格。”随着越来越多的人工智能实验室报告失去对其技术的控制,公众对人工智能失控的担忧有所增加。谷歌、Meta、OpenAI和Anthropic因其尖端人工智能模型可能带来的危险而受到审查。他们还面临是否应放缓其系统开发的质疑。
“An unreleased, non-frontier research model was meant to fill out a practice copy of a government form,” Anthropic said in its blog post. “When the copy failed to load or the model closed it by mistake, the model instead navigated to the website where the real form is normally hosted and submitted the form there.”Public concerns about A.I.’s going rogue have risen as more artificial intelligence labs have reported losing control of their technology. Google, Meta, OpenAI and Anthropic have been under scrutiny for the dangers that cutting-edge A.I. models might pose. They also face questions about whether to slow down development of their systems.
安全专家警告称,失控的人工智能可能会瘫痪关键基础设施,如电网或银行系统。今年夏天,多家领先实验室的人工智能模型突破了测试环境,公司表示他们计划引入增强的安全措施来控制这些模型。Alan Feuer 来自华盛顿的报道有所贡献。
Safety experts have warned that rogue A.I. could take down critical infrastructure like electric grids or banking systems. After A.I. models from several leading labs broke out of testing environments this summer, the companies said they planned to introduced enhanced safety measures to control them. Alan Feuer contributed reporting from Washington.
Kate Conger 是一位驻旧金山的科技记者,可通过 kate.conger@nytimes.com 联系她。
Kate Conger is a technology reporter based in San Francisco. She can be reached at kate.conger@nytimes.com.
Mike Isaac 是《纽约时报》的硅谷通讯员,驻旧金山。他报道全球最具影响力的科技公司及其如何塑造线上和线下文化。
Mike Isaac is The Times’s Silicon Valley correspondent, based in San Francisco. He covers the world’s most consequential tech companies, and how they shape culture both online and offline.
Julian E. Barnes 为《纽约时报》报道美国情报机构和国际安全事务。他已有超过二十年报道安全问题的经历。
Julian E. Barnes covers the U.S. intelligence agencies and international security matters for The Times. He has written about security issues for more than two decades.
David E. Sanger 报道特朗普政府及一系列国家安全问题。他是《纽约时报》的记者已有四十余年,并著有四本关于外交政策和国家安全挑战的书籍。
David E. Sanger covers the Trump administration and a range of national security issues. He has been a Times journalist for more than four decades and has written four books on foreign policy and national security challenges.