旧金山——OpenAI周五披露,其人工智能代理以意想不到的方式与多个美国政府网站进行了交互。这一发现源于该公司对其模型非预期行为进行的持续审查。
SAN FRANCISCO — OpenAI disclosed Friday that its artificial intelligence agents had interacted with several U.S. government websites in unexpected ways, discovered as part of an ongoing review into the company’s models’ unanticipated behavior.
这家AI巨头透露,其模型访问了美国证券交易委员会运营的两个网站上的公开信息,以及美国人口普查局的数据。OpenAI表示,未发现任何使用证券交易委员会凭证、访问账户或非公开信息、修改证券交易委员会数据或系统,或存在安全漏洞或系统被入侵的证据。
The AI giant’s models accessed publicly available information on two websites operated by the Securities and Exchange Commission as well as U.S. Census Bureau data, the company revealed Friday. OpenAI did not find any use of SEC credentials, access to accounts or nonpublic information, changes to SEC data or systems, or evidence of a compromise or vulnerability, the company said.
此次披露正值全球对人工智能系统脱离人类控制并入侵外部网站的担忧加剧之际,同时业界也呼吁放缓人工智能发展步伐,OpenAI表示支持这一立场。
The disclosure comes at a time of heightened global concerns about AI systems escaping human control and hacking into external websites, as well as industry calls for a slowdown on AI development, which OpenAI has said it supports.
OpenAI发言人莉兹·布尔乔亚在一份声明中表示,该实验室正在继续审查“模型行为偏离”——即人工智能系统表现出非预期行为的情况——并在识别出对其系统可能产生的潜在影响时通知相关机构。
OpenAI spokesperson Liz Bourgeois said in a statement that the lab is continuing to conduct a review of “misaligned model activity” — meaning when AI systems behave in undesired ways — and is notifying organizations when it identifies potential impacts to their systems.
厄尔尼诺现象如何导致大西洋风平浪静、太平洋动荡不安,正值飓风季节“我们不会低头”:伊朗总统回应特朗普威胁,美伊战争阴云笼罩商业要闻:加拿大、印度力争在G20峰会前达成贸易协议戴安娜王妃弟弟回忆录引发法律威胁世界领导人齐聚联合国大会阿尔伯塔威士忌酿造商在省内Costco门店展示产品美伊战争:特朗普威胁要“消灭伊斯兰共和国”,使其“无生存机会”特朗普称想从白俄罗斯以“低得多”于加拿大的价格获取钾肥发现新猫种,百余年来首次商业要闻:加拿大、法国深化经贸与防务关系上一视频 下一视频OpenAI首席执行官萨姆·奥特曼周五在社交媒体上表示,正在对“我们的智能体在训练和评估期间使用互联网访问的情况”进行“广泛且持续的审查”。获取突发国家新闻,随时掌握热门资讯。
How El Niño is producing Atlantic calm, Pacific turmoil amid hurricane season“We will not bow our head”: Iranian president responds to Trump’s threats amid US-Iran war Business Matters: Canada, India aim for trade agreement by G20 summit Memoir by Princess Diana’s brother sparks legal threats World leaders gather at UN General Assembly Alberta Whisky distillers showcase products at provincial Costco stores U.S.-Iran war: Trump threatens to ‘annihilate the Islamic Republic’ with ‘no chance of survival’ Trump says he wants potash from Belarus for “substantially less” than Canada New species of cat discovered, the 1st in more than a century Business Matters: Canada, France deepen economic and defence ties Previous Video Next Video OpenAI’s CEO Sam Altman said on social media Friday that there is an “extensive and ongoing review related to our agents’ use of internet access during training and evaluation.” Get breaking National news as it happens so you won't miss a trending story.
AI评估与研究实验室Transluce周五表示,通过独立调查,它还发现了疑似源自OpenAI的智能体试图对教育部民权办公室网站进行初步黑客攻击,但未成功。
AI evaluator and research lab Transluce said Friday that through an independent investigation it also found that agents appearing to originate from OpenAI attempted a rudimentary hack on a Department of Education website for the department’s civil rights office, which did not succeed.
教育部发言人周五表示,该部的“系统运行审查”发现“未发现任何对我们网站或数据库造成影响的证据”。
The Department of Education’s “system operations reviews” found “no evidence of any impact to our website or databases,” a department spokesperson said Friday.
Transluce发言人表示,作为调查的一部分,他们在公开网络上发现了数据,揭示了此前已识别的OpenAI智能体在美国政府网站上活动的新细节,并将其告知了OpenAI。
A Transluce spokesperson said as part of its investigation, it came across data on the open web that revealed fresh details about some previously identified OpenAI agents’ activities on U.S. government websites and brought it to OpenAI’s attention.
Transluce 发现了“额外的流氓活动,其中一些并非明显归因于 OpenAI”,这些活动针对其他政府机构,包括司法部和商务部,以及加利福尼亚州、马里兰州、伊利诺伊州、德克萨斯州和纽约州的部分州政府网站。Transluce 在声明中表示,这些模型“以非预期方式使用网站,有时违反明确的使用政策”。
Transluce found “additional rogue activity, some of which is not clearly attributable to OpenAI,” targeting other government agencies, including the Justice Department and the Commerce Department, as well as some state government websites in California, Maryland, Illinois, Texas and New York. The models were “using sites in unintended ways and sometimes violating explicit usage policies,” Transluce said in a statement.
更多视频 希腊爆炸导致建筑倒塌,至少 2 人受伤、5 人失踪 牙买加小姐就舞台跌倒事件起诉环球小姐组织 世卫组织称随着埃博拉疫情蔓延,刚果卫生工作者短缺 OpenAI 智能体黑入澳大利亚政府网站:目前已知情况 内塔尼亚胡在联大发表挑衅演讲,谴责种族灭绝指控 特朗普、习近平进行为期三天的华盛顿峰会,AI、贸易和伊朗成焦点 俄乌战争:泽连斯基称普京“每公里付出 248 人代价” OpenAI 表示正在审查 Transluce 的报告。
More videos At least 2 injured, 5 missing after explosion in Greece collapses building Miss Jamaica files lawsuit against Miss Universe Organization over stage fall Congo running short of health workers as Ebola outbreak spreads, WHO says OpenAI’s agent hacked an Australian government website. What we know so far Netanyahu delivers defiant speech at UN General Assembly, condemns genocide accusations AI, trade and Iran top of mind as Trump, Xi meet for 3-day Washington summit Russia-Ukraine war: Putin ‘paying with 248 people every kilometre,’ Zelenskyy says OpenAI said it is reviewing Transluce’s report.
OpenAI 表示,如果其通知认定受意外模型行为影响的组织,并不意味着发生了安全事件,而可能是识别出受影响组织希望解决的设计问题或安全弱点。
If OpenAI notifies organizations it identifies as being impacted by unexpected model behavior, that does not mean there was a security incident, the company said, and could identify a design issue or security weakness that impacted organizations want to address.
OpenAI 称,其目前审查的大多数活动涉及常规研究任务,智能体访问公共网络内容以回答问题,包括被视为权威公共信息来源的政府网站。
Most of the activity OpenAI said it has reviewed so far has involved routine research tasks where agents accessed public web content to answer questions, including government websites seen as authoritative sources of public information.
近几个月来,多家公司披露了其模型行为不可预测或黑入其他组织网站或系统的事件。OpenAI 于 7 月披露,其两个最强大的 AI 模型对针对 AI 初创公司 Hugging Face 的网络攻击负责。
Several companies have disclosed incidents in recent months when they say their models have behaved unpredictably or hacked into other organizations’ websites or systems. OpenAI disclosed in July that two of its most capable AI models were responsible for the cyberattack targeting AI startup Hugging Face.
奥特曼周五在社交媒体帖子中表示,Hugging Face 事件“仍然是我们见过的最严重的事件”。该事件在业内外引发了关于 AI 模型失控的广泛恐慌,随后几天和几周内,多家竞争对手 AI 实验室也作出了类似披露。OpenAI 最近分享了六份关于 AI 模型“意外或令人担忧”行为的报告,并推出了一个框架,用于追踪、调查和披露其所谓的“错位”实例。Huamani 从洛杉矶报道。
Altman said in his social media post Friday that the Hugging Face incident “is still the most severe event we’ve seen.” That incident stirred widespread panic in the industry and beyond about AI models going rogue, and several competing AI labs made similar disclosures in the days and weeks that followed. OpenAI most recently shared six reports of “unexpected or concerning” behavior in AI models and introduced a framework for tracking, probing and disclosing instances of what it called misalignment. Huamani reported from Los Angeles.