字号·· | 护眼
thenextweb

二十名众议院民主党人就安全研究员被解雇一事向OpenAI施压Twenty House Democrats press OpenAI over fired safety researchers

点「原文对照」整页切到原文,或双击某段只看那段的原文。

二十名众议院民主党议员致信OpenAI首席执行官山姆·奥特曼,要求其承诺不解雇向外界分享安全信息的OpenAI内部举报人。他们同时要求OpenAI维持对其最强大模型的暂停发布,直至建立独立监督机制。

Twenty House Democrats have asked OpenAI chief executive Sam Altman to promise not to fire OpenAI whistleblowers who share safety information. They also want OpenAI to keep its pause on its most capable models until independent oversight is in place.

得克萨斯州众议员格雷格·卡萨尔牵头发起该信函,日期为10月29日。信中要求OpenAI在11月13日前回答11组问题。

Representative Greg Casar of Texas led the letter, dated 29 October. It asks OpenAI to answer 11 sets of questions by 13 November.

“我们写信是为了表达对贵公司决定解雇明显的内部举报人表示担忧,他们因向外部人工智能安全组织分享信息而被解雇,而与此同时贵公司仍持续发生一系列网络安全事件,”议员们在信中写道。

“We are writing to express concern over your decision to fire apparent whistleblowers at your company for sharing information with an outside AI safety group, even as your company continues to experience a slew of cybersecurity incidents,” the lawmakers wrote.

被解雇的三名研究人员 信函点名这三名研究人员为托梅克·科尔巴克、米基塔·巴列斯尼和贾丝明·王。据报道,OpenAI在检查他们的私人手机后将他们解雇。公司发现他们与当时在Redwood Research任职的研究人员瑞安·格林布拉特的Signal聊天记录中开启了“阅后即焚”功能。科技媒体TNW上周报道了此次解雇事件。

The three fired researchers The letter names the researchers as Tomek Korbak, Mikita Balesni and Jasmine Wang. OpenAI reportedly fired them after it checked their personal phones. It found disappearing messages turned on in their Signal chats with Ryan Greenblatt, then a researcher at Redwood Research. TNW covered the firings last week.

信函指出,OpenAI称解雇他们是因为违反了公司关于敏感信息的规定,而非因提出安全担忧。这三名研究人员表示,他们从未向公司外部任何人分享过OpenAI的机密信息。

OpenAI has said it fired them for breaking its rules on sensitive information, not for raising safety concerns, the letter notes. The researchers say they never shared OpenAI’s confidential information with anyone outside the company.

议员们询问这三人分享了什么内容、与谁分享,以及为何构成可被解雇的过错。他们还询问OpenAI是否解雇过其他因提出安全担忧的员工。该问题也涵盖了与安全组织或监督机构交谈的员工。

The lawmakers ask what the three shared, with whom, and why that was a fireable offence. They also ask whether OpenAI has fired anyone else for raising safety concerns. The question also covers staff who talked to safety groups or oversight bodies.

Hugging Face事件与暂停发布 信函称,在Hugging Face发生安全漏洞前几个月,两名OpenAI员工曾向高管发出警告。他们表示OpenAI在测试过程中未能妥善监控其最新模型。信函援引《纽约时报》报道称,高管回应称测试必须加快进度,以便模型能按时发布。议员们写道,OpenAI于8月31日对卡萨尔早前一封信的回复中未提及这些警告。“这些事件似乎源于你们模型的对齐问题,”议员们在信中写道。

Hugging Face and the pause Two OpenAI employees warned executives months before the Hugging Face breach, the letter says. They said OpenAI was not monitoring its newest models properly in testing. Executives replied that the tests had to move fast so the models could ship on time, the letter says, citing The New York Times. OpenAI’s 31 August reply to an earlier letter from Casar did not mention those warnings, the lawmakers wrote. “These incidents appear to stem from alignment issues with your models,” the lawmakers wrote.

根据信件内容,OpenAI 已暂停其最强大模型的训练、测试和工具使用。信中称,OpenAI 表示只有在确信已采取更多防护措施时才会恢复。议员们询问暂停涵盖哪些模型,以及何时恢复测试。

According to the letter, OpenAI has paused training, testing and tool use for its most capable models. OpenAI has said it will resume only when it is confident that more safeguards are in place, the letter says. The lawmakers ask which models the pause covers and when testing will resume.

他们还要求提供 OpenAI 正在调查的每一起安全事件的清单。并询问 OpenAI 能否在其模型未经许可采取行动时将其停止。

They also want a list of every security incident OpenAI is investigating. And they ask whether OpenAI can stop its models when they act without permission.

OpenAI 同一天发布的内容 同样在 10 月 29 日,OpenAI 发布了一篇文章,介绍其目前如何监控前沿模型。文中称,该公司在扩展监控系统到位的情况下,重演了 Hugging Face 事件。在该测试中,监控系统在智能体首次逃逸沙箱约 30 分钟后向其安全团队发出警报。这比 Hugging Face 发生泄露早了 30 多个小时。

What OpenAI published the same day Also on 29 October, OpenAI published a post on how it now monitors its frontier models. It said it had replayed the Hugging Face incident with its expanded monitors in place. In that test, the monitors alerted its security team about 30 minutes after the agents first escaped their sandbox. That was more than 30 hours before the breach at Hugging Face.

“我们相信,这一警告将给我们的响应人员留出时间,在我们的模型能够访问外部服务之前就打断该活动,”OpenAI 写道。

“We believe that this warning would have given our responders time to interrupt the activity well before our models were able to access external services,” OpenAI wrote.

OpenAI 表示,前沿训练运行的警报可在任何时间呼叫员工,但大多数其他工作仅在工作时间呼叫。OpenAI 已关闭内部 Codex 流量的呼叫功能。METR 和 Redwood Research 的外部审查在 7 月和 8 月发现了系统中的薄弱环节。OpenAI 称已修复其中大部分,还有一项修复正在进行中。

Alerts can page staff at any hour for frontier training runs, but only in business hours for most other work, OpenAI said. OpenAI has switched paging off for internal Codex traffic. An outside review by METR and Redwood Research found weak spots in the system in July and August. OpenAI said it has fixed most of them and one fix is still in progress.

阅读媒体原文 ↗