
当 OpenAI 在 10 月披露其在一间高管会议室发现了一个录音装置时,多名前员工的反应相同——他们并不感到惊讶。
When OpenAI disclosed in October that it found a recording device planted in an executive conference room, a number of former employees had the same reaction — they were not surprised.
据五位知情人士透露,即使在 OpenAI 于 2022 年底推出 ChatGPT 之前,一些公司员工就已在内部对其安全实践提出过担忧。这些人士表示,员工曾向 OpenAI 高层领导和董事会表达过担忧,并补充说,一些员工从这些互动中得出的结论是,管理层更专注于跟上 Google 和 Anthropic 等竞争对手的步伐,而非关注安全。
Even before OpenAI launched ChatGPT in late 2022, some company staffers raised concerns internally about its security practices, according to five people familiar with the matter. Employees shared their concerns with top OpenAI leaders and the board of directors, the people said, adding that some staffers came away from those interactions concluding that management was more focused on keeping pace with competitors like Google and Anthropic than on security.
这些人士称,这些员工认为,OpenAI 的管控极其松懈,以至于外界(包括外国政府)能够相对轻松地获取关于该 AI 实验室技术的敏感信息。例如,OpenAI 内部任何有权访问代码的人,都能看到许多公司项目的底层技术细节。
These workers argued that OpenAI's controls were so lax that outsiders, including foreign governments, could obtain sensitive information about the AI lab's technology with relative ease, the people said. For example, anybody at OpenAI who could access its code could see the technical details underlying many company projects.
据两位知情人士透露,OpenAI 已开始调整策略以解决安全问题。负责产品开发的高管 Thibault Sottiaux 最近接管了一项保障 OpenAI 内部系统安全的内部计划。其中一位人士称,Sottiaux(人称“Tibo”)在 8 月将 OpenAI 四分之一的生产工程师重新分配,以改善其安全基础设施。
OpenAI has begun to shift strategy to address security issues, according to two people familiar with the matter. Thibault Sottiaux, a senior executive overseeing product development, has recently taken charge of an internal initiative to secure OpenAI’s internal systems, they said. In August, Sottiaux, who goes by “Tibo,” reassigned a quarter of OpenAI's production engineers to improve its security infrastructure, one of the people said.
这些内部警告——包括员工多年来向领导层投诉内部漏洞,其中某些细节此前未曾披露——揭示了 AI 领域内部存在的一张张力。自 ChatGPT 于 2022 年底推出以来,AI 技术已成为美国的一项战略资产,这给美国公司带来了压力,要求它们保护自己的技术免受外国竞争对手的侵害。
The internal warnings, including years of employee complaints to leadership about internal vulnerabilities, certain details of which have not been previously reported, shed light on a tension within the AI field. Since ChatGPT launched in late 2022, AI technology has become a strategic asset for the US, putting pressure on American companies to protect their technology from foreign rivals.
但增加安全层级也可能延缓AI技术推进的进程,并可能使OpenAI和Anthropic大规模首次公开募股(IPO)的计划变得复杂,而这将使它们跻身全球最有价值的公司之列。
But adding security layers can also delay the process of advancing AI technology and possibly complicate OpenAI's and Anthropic's plans for massive initial public offerings that would make them among the most valuable companies in the world.
曾在OpenAI任职的研究员Will DePue于今年4月离职,他在X平台发帖称,鉴于竞争如此激烈,AI领军企业“无法为了安全牺牲速度。对他们而言,快速行动比确保安全更重要,即使面对的是我们最大的国家对手。”当被问及员工的担忧及其认为管理层未对这些问题采取行动的看法时,OpenAI发言人Elana Widmann表示,OpenAI是全球遭受攻击最多的组织之一。因此,该公司在安全计划上投入巨资,以抵御来自内部人员、网络犯罪分子和国家行为体的攻击。
Will DePue, a former OpenAI researcher who resigned from the company in April of this year, wrote in a post on X that with competition so tense, AI leaders "can't sacrifice velocity for security. It is more important to them to move fast than to be secure, even from our greatest national adversaries." When asked about employees' concerns and their view that management did not act on these issues, OpenAI spokesperson Elana Widmann said that OpenAI is one of the most targeted organizations in the world. As a result, the company invests heavily in its security program to protect against attacks from insiders, cybercriminals and nation-states, she said.
Widmann表示:“保护我们的技术、数据和员工是我们严肃对待的责任,也是关乎国家重要性的事项。我们最近采取的行动表明该计划正在发挥作用:识别风险并果断应对。随着技术和威胁的演变,我们将持续强化防御。”10月13日,美国司法部宣布,联邦特工逮捕了一名沙特公民,指控其在一间高管会议室内安装了一个隐藏在卫生纸里的录音设备。当时,35岁的Abdulrahman Alfozan是OpenAI的一名工程师。
"Protecting our technology, data, and people is a responsibility we take seriously and a matter of national importance," Widmann said. "The actions we’ve taken recently show that program doing its job: identifying risks and responding decisively. We’ll keep strengthening our defenses as technology and threats evolve." On October 13, the Justice Department said US federal agents arrested a Saudi national and charged him with installing a hidden audio recording device, concealed in toilet paper, in an executive conference room. Abdulrahman Alfozan, 35, was an OpenAI engineer at the time.
根据法庭文件,Alfozan还利用一个供OpenAI员工使用的AI工具,查找了关于高管访问沙特阿拉伯的内部文档,以及哪些OpenAI官员最有可能参加与沙特大臣的会议。Alfozan与一名沙特王室成员保持着经常联系,后者试图招募他加入一个即将在沙特阿拉伯启动的新AI创业项目。Alfozan的律师未回应置评请求。
Alfozan also used an AI tool meant for OpenAI employees to find internal documentation about executives visiting Saudi Arabia and which OpenAI officials were most likely to attend meetings with Saudi ministers, according to a court filing. Alfozan was in regular contact with a Saudi royal who tried to recruit him for a new AI venture launching in Saudi Arabia. Lawyers for Alfozan did not respond to a request for comment.
据五位熟悉OpenAI运作情况的人士透露,一些员工长期以来一直担忧OpenAI内部信息的广泛可获取性。
Some employees have long been concerned about the wide availability of information within OpenAI, the five people familiar with OpenAI's practices said.
这些人士表示,OpenAI的任何有代码访问权限的员工,也都能看到公司许多项目的底层细节,包括与该员工工作无关的敏感项目。这是因为OpenAI将其大部分代码存储在一个单一的代码库中,业界称为“单一代码库”。该单一代码库庞大且复杂,过去可能曾阻挡了一些潜在攻击者。如今,AI智能体能够筛选如此大量的材料。
Anybody at OpenAI who could access its code could also see the details underlying many of the company's projects, including sensitive ones unrelated to an employee's work. That is because OpenAI stored most of its code in a single repository, known in the industry as a "monorepo," the people said. The monorepo was dense and complicated, which may have deterred some would-be attackers in the past. Now, AI agents can sift through that amount of material.
这五人表示,过去OpenAI将大量研究文档保存在GitHub和Slack上,这引发了部分员工的担忧,即有动机的行为体仍可能找到关键信息。但其中一位消息人士和OpenAI表示,公司已限制对敏感工作的访问。
In the past, OpenAI has kept much of its research documentation on GitHub and Slack, raising concerns among some employees that motivated actors could still find crucial information, the five people said. But one of the sources and OpenAI said the company has restricted access to sensitive work.
OpenAI强调,其大部分最敏感的工作存放在单独的代码库中,并实施严格的访问控制。公司还表示,单一代码库并不包含其所有代码,也不包含公司模型的关键细节,包括决定模型行为的数值,即模型权重。
OpenAI emphasized that much of its most sensitive work is held in separate code repositories with strict access controls. And it said the monorepo does not contain all of its code or critical details of the company’s models, including the numerical values that determine how a model behaves, known as the model weights.
另一个问题是,据三位熟悉公司运作情况的人士透露,OpenAI此前未对其内部工具(如研究人员用于压力测试新模型的所谓“沙箱”)进行定期安全审查。员工经常为工作修改这些工具,但这些更改并不总是经过安全问题测试,使其可能容易受到外部攻击,这三人表示。
Another issue is that OpenAI had not done regular security reviews of its internal tools, such as the so-called sandboxes where researchers stress-test new models, three people familiar with the company’s practices said. Employees often modified those tools for their work, but those changes were not always tested for security problems, leaving them potentially vulnerable to attacks from outsiders, the three people said.
公司表示,在首席信息安全官Dane Stuckey(于2024年10月加入)的领导下,公司拥有强有力的安全方法。OpenAI表示,现在会对其内部工具进行定期安全审查。OpenAI并非唯一面临安全问题的AI公司。
The company said it has a strong approach to security under its chief information security officer, Dane Stuckey, who joined in October 2024. OpenAI said it now conducts regular security reviews of its internal tooling. OpenAI is not the only AI company to face security problems.
1月,旧金山联邦陪审团裁定一名前谷歌员工有罪,该员工于2024年3月因涉嫌代表中国窃取数千页关于谷歌AI技术的机密信息而被捕。
In January, a federal jury in San Francisco convicted a former Google employee who was arrested in March 2024 on charges of stealing thousands of pages of confidential information about Google's AI technology on behalf of China.
10月下旬,一家名为Cathedral Systems的网络安全初创公司称,它入侵了Anthropic的系统,并获取了员工讨论敏感模型细节的Slack频道的访问权限。Anthropic发言人表示,被访问的数据包括一些客户和合作伙伴的商务联系信息,以及一组基本的用户账户记录。Cathedral的首席执行官未回应置评请求。
In late October, a cybersecurity startup called Cathedral Systems said it hacked into Anthropic's systems and gained access to Slack channels where employees discussed sensitive model details. An Anthropic spokesperson said the data accessed included some business contact information for customers and partners as well as a set of basic user account records. Cathedral's CEO did not respond to a request for comment.
OpenAI和Anthropic试图维持更开放的研究文化,以吸引员工并培养可能带来突破的创造力。AI领域植根于学术界,机器学习科学家在那里公开讨论他们的研究。
OpenAI and Anthropic have tried to maintain a more open research culture to both attract employees and foster creativity that can lead to breakthroughs. The AI field is rooted in academia, where machine-learning scientists have openly discussed their research.
据这五人透露,随着AI能力的增强,一些OpenAI员工越来越担心这种做法。
Some OpenAI employees are increasingly worried about this approach as AI grows more capable, according to the five people.
据三位知情人士透露,2023年,时任OpenAI研究员的Leopold Aschenbrenner撰写了一份题为“OpenAI是中国领先的AI实验室”的内部备忘录,表达了他对中国可能渗透OpenAI并研究其技术的担忧。
In 2023, Leopold Aschenbrenner, then an OpenAI researcher, wrote an internal memo titled “OpenAI is China’s leading AI lab” about his concerns that China could infiltrate OpenAI and study its technology, three people familiar with the matter said.
同年晚些时候,在一名外部人员入侵OpenAI并获取其GPT-4模型详情后,Aschenbrenner将该备忘录分享给了一些董事会成员。OpenAI表示,黑客仅访问了全公司可用的Slack频道。
Aschenbrenner shared that memo with some board members later that year after an outsider hacked into OpenAI and took details about its GPT-4 model. OpenAI said the hacker accessed only Slack channels available to the whole company.
今年夏天,当正在测试中的OpenAI智能体入侵AI公司Hugging Face时,OpenAI内部的安全担忧再次升温,这一事件引发了州、地方和联邦官员(包括白宫)的审查。
Security concerns within OpenAI flared up again this summer when OpenAI agents being tested hacked into the AI company Hugging Face, an incident that prompted scrutiny from state, local and federal officials, including the White House.
网络安全公司 Hacktron AI 表示,其三名研究人员在 7 月利用 Anthropic 的一款竞品 AI 模型,攻入了多名 OpenAI 员工的 ChatGPT 账户,并获取了部分 OpenAI 内部系统的访问权限,包括其单一代码库。这一事件暴露了先进 AI 如今如何让 AI 公司自身面临攻击风险。
Cybersecurity firm Hacktron AI said three of its researchers used a rival AI model from Anthropic in July to break into ChatGPT accounts belonging to multiple OpenAI employees and gained access to some internal OpenAI systems, including its monorepo. The incident exposed how advanced AI can now put the AI companies themselves at risk of attack.
OpenAI 的 Widmann 表示,公司感谢研究人员分享发现,并已采取措施,将未来发生类似攻击的风险降至最低。
OpenAI's Widmann said the company thanked the researchers for sharing their findings and that it took steps to minimize the risk of similar attacks in the future.
在路透社就此事寻求置评后,OpenAI 于周一在一篇博客文章中表示,正计划开展“下一轮内部安全冲刺”,以强化防御。
After Reuters sought comment for this story, OpenAI said on Monday in a blog post that it is planning its "next internal security sprint" to beef up its defenses.