一位前安索司和OpenAI的研究员兼举报人表示，自动化的AI研究正在逼近，警告称这可能让人类完全无法控制未来发展的方向。27岁的考克斯在上个月公开辞去安索司的能力研究员职务后，在周一面前向纽约市议员发表了讲话，警示AI可能威胁到人类的生存。
Automated AI research is on the horizon, a former Anthropic and OpenAI researcher-turned-whistleblower said, warning it could leave humans totally unable to control what comes next. Jacob Coxon, the 27-year-old who publicly resigned from Anthropic last month after working as a capabilities researcher, made the comments before New York City lawmakers on Monday as he sounded the alarm that AI could threaten humanity's survival.
考克斯在纽约市议会关于AI风险的听证会上作证称，自动化AI研究已成为顶级前沿AI实验室的“主要目标”。
Coxon testified that automating AI research has become "the primary goal" of top frontier AI labs.
“在我上一份工作中，某种意义上来说，我是在为自己自动化而工作的,”考克斯在纽约市议会听证会上说。“当我在OpenAI工作时，我们为自动化AI研究员设立了里程碑目标，大概在2027年、2028年，我们正按计划推进，甚至超出预期,”他说。“这只是几个月的事情，不是几十年，甚至不是五年。”
"At my last job, I was, in some sense, working to automate myself," Coxon said at the New York City Council hearing focused on AI risks. "When I was at OpenAI, we had milestones for an automated AI researcher, around 2027, 2028, and we are on track or beating these expectations," he said. "That's a matter of months from now, not decades or even five years."
考克斯表示，一旦AI能够进行自己的研究，“人类将远远落后于当前的水平，而当前的局面已经不太理想。”
Coxon said that once AI can conduct its own research, "humans will be much further out of the loop than we are today, and today is already not great."
凭借他所称的第一手经验，考克斯表示，如今大多数代码是由AI编写的。“人们再也不会那么仔细地检查这些代码了,”他作证。OpenAI和安索司未立即回应对考克斯言论的置评请求。
Speaking from what he called firsthand experience, Coxon said that the majority of the code written today is written by AI. "And people do not check it that carefully anymore," he testified. OpenAI and Anthropic did not immediately respond to a request for comment on Coxon's remarks on Tuesday.
考克斯是一批AI行业举报人的成员，在为时多小时的听证会上作证，其他发言者还包括OpenAI、安索司、谷歌和Meta的代表。
Coxon was among a panel of AI-industry whistleblowers to testify at the hourslong hearing, which also included testimony from representatives of OpenAI, Anthropic, Google, and Meta.
“本次听证会并非要抑制创新,”市议会发言人朱丽·明宁在开场时解释道,“这次听证会的真正意图是确保创新能够负责任地进行。”
"This hearing is not about stifling innovation," City Council speaker Julie Menin said at the outset of the proceeding, explaining, "the true intent of this hearing is to ensure that innovation happens responsibly."
在他的证词中，考克斯告诉议员们，他在安索司和OpenAI的经历让他确信这些公司在没有足够安全保障措施的情况下推进了相关工作。
In his testimony, Coxon told council members that his experience inside Anthropic and OpenAI convinced him that the firms were moving ahead without adequate safeguards in place.
“人类很可能会失去对这些人工智能的控制，最终甚至可能导致人类灭绝，”考克森说道，并补充道：“以目前的风险程度来看，这些公司行事实在过于鲁莽。” 考克森在X平台上发布了一篇迅速走红的帖子，宣布自己从Anthropic辞职。他在帖子中称，无论是Anthropic还是OpenAI都“没有履行应有的责任”，还指责两家公司都在“拿我们的生命当赌注”。
"It is more likely than not that humanity loses control to these AIs, and it could end in human extinction," Coxon said, adding, "From my experience, the companies are being extremely reckless given the stakes." When Coxon announced his resignation from Anthropic on X in a now-viral post, he said neither Anthropic nor OpenAI was "acting responsibly," and alleged both were "gambling with our lives."
在周一的听证会上，考克森呼吁各人工智能实验室提高透明度，并放缓技术发展的速度。“这些公司秉持的是初创企业的思维模式：快速行动、大胆试错、事后再补救。这种模式适用于照片分享类应用，却绝不适用于开发有史以来最强大的技术，”他作证时说道。 考克森辞职数日后，Anthropic首席执行官达里奥·阿莫迪发表了一篇近4000字的文章，呼吁整个人工智能行业放慢发展步伐。
During Monday's hearing, Coxon called for more transparency from AI labs and a slowdown in the development of rapidly advancing technology. "The companies run on a startup mindset: move fast, break things, fix them later. That works for a photosharing app. It does not work for building the most powerful technology ever built," he testified. Days after Coxon's resignation, Anthropic CEO Dario Amodei published a new, nearly 4,000-word essay urging the AI industry to slow down.
“我们必须减缓提升人工智能模型能力的速度，”阿莫迪写道，“即便如此，技术进步看起来依然会很快，因此我们必须善加利用由此获得的宝贵时间。” 对此，OpenAI首席执行官萨姆·奥尔特曼也在X平台上回应称：“我赞同达里奥的观点，我们需要控制技术发展的节奏。这也是近几周来我们在OpenAI内部讨论的核心议题。”
"We must slow the pace at which we improve the capabilities of AI models," Amodei wrote. "Progress will still seem fast, and we must make wise use of the time we gain." In response, OpenAI CEO Sam Altman said in an X post, "I agree with Dario that we need to pace the frontier. This has been a primary topic of discussions we've had at OpenAI in recent weeks."