作者：Seth Fiegerman。一名专注于AI安全的OpenAI员工已辞职，并警告称，顶尖的人工智能公司尚未采取足够措施来缓解该技术带来的风险。他加入了越来越多从行业内发出警报的员工行列。
By Seth Fiegerman An OpenAI employee focused on AI safety has quit the company and warned that top artificial intelligence firms aren’t doing enough to mitigate the technology’s risks, joining a growing chorus of employees raising alarms from within the industry.
此前曾负责OpenAI安全团队透明度工作的David Robinson在《大西洋》杂志的一篇文章中写道，ChatGPT的开发者“通过试错法取得了成功”。
David Robinson, who previously led transparency work on OpenAI’s safety team, wrote in an essay for The Atlantic that the ChatGPT maker “has thrived by trial and error.”
然而，他表示，这种模式所导致的失败风险正随着技术能力的提升而加剧，并提到了OpenAI在测试期间未能阻止其AI失控的情况。
However, he said the stakes of the inevitable failures that come from that approach are growing along with the technology’s capabilities, citing OpenAI’s failure to prevent its AI from going rogue during testing.
Robinson在文章中写道：“我的前同事都很聪明，工作努力，并试图做出正确的选择。
“My former colleagues are smart, work hard, and try to make good choices,” Robinson wrote in the essay.
但随着公司从一个产品发布冲刺到下一个，他们未能达到我认为所必需的关注程度。”他补充说，真正需要的是“第一次就能做到近乎完美”。
“But as the company sprints from one launch to the next, it is failing to achieve the level of care that I believe is needed.”What’s required, he added, is “something much closer to perfection the first time.”
近几周，多家顶尖AI公司的员工都警告了人工智能可能带来的灾难性风险。一些人甚至表示，该技术有一天可能会灭绝人类。
A number of employees across the top AI companies in recent weeks have warned about the potential catastrophic risks from artificial intelligence. Some have gone so far as to say there’s a chance the technology could one day wipe out the human race.
在此背景下，Anthropic PBC首席执行官Dario Amodei呼吁放慢开发最先进模型的速度，并表示他的公司将聘请第三方评估者来协助审查和保护这项技术。
Against that backdrop, Anthropic PBC Chief Executive Officer Dario Amodei called for slowing down the pace of developing the most cutting-edge models, and said his company would bring on third-party evaluators to help vet and safeguard the technology.
包括OpenAI的Sam Altman在内的其他行业人士也公开支持Amodei的计划。
Others in the industry, including OpenAI’s Sam Altman, have publicly endorsed Amodei’s plan.
Robinson在文章中指出，AI公司应更像核电站那样运营，“具备多层冗余机制和细致、耗时的规划，这样偶尔不可避免的人类错误才不会引发灾难”。
In his essay, Robinson said AI firms should be run more like nuclear power plants, “with layers of redundancy and careful, time-consuming planning, so that the occasional and inevitable human error does not open a door to disaster.”
他说道，目前“AI公司并不知道如何做到这一点——但其他人知道。”
At the moment, he said, “AI companies don’t know how — but other people do.”