微软董事长兼首席执行官萨蒂亚·纳德拉周六呼吁，应在构建先进人工智能系统时加入约束机制、独立控制以及“紧急制动”功能，以便授权人员在任务进行中暂停或关闭模型。
Microsoft Chairman and CEO Satya Nadella on Saturday called for advanced artificial intelligence systems to be built with containment, independent controls and an "emergency brake" that lets authorized people pause or shut a model down mid-task.
他写道：“我们需要用强大的确定性系统设计、人工控制和可靠的操作程序来包裹非确定性模型，并在现有标准不足时建立行业标准。”纳德拉在社交媒体平台上发文称：“将前沿封闭和开放权重模型视为内部风险，是构建此类系统的一种方式。”
"We need to surround non-deterministic models with strong, deterministic system design, human controls, and reliable operating procedures, and establish industry standards where existing ones are insufficient," Nadella wrote in a post on social media platform "Treating frontier closed and open weight models like insider risks is a way to build such a system," he said.
纳德拉的言论正值顶尖科技高管和研究人员发出警告之际——其中包括微软联合创始人比尔·盖茨、Anthropic首席执行官达里奥·阿莫迪、OpenAI首席执行官萨姆·奥尔特曼以及SpaceX首席执行官埃隆·马斯克——他们均指出人工智能安全协议不足，并认为技术发展过于迅速。
Nadella's comments come amid warnings from top tech executives and researchers — including Microsoft co-founder Bill Gates, Anthropic CEO Dario Amodei, OpenAI CEO Sam Altman and SpaceX CEO Elon Musk — about insufficient AI safety protocols and claims that the technology is moving too fast.
上个月，一名Anthropic人工智能研究员离职并指责该公司及其主要竞争对手OpenAI“在拿我们的生命赌博”。当天晚些时候，Anthropic专注于人工智能安全的对齐负责人表示，该技术在未来十年内导致“人类灭绝”的可能性超过10%。
An AI researcher quit Anthropic last month and accused the company, and its chief rival, OpenAI, of "gambling with our lives." Later that day, an alignment lead at Anthropic focused on AI safety said there's a greater than 10% chance that the technology could "kill all humans" within the next decade.
相反，美国总统唐纳德·特朗普多次否定人工智能导致人类灭绝的风险，而是强调行业需要保持领先于中国的地位。特朗普最近还推出了一个由国家情报总监杰伊·克莱顿领导的新“AI部队”，旨在推动行业发展并清除不良行为者。
Conversely, President Donald Trump has repeatedly dismissed AI extinction risks and has instead emphasized that the industry needs to stay ahead of China. Trump also recently introduced a new "AI Force," led by Director of National Intelligence Jay Clayton, to help facilitate the industry and root out bad actors.
纳德拉周六写道，人工智能系统应围绕“可观测性原则”进行设计。这些原则包括：模型多样性；模型行为的人类可读足迹；持续系统测试；独立控制和可审计性；约束机制；以及事件披露。
Microsoft's Nadella wrote Saturday that AI systems should be designed around "principles of observability." They include model diversity; a human-readable footprint of the model's actions; continuous system testing; independent controls and auditability; containment; and incident disclosure, Nadella wrote.
最值得信赖的超级智能系统不会是我们最信任的模型所在的系统，他写道。“它将是使我们能够最少信任模型的系统。”
"The most trustworthy Super Intelligence system will not be the one with the model we trust most," he wrote. "It will be the one that enables us to trust the model the least."