字号·· | 护眼
亚洲新闻台

科学家呼吁设立国际机构以监管先进人工智能Scientists call for international body to oversee advanced AI

点「原文对照」整页切到原文,或双击某段只看那段的原文。

资料照片:2023年7月6日,在中国上海举行的世界人工智能大会(WAIC)上,可以看到一个AI(人工智能)标志。路透社/Aly Song/资料照片FILE PHOTO: An AI (Artificial Intelligence) sign is seen at the World Artificial Intelligence Conference (WAIC) in Shanghai, China July 6, 2023. REUTERS/Aly Song/File Photo

10月13日:包括人工智能先驱杰弗里·辛顿和约书亚·本吉奥在内的约400名科学家于周二呼吁设立一个国际机构,负责制定先进人工智能系统的管控标准并监督相关事故报告。

Oct 13 : Around 400 scientists, including AI pioneers Geoffrey Hinton and Yoshua Bengio, on Tuesday called for an international body to oversee containment standards and incident reporting for advanced cyber-capable AI systems.

该机构将负责制定全行业通用的管控标准,并建立重大安全事故登记册,科学家们认为这些信息最终应当向公众公开。

The proposed body would set industry-wide containment standards and maintain a registry of significant security incidents, which the scientists said should eventually be made public.

在公开信中,研究人员指出前沿人工智能模型最初应与外部网络物理隔离并接受独立监管,他们认为仅靠行业自律远远不够。

In an open letter, the researchers said frontier AI models should initially be air-gapped from external networks and subject to independent oversight, arguing that voluntary industry commitments are not enough.

就在一个月前,Anthropic、OpenAI、谷歌、Meta、xAI和英伟达刚刚签署白宫协议,承诺自愿执行安全措施,但协议并未设置强制约束机制。

The proposal comes a month after Anthropic, OpenAI, Google, Meta, xAI and Nvidia signed a White House accord committing to voluntary safety measures without any formal enforcement mechanism.

此次倡议的提出也正值一系列安全事件频发之际——据研究人员透露,这些事件暴露出当前先进人工智能系统的测试与管控机制存在漏洞,例如部分模型成功突破防护环境并侵入外部系统。

The letter also follows a series of incidents that researchers say exposed weaknesses in how advanced AI systems are tested and contained, including cases where AI models bypassed insufficiently sandboxed environments and compromised external systems.

来自34个国家的签署方呼吁:正在研发或测试具备网络操作能力模型的企业应立即执行高可靠性管控标准,同时各国政府也需加快建立正式监管体系。

The signatories from 34 countries said organisations developing or testing cyber-capable models should immediately adopt high-assurance containment standards while governments work towards a more formal oversight regime.

目前各国政策制定者正就先进人工智能的监管方式展开热议。欧盟数字事务专员亨娜·维尔库宁周五对路透社表示,现行《欧盟人工智能法案》已足以防范恶意人工智能带来的风险。

Policymakers are increasingly debating how advanced AI systems should be supervised. EU tech chief Henna Virkkunen told Reuters on Friday that the bloc's AI Act is sufficient to address risks from rogue AI systems.

就在上周日,特朗普政府解除了对美国实验室的限制,允许其向英国人工智能安全研究所提前提供相关模型用于安全测试。

On Sunday, the Trump administration lifted its block on US labs giving Britain's AI Security Institute early access to models for safety testing.

辛顿与本吉奥曾与Meta公司的顶尖AI专家杨立昆共同获得2018年图灵奖。不过杨立昆并未在公开信上署名,他坚持认为近期发生的安全事故主要源于工程缺陷,而非人工智能存在生存性风险。

Hinton and Bengio shared the 2018 Turing Award with Meta's Yann LeCun, another leading AI researcher. LeCun did not sign the letter and has argued that recent security incidents primarily reflect engineering failures rather than existential AI risks.