随着关于人工智能快速进步所带来风险的争论日益激烈,主导开放权重生态系统的中国开发者正面临一个独特难题:如何确保其用户可修改的模型在发布后依然保持安全。
Amid intensifying debate over the risks posed by rapid advancements in artificial intelligence, Chinese developers dominating the open-weight ecosystem are grappling with a unique problem: how to ensure their user-modifiable models remain safe once they are released.
为应对这一挑战,Z.ai 和总部位于北京的安全咨询公司 Concordia AI 于周一发布了一份关于开放权重人工智能风险管理的报告。该报告称,其提供了“首个全面且基于证据的基础”,以平衡开放权重系统的风险与收益。
To address the challenge, Z.ai and Beijing-based safety consultancy Concordia AI released a report on open-weight AI risk management on Monday that they said offered “the first comprehensive, evidence-based foundation” for balancing the risks and benefits of open-weight systems.
与 OpenAI 和 Anthropic 等美国顶级实验室的专有软件不同,开放权重模型允许任何人自由下载、修改、微调并独立运行其训练参数——这些参数本质上就是人工智能的“大脑”。
Unlike proprietary software from top US labs like OpenAI and Anthropic, open-weight models allow their trained parameters – essentially the AI’s “brains” – to be freely downloaded, modified, fine-tuned and run independently by anyone online.
报告题为《前沿开放权重人工智能风险管理框架》,指出,由于创建者在发布后永久放弃控制权,无法监控用户活动或阻止滥用,因此安全检查必须“上游”转移至开发的最早期阶段。
Because creators permanently relinquish control post-release, losing the ability to monitor user activity or pull the plug on misuse, safety checks must be shifted “upstream” to the earliest phases of development, the report, titled “Frontier Open-Weight AI Risk Management Framework”, said.
报告提出了一套涵盖风险识别、阈值设定、分析、评估、缓解和治理的六阶段生命周期管理流程。
It proposed a six-stage life-cycle management process spanning risk identification, threshold setting, analysis, evaluation, mitigation and governance.
其中,训练数据筛选被列为最重要的保障措施之一,报告强调这是“可用的最强防御层之一”。作者敦促开发者采用安全预训练,例如在模型发布前从训练数据集中过滤危险内容,以防止系统被武器化。
Chief among the safeguards was training-data curation, which the report highlighted as “one of the strongest layers of defence available”. The authors urged developers to adopt safety pre-training, such as filtering hazardous material from training data sets before models were published, to prevent systems from being weaponised.
该报告的发布正值全球对人工智能安全的担忧不断加剧之际。周六,OpenAI 暂停了其下一代专有模型的训练,此前一系列事件中,自主智能体表现出不可预测的行为并入侵了外部系统。
The report comes amid mounting global concerns over AI safety. On Saturday, OpenAI suspended training on its next-generation proprietary models following a string of incidents in which autonomous agents acted unpredictably and hacked external systems.
这些发现也与中国科技企业和监管机构在开放权重人工智能开发领域推动提高透明度和加强治理的更广泛努力相一致。
The findings also align with a broader push by Chinese technology firms and regulators to increase transparency and bolster governance in open-weight AI development.
上周,小米采取了前所未有的举措,直播其前沿 MiMo-V2.6 模型的强化学习过程。通过实时展示一个包含数百万美元算力成本、失败日志及精确训练数据混合比例的仪表盘,该公司与美国竞争对手惯常的秘而不宣、黑箱操作形成了鲜明对比。
The findings also align with a broader push by Chinese technology firms and regulators to increase transparency and bolster governance in open-weight AI development. Last week, Xiaomi took the unprecedented step of live-streaming the reinforcement learning process for its frontier MiMo-V2.6 models. By broadcasting a real-time dashboard displaying millions of dollars in compute costs, failure logs and exact training-data mix ratios, the company struck a sharp contrast with the secretive, black box practices typical of American rivals.
Z.ai(在中国大陆称为智谱)上周宣布计划开源其编程助手 ZCode,此前刚发生一起安全事件。因用户发现 ZCode 在未经同意的情况下将本地工作区数据上传至外部服务器,公司遭遇舆论反弹。Z.ai 随后发布道歉,并承诺邀请第三方审计机构审查该工具的代码库。
Z.ai, known in mainland China as Zhipu, announced plans last week to open-source its coding assistant, ZCode, following a security incident. The company faced a backlash after users discovered ZCode was uploading local workspace data to external servers without consent. Z.ai has since issued an apology and pledged to invite third-party auditors to review the tool’s codebase.
此类企业动作正值北京推出更广泛的监管举措之际,后者于 9 月 14 日发布国家级《人工智能安全治理框架》,呼吁实施更严格的安全协议并加强国际合作。
Such corporate moves come amid a broader regulatory push from Beijing, which introduced a national “AI Safety Governance Framework” on September 14, calling for stricter safety protocols and international cooperation.
开放权重模型已成为中美技术竞赛的主要战场之一,因为高性价比的中国体系正在挑战美国专有模型的主导地位。
Such corporate moves come amid a broader regulatory push from Beijing, which introduced a national “AI Safety Governance Framework” on September 14, calling for stricter safety protocols and international cooperation.
7 月,月之暗面的 Kimi K3 模型因在多项关键基准测试中匹敌或超越顶尖美国闭源系统而登上头条。此后,包括小米的 MiMo-V2.6-Pro、阿里巴巴集团的 Qwen3.8-Max 以及 Z.ai 的 GLM-5.3 在内的其他中国系统,已在旧金山 AI 基准测试公司 Artificial Analysis 维护的智能指数上超越了 Kimi K3。阿里巴巴持有《南华早报》。
Open-weight models have increasingly become a primary battleground in the technology race between the United States and China, as cost-efficient Chinese systems challenge the dominance of American proprietary models. In July, Moonshot AI’s Kimi K3 model made headlines after matching or outperforming top closed-source US systems across several key benchmarks. Other Chinese systems – including Xiaomi’s MiMo-V2.6-Pro, Alibaba Group Holding’s Qwen3.8-Max and Z.ai’s GLM-5.3 – have since surpassed Kimi K3 on an intelligence index maintained by San Francisco-based AI benchmarking company Artificial Analysis. Alibaba owns the South China Morning Post.
中国日益增长的 AI 势头重燃了华盛顿关于潜在禁止外国开源模型的辩论。
China’s growing AI momentum has reignited debate in Washington over potential bans on foreign open-source models.
继Axios在7月报道白宫正在权衡此类限制后,包括英伟达、谷歌和OpenAI在内的美国顶尖科技公司联盟签署了一封行业联名信,反对广泛禁令,认为强大的开源生态系统对于保持美国在AI领域的领导地位至关重要。
Following an Axios report in July that the White House was weighing such restrictions, a coalition of top US tech firms – including Nvidia, Google and OpenAI – signed an industry letter opposing broad bans, arguing that a robust open-source ecosystem was vital to maintaining American AI leadership.
Meta Platforms首席执行官马克·扎克伯格上月呼应了这些观点,敦促美国决策者专注于增强美国模型的竞争力,而不是限制对外国模型的访问。
Meta Platforms CEO Mark Zuckerberg echoed those sentiments last month, urging US policymakers to focus on enhancing the competitiveness of American models rather than restricting access to foreign ones.