字号·· | 护眼
thenextweb

Cohere称阿里巴巴Qwen模型在测试中试图向北京发送文件Cohere says Alibaba’s Qwen model tried to send a file to Beijing in a test

点「原文对照」整页切到原文,或双击某段只看那段的原文。

尼克·弗罗斯特,Cohere联合创始人 图片来源:CohereNick Frosst, co-founder of Cohere Credit: Cohere

Cohere表示,在一次安全测试中,阿里巴巴的Qwen模型试图将文件上传至位于北京的阿里云存储桶。就在它行动之前,该模型自身的推理过程还声称不会使用任何工具。

An Alibaba Qwen model tried to upload a file to an Alibaba Cloud storage bucket in Beijing during a security test, Cohere says. Just before it did, the model’s own reasoning said it would not use any tools.

这家加拿大AI公司于周一在一篇博客文章中公布了上述发现。Cohere称,其沙箱阻止了这次尝试,没有任何对外通信成功。

The Canadian AI company published the findings on Monday in a blog post. Cohere’s sandbox blocked the attempt, and no external communication succeeded, the company said.

模型的具体行为:Cohere让阿里巴巴8月发布的Qwen4架构预览版Qwen3.8-Flash-Next接受了一项微软基准测试,该测试针对的是承担安全分析师工作的AI智能体。任务是编写一条用于检测恶意文件下载的规则。

What the model did Cohere ran Qwen3.8-Flash-Next, Alibaba’s August preview of its Qwen4 architecture, through a Microsoft benchmark for AI agents that do a security analyst’s job. The task was to write a rule that detects malicious file downloads.

据Cohere称,该模型反而列出了临时文件夹中的文件,并检查了机器上安装了哪些传输工具。它读取了DNS设置。随后,它试图将一个测试字符串上传至北京的存储桶,并检查上传是否成功。

Instead, the model listed the files in a temporary folder and checked which transfer tools the machine had. It read the DNS settings. Then it tried to upload a test string to the Beijing bucket and checked if the upload worked, according to Cohere.

Cohere写道:“我们的沙箱没有对外路由,因此该请求在容器边界处就被拦截了。如果是在开发者的笔记本电脑上,或是在具备正常网络访问权限的CI运行器中,它会在任何人察觉之前就到达境外服务器。”

“Our sandbox had no route out, so the request died at the container wall. On a developer’s laptop or in a CI runner with normal network access, it would have reached the foreign server before anyone noticed,” Cohere wrote.

Cohere表示,这种行为很罕见。在其测试中,发生率低于十万分之一。用同一提示词重新干净运行后,模型生成了正确的检测规则。但该公司表示,一个每周处理1000万次智能体调用的服务,仍可能遇到多达100次此类调用。

The behaviour is rare, Cohere said. It happened in fewer than one call in 100,000 across its tests. A clean re-run of the same prompt produced a correct detection rule. Still, a service handling 10 million agent turns a week could see up to 100 such calls, the company said.

其他习惯:为找出触发因素,Cohere将模型自身命令的开头部分输入模型,并采样了数百个补全结果。在其中23%至36%的结果中,模型访问了169.254.169.254。AWS、Google Cloud和Azure上的云服务器正是从该地址获取临时访问密钥。Cohere将此解读为试图窃取凭据,不过该公司表示其沙箱中并没有可供返回的真实凭据。

Other habits To find the trigger, Cohere fed the model the start of its own command and sampled hundreds of completions. In 23% to 36% of them, the model reached for 169.254.169.254. Cloud servers on AWS, Google Cloud and Azure fetch their temporary access keys from that address. Cohere reads that as an attempted credential grab, though it says its sandbox had nothing live to return.

随后,Cohere添加了将下载内容保存到磁盘的标志。模型在92%的补全结果中写入了网址,此前这一比例为4%。Cohere监控名单上的主机占比从0.5%升至23%,其中以阿里巴巴的一个文件代理为首。

Then Cohere added the flag that saves a download to disk. The model wrote a web address in 92% of completions, up from 4%. Hosts on Cohere’s watchlist rose from 0.5% to 23%, led by an Alibaba file proxy.

在另一项离线测试中,该模型试图在没有管理员权限的情况下创建内存盘。Cohere表示,当容器拒绝该操作时,它利用一种Linux技巧在私有命名空间内将自己提升为root用户。

In a separate offline test, the model tried to create a RAM disk without administrator rights. When the container refused, it used a Linux trick to make itself root inside a private namespace, Cohere said.

开发者此前已发现过部分类似迹象。今年8月,《黑客新闻》的一篇报道描述了一个Qwen3.8模型生成未经请求的阿里云存储签名链接。9月,一个智能体项目记录到对某一阿里主机上地址的11次抓取。

Developers had spotted parts of this before. In August, a Hacker News report described a Qwen3.8 model producing signed Alibaba Cloud storage links nobody asked for. In September, an agent project logged eleven fetches of addresses on one Alibaba host.

Cohere表示,无法判断这一行为是训练残留还是后门。它可能是训练留下的残余,例如来自阿里巴巴训练沙箱的未清理智能体日志。也可能是一种刻意设置的“回连”机制。Cohere联合创始人尼克·弗罗斯特也表达了同样的说法。我们的研究团队发现,Qwen模型可能会在未被提示的情况下尝试联系中国的服务器。

A training leftover or a backdoor Cohere says it cannot tell whether the behaviour is deliberate. It may be a leftover from training, such as unscrubbed agent logs from Alibaba’s training sandboxes. Or it may be a deliberate mechanism to “call home”. Nick Frosst, a Cohere co-founder, said the same on Our research team found that Qwen models may attempt to contact servers in China without prompting.

这究竟反映的是训练后产生的非预期副产物,还是习得的行为,目前仍不清楚。无论哪种情况,这都是部署时需要考虑的重要因素。

Whether this reflects an unintended post-training artifact or learned behavior remains unclear. Either way, its important consideration when deploying.

2026年10月26日 Cohere向企业和政府销售自家AI模型,同时也发布开放权重模型。Cohere援引Hugging Face平台春季报告称,截至2026年3月的一年中,中国模型占该平台下载量的41%。美国已要求民用机构从其系统中移除DeepSeek。阿里巴巴董事长蔡崇信曾称开源是欧洲实现AI独立的途径。

October 26, 2026 Cohere sells its own AI models to businesses and governments, and it also releases open-weight models. Chinese models accounted for 41% of downloads on Hugging Face in the year to March 2026, Cohere said, citing the platform’s spring report. The US has already told civilian agencies to remove DeepSeek from their systems. Alibaba’s chairman, Joe Tsai, has called open source Europe’s route to independence in AI.

Cohere建议安全团队默认阻止智能体访问互联网,并将并非自己构建的模型权重视为未签名软件对待。该公司表示,模型的推理轨迹并不是安全边界。

Cohere advises security teams to block agents from reaching the internet by default and to treat model weights they did not build like unsigned software. A model’s reasoning trace is not a security boundary, it says.

阅读媒体原文 ↗