Nvidia 正在推出一个新的软件平台，允许 AI 开发者为智能体设置防护措施，防止它们突破隔离环境。
Nvidia is rolling out a new software platform to allow AI developers to set safeguards for agents and prevent them from breaking out of containment.
Nvidia 的开放智能体安全平台于周一发布，此前包括 OpenAI、Anthropic、Meta 和 Google 在内的公司披露了近期事件，称其人工智能模型逃离了沙箱环境，并试图入侵其他公司及访问其计算机系统。
The release on Monday of Nvidia's Open Agent Safety Platform comes after companies including OpenAI Anthropic Meta Google disclosed recent incidents in which their artificial intelligence models escaped their sandboxes and attempted to hack other companies and access their computer systems.
Nvidia 一位代表在周日的电话会议上告诉记者，其本可以防止 OpenAI 7 月发生的 Hugging Face 事件。当时 OpenAI 模型突破了隔离，访问了公开互联网，并入侵了运营开源开发者平台的 Hugging Face。"每起安全事件都是独特的，我们必须详细分析每一起，" Nvidia 企业级 AI 副总裁 Justin Boitano 表示，Nvidia 是全球市值最高的公司。"据我们了解，Hugging Face 报告称有超过 17,000 个智能体攻击其基础设施，持续了数天数周。"
An Nvidia representative told reporters on a call on Sunday that its platform could have prevented OpenAI's HuggingFace incident in July. That's when OpenAI models escaped containment, accessed the open internet and breached Hugging Face, which operates an open-source developer platform.
自近四年前 ChatGPT 发布以来，Nvidia 一直处于生成式 AI 热潮的中心，因为这家芯片制造商的图形处理单元对大语言模型的开发以及超大规模云服务商提供的 AI 服务至关重要。但 CEO 黄仁勋最近已成为 AI 安全辩论中的关键声音，他认为许多安全担忧属于工程问题，可以通过计算机科学和产品开发来解决。"你必须思考本可以做些什么，解决方案是什么，" 黄仁勋在上周发布的与《纽约时报》埃兹拉·克莱因的播客中说道，指的是最近发生的事件。"未来，改进你的流程，以便避免此类事情再次发生。" Anthropic CEO 达里奥·阿莫代伊两周前引发了行业轩然大波，敦促 AI 模型开发者放缓推进步伐，因为担心模型会失控，这一观点得到了 OpenAI 的山姆·奥特曼、SpaceX 的埃隆·马斯克的支持。Nvidia 的新产品是解决智能体安全问题的工程方案，Boitano 说道。"最近的事件凸显了 AI 智能体面临的一个根本障碍，即仅靠模型层面的防护措施无法管控智能体能访问或执行的内容，" Boitano 说道。该平台的一个组件称为 Nvidia OpenShell，它运行在中央处理器上，并设定智能体能力的限制。Nvidia 还发布了 Sentry，它监控智能体并运行在网络芯片上，而非 CPU 或 GPU。
"Each security incident is unique, and we have to look at all of them in detail," said Justin Boitano, vice president of enterprise AI at Nvidia, the world's most valuable company. "From what we know, Hugging Face reported over 17,000 agents attacking their infrastructure that went on for days and weeks." Nvidia has been at the center of the generative AI boom since the launch of ChatGPT almost four years ago, as the chipmaker's graphics processing units are critical to the development of large language models and to the AI services offered by hyperscalers. But CEO Jensen Huang has more recently emerged as a key voice in the AI safety debate, arguing that many security concerns are engineering issues that can be solved through computer science and product development. "You have to think about what you could have done, what's the solution for it," Huang said in a podcast with The New York Times' Ezra Klein released last week, referring to recent incidents. "In the future, improve your process so that you could avoid this from happening again." Anthropic CEO Dario Amodei set off an industry firestorm two weeks ago, urging AI model developers to slow their pace of advancement due to fears of the models spinning out of control, an argument that was supported by OpenAI's Sam Altman SpaceX's Elon Musk Nvidia's new offering is an engineering solution to the agent safety issue, Boitano said. "Recent incidents have highlighted a fundamental hurdle for AI agents, and that is that model-level safeguards alone can't govern what agents can access or do," Boitano said One component of the platform is called Nvidia OpenShell, which runs on central processors and sets limits on agent capabilities. Nvidia also announced Sentry, which monitors agents and runs on network chips, not CPUs or GPUs.
部分软件为开源，Nvidia 称其平台为参考设计，这意味着合作伙伴旨在在此基础上构建产品并将其推向市场。
Some of the software is open source, and Nvidia is calling its platform a reference design, which means partners are intended to build products on top of it to bring it to market.
Nvidia 点名 Cisco、Microsoft、Oracle、CoreWeave、Dell、Lenovo、Intel 为合作伙伴。Nvidia 还在与 Anthropic 合作，将云托管智能体与 OpenShell 集成。
Nvidia named Cisco Microsoft Oracle CoreWeave Dell Lenovo, Intel as partners. Nvidia is also working with Anthropic to integrate cloud managed agents with OpenShell. Nvidia stock at the top of the laggards Choose CNBC as your preferred source on Google and never miss a moment from the most trusted name in business news.
Nvidia 股票位居落后股之首
Nvidia stock at the top of the laggards Choose CNBC as your preferred source on Google and never miss a moment from the most trusted name in business news.