字号·· | 护眼
theregister

英伟达以更开放权重的模型争取警惕的欧洲客户Nvidia woos wary Europeans with more open weights models

点「原文对照」整页切到原文,或双击某段只看那段的原文。

Nvidia希望通过推出一系列涵盖聊天机器人、医疗保健和机器人领域的新开放权重模型,来利用欧洲对主权AI的需求。主要模型开发商拥有从头构建高性能模型的资源。但大多数企业不具备这一条件,因此被迫使用自己的数据集对Mistral或H Company等公司的开放权重模型进行微调。在GTC Berlin大会上,Nvidia发布了其开放权重模型库的最新成员,包括更新后的Nemotron Retriever嵌入模型和Alpamayo自动驾驶模型。

Nvidia hopes to capitalize on European sovereign AI demand by unloading a slew of new open weights models spanning chatbots, healthcare, and robotics. The major model devs have the resources to build highly capable models from scratch. But most enterprises don't, and have instead been forced to fine tune open weights models from the likes of Mistral or H Company using their own datasets. At GTC Berlin, Nvidia unveiled its latest additions to its open weights model library with refreshed Nemotron Retriever embedding and Alpamayo autonomous vehicle models.

嵌入模型的作用虽然嵌入模型绝不是最引人注目的模型子类,但它们对于企业应用来说却是最实用的模型之一。我们过去曾深入探讨过的检索增强生成(RAG)技术,在很大程度上依赖这些模型生成的嵌入向量,用于AI增强搜索等应用。从高层来看,RAG的工作原理是将文档切分成块,然后将其转换为称为嵌入的向量。

The point of embedding models While by no means the sexiest subclass of models out there, embedding models are some of the more useful ones for enterprise apps. Retrieval augmented generation (RAG), a technology we've explored extensively in the past, relies heavily on the embeddings generated by these models for applications like AI-augmented search. At a high level, RAG works by cutting up documentation in chunks, then converting those into vectors called embeddings.

这些嵌入会根据与用户查询的相关性进行排序,随后被送入大语言模型(LLM)的上下文中。

The embeddings are then ranked based on their relevance to the user's query before they're fed into an LLM's context.

Nvidia最新的基于Nemotron 3.5的嵌入和重排序模型,支持跨34种语言的图像和文本嵌入。此次发布的模型参数量从10亿到80亿不等,并提供了适用于新款Blackwell架构加速器的NVFP4量化版本。这种规模足以在DGX Spark等设备上运行,并留有充足空间供其他模型使用。一如既往地,厂商的宣称需持保留态度,但Nvidia声称,在BF16精度下,其新款80亿参数的嵌入和重排序模型现已成为ViDoRe V3.1基准测试中排名第一的稠密模型。然而,并非所有文档都能轻松转换为嵌入。PDF因嵌入模型难以理解而臭名昭著。

Nvidia's latest embedding and reranking models, based on Nemotron 3.5, support embeddings of both images and text across 34 languages. This time around, the models are being offered in sizes ranging from one to eight billion parameters, with NVFP4-quantized versions for those running on new Blackwell-based accelerators. That's small enough to run on something like a DGX Spark with plenty of room to spare for other models. Always take vendor claims with the usual grain of salt, but among competing embedding models, Nvidia boasts that at BF16-precision, its new 8 billion parameter embedding and reranking models are now the top-ranked dense models on the ViDoRe V3.1 benchmarks. However, not all documents are easily converted into embeddings. PDFs are notoriously difficult for embedding models to make sense of.

这些文档通常是从印刷源材料扫描并格式化而成,供人们阅读,这意味着需要抓取文本并解析图表。为此,Nvidia 还推出了经过更新的 Nemotron Parse 模型,该模型专门经过训练,用于从 PDF 文档中提取信息。Nvidia 称,在单张 H100 上运行 10 亿参数模型时,该模型每秒可处理约 10.5 页。

They're often scanned from printed source material and formatted for consumption, which means scraping text and parsing charts. For this, Nvidia has also launched a refreshed Nemotron Parse model that's been trained specifically to extract information from PDF documents. Nvidia claims the model can process roughly 10.5 pages a second when running the one billion-parameter model on a single H100.

除了新的嵌入模型,Nvidia 还推出了 Alpamayo 2 Edge 的访问权限,这是其自动驾驶模型的一个更紧凑版本,基于该模型,Nvidia 承诺在公司的 DRIVE AGX Thor 平台上运行时,可实现对流式视频和传感器数据的实时处理。

Alongside the new embedding models, Nvidia is also rolling out access to Alpamayo 2 Edge, a more compact version of its autonomous driving model based on which promises real-time processing of streaming video and sensor data when running on the company's DRIVE AGX Thor platform.

这些模型的发布仅在 GPU 巨头推出 Nemotron 3.5 Super 视觉语言 (VL) 模型一周后,并预告了 Nemotron 3.5 Bolt,这是一个拥有 740 亿参数的专家混合 (MoE) 模型,设计目标是能装入最低仅 24 GB 显存中。Nvidia 表示,该模型将于周五起供下载。

The models come just a week after the GPU giant launched its Nemotron 3.5 Super vision language (VL) model and teased Nemotron 3.5 Bolt, a 74 billion-parameter mixture of experts (MoE) model designed to fit in as little as 24 GB of video memory. That model, Nvidia says, will be available for download starting Friday.

虽然开放模型为企业和政府提供了一条通往主权 AI 的道路,但 Nvidia 的模型在发布方式上有些独特。大多数开放权重模型都是一种“黑盒”。任何人都可以下载它们,但用于得出这些权重的数据和过程却是个谜。Nvidia 的许多模型并非如此:除了权重,Nvidia 通常还会发布训练数据以及将其转化为最终模型的配方。这意味着客户不仅可以在底层检查模型,还可以基于 Nvidia 的 Nemotron 架构构建完全定制的模型,而不必试图事后通过微调来修改权重。

While open models provide enterprises and governments a path toward sovereign AI, Nvidia's models are somewhat unique in how they're released. Most open weights models are a sort of black box. Anyone can download them, but the data and processes used to arrive at those weights is a mystery. This isn't the case with many of Nvidia's models: Alongside their weights, Nvidia routinely releases the training data and the recipes used to turn it into the final model. This means customers can not only inspect the model at a low level, but build a fully custom model based on Nvidia's Nemotron architecture, rather than trying to modify the weights after the fact through fine tuning.

我们应当指出,Nvidia 并非唯一这样做的机构。艾伦人工智能研究所 (Allen Institute) 出于同样的原因,也在其 OLMo 模型上采用了类似的策略。®

We should note that Nvidia is not the only one to do this. The Allen Institute has employed a similar strategy with its OLMo models for this very reason. ®

阅读媒体原文 ↗