字号·· | 护眼
连线

Hugging Face推出新AI生物学模型,让你与DNA对话Hugging Face’s New AI Biology Model Lets You Chat With DNA

点「原文对照」整页切到原文,或双击某段只看那段的原文。

人工智能平台 Hugging Face 周四发布了一个新的开源模型,用于解析 DNA 结构,该模型可以在笔记本电脑上本地运行。

The AI platform Hugging Face on Thursday released a new open-source model for understanding DNA that can run locally on a laptop.

该模型是由 Hugging Face 与中国中关村研究院以及意大利那不勒斯费德里科二世大学的研究人员共同开发的,通过分析基因组序列和自然语言数据进行训练,使用户能够提出关于 DNA 变化对基因活性和健康影响的问题,并获得相应的对话式回答。

Developed in collaboration with researchers at Zhongguancun Academy in China and the University of Naples Federico II in Italy, the model is trained on genomic sequences and natural language so that people can ask questions about the effects of DNA changes on gene activity and health and get conversational answers in return.

Hugging Face 的高级研究科学家刘易斯·坦斯托尔(Lewis Tunstall)表示,这一工具旨在帮助研究人员设计新的药物和基因疗法,同时也能帮助患者更好地理解自己的基因组信息。

Lewis Tunstall, a senior research scientist at Hugging Face, says the tool is meant to help researchers design new drugs and genetic therapies, and it could potentially aid patients in interpreting their own genomes.

“我们在语言模型领域实现了新的突破——这种模型能够‘与 DNA 进行对话’,”他这样描述这个被命名为 Carbon-X 的新模型。由于使用了自然语言处理技术,即使是非技术领域的用户也能提出关于 DNA 的问题,而这些问题是其他工具无法实现的。Hugging Face 被誉为人工智能模型的“GitHub”平台,它为开发者、研究人员和企业提供了大量的现成 AI 工具,以及一个用于运行开源 AI 应用的平台,让那些希望尝试 AI 技术的人无需从头开始构建一切。

“We've unlocked a new capability in language models, which is fundamentally about being able to chat with DNA,” he says of the new model, dubbed Carbon-X. Using natural language means even nontechnical users “can actually ask questions about DNA that wouldn't be accessible through any other tool.”Known as essentially GitHub for AI models, Hugging Face provides a library of readymade AI tools and a platform for running primarily open-weight and open-source AI applications for developers, researchers, businesses, and people who want to experiment with AI without building everything from scratch.

今年 9 月,Nvidia 以近 130 亿美元的价格收购了 Hugging Face。(今年早些时候,Hugging Face 的模型还曾成为 OpenAI 发起的一次重大网络攻击的受害者。)DNA 实际上更类似于计算机代码:它使用“A”、“C”、“G”和“T”等字母来编码信息,而非传统的 0 和 1。人类基因组包含约 60 亿个这样的碱基对。尽管人类基因组已经被完全测序,但科学家们仍不清楚其大部分功能的运作机制。

In September, Nvidia agreed to acquire the company for nearly $13 billion. (Hugging Face was also at the center of a major hack by OpenAI’s models earlier this year.) DNA is more like computer code than natural language. Instead of 0s and 1s, though, it uses As, Cs, Gs, and Ts to encode information. A human genome contains 6 billion of these letters. While the human genome has been sequenced end to end, scientists still don’t understand how most of it works.

如今,人工智能模型正在帮助研究人员破解其中一些谜团。去年,谷歌DeepMind发布了AlphaGenome,它能够预测DNA序列和基因突变的影响,但以数字格式呈现,并且需要更多算力。由Arc研究所和英伟达以及学术伙伴共同开发的模型Evo 2则通晓DNA语言,能够从零开始生成完整的基因组。

Now, AI models are helping researchers decipher some of those mysteries. Last year, Google DeepMind released AlphaGenome, which predicts the effects of DNA sequences and genetic mutations but does so in a numeric format. It also requires more compute power. Evo 2, a model developed by the Arc Institute and Nvidia, along with academic partners, speaks the language of DNA and can generate entire genomes from scratch.

Carbon-X在对话式界面中同时整合了DNA和自然语言。可以把它想象成DNA版的ChatGPT。

Carbon-X integrates both DNA and natural language in a conversational interface. Think of it like a ChatGPT for DNA.

团队从现有的语言模型入手,扩展其词表,使其能够以六个字母为一组读取DNA。随后,他们继续用3000亿个数据块(或称token)进行训练,这些数据结合了DNA序列、英文文本以及将DNA与生物学描述联系起来的示例。DNA序列来自哺乳动物(包括人类)、其他脊椎动物、无脊椎动物、植物、真菌和原生动物。坦斯托尔表示,团队没有用病毒来训练该模型,因为他们不希望它被用于潜在危险的应用。

The team started with an existing language model and expanded its vocabulary to read DNA in groups of six letters. They then continued training on 300 billion chunks of data, or tokens, that combined DNA sequences, English text, and examples linking DNA to biological descriptions. The DNA sequences came from mammals (including humans), other vertebrates, invertebrates, plants, fungi, and protozoa. Tunstall says the team didn’t train the model on viruses because they didn’t want it to be used for potentially dangerous applications.

用户将无法上传完整的人类基因组。该模型的训练目标是能够接收大约5万个碱基对的DNA序列,因此用户一次只能查询基因组的一小部分。

Users won’t be able to upload full human genomes. The model was trained to be able to ingest DNA sequences of roughly 50,000 base pairs, so users will only be able to query small parts of the genome at a time.

科学家使用Carbon-X的方式之一,是帮助判断某个基因突变是良性的还是致病的,这是开发靶向药物或基因疗法的关键一步。如果干预措施针对了错误的突变,可能完全无效,甚至更糟,造成意外伤害。

One of the ways scientists could use Carbon-X is to help understand whether a genetic mutation is benign or disease-causing, a key step in developing a targeted drug or genetic therapy. If an intervention targets the wrong mutation, it could be totally ineffective or, worse, cause unintended harm.

研究人员在将可识别或敏感的患者数据上传到前沿人工智能模型时面临限制,因此坦斯托尔表示,他的团队有意设计了一个140亿参数的小型模型。这将使其能够在用户的本地硬件上运行,而不必依赖云端模型。他说,不会有任何数据发送给Hugging Face或任何其他公司。

Researchers face restrictions when it comes to uploading identifiable or sensitive patient data to frontier AI models, so Tunstall says his team intentionally designed a small model with 14 billion parameters. That will allow it to run locally on the user’s hardware, rather than rely on cloud-based models. No data is sent to Hugging Face or any other company, he says.

Carbon-X的开发者提醒称,他们尚未通过实际的实验室实验来验证该模型的准确性,因此无法确定其预测结果的可靠性。

The developers of Carbon-X caution that they haven’t validated the model yet with actual wet lab experiments, so they can’t say how accurate its predictions are.

阅读媒体原文 ↗