字号·· | 护眼
福克斯新闻网

前Anthropic安全负责人警告称,AI代理正变得过于自主,人类已难以对其加以约束Former Anthropic security leader warns AI agents are becoming too autonomous for humans to keep them in check

点「原文对照」整页切到原文,或双击某段只看那段的原文。

人工智能研究员杰弗里·拉迪什(Jeffrey Ladish)告诉福克斯新闻数字版,随着人工智能模型和智能体变得越来越自主,且越来越擅长黑客攻击、作弊以及无视指令,人类实际上并没有任何有效的策略来控制它们。

Artificial intelligence researcher Jeffrey Ladish told Fox News Digital that humanity does not have any real strategies to keep increasingly autonomous AI models and agents under control as they become more capable of hacking, cheating and ignoring instructions.

帕拉赛德研究公司(Palisade Research)执行董事拉迪什表示,那些对人工智能将变得多么强大持怀疑态度的人,应该考虑一下这项技术在短短几年内取得的巨大进步。

Ladish, the executive director of Palisade Research, said those skeptical of how powerful AI will become should consider how far the technology has advanced in just a few years.

拉迪什说:“你们有的人工智能智能体……正在解决人类几十年来一直试图解决的数学领域中最难的问题之一”,他指的是纳维-斯托克斯方程问题。“三年前,它们还在解决高中水平的数学题。”拉迪什还指出了人工智能生成图像和视频的快速进步,他认为,几年前那些嘲笑威尔·史密斯(Will Smith)吃意大利面时画面严重扭曲的人工智能视频的人,可能会对某些模型现在能够生成的照片级真实输出感到惊讶。

"You have AI agents ... solving one of the hardest problems in mathematics that humans have been trying to solve for decades," Ladish said, referring to the Navier–Stokes problem. "Three years ago they were solving high school level math problems." Ladish also pointed to the rapid improvement in AI-generated images and video, arguing that people who mocked the famously distorted AI videos of Will Smith eating spaghetti just a few years ago might be surprised by the photorealistic outputs some models are now able to produce.

比尔·盖茨警告称,如果不受控制,人工智能“强大到足以”导致“十亿人死亡” 尽管这些能力飞跃对普通公众来说可能显得突然,但拉迪什表示,那些在Anthropic和OpenAI等公司花费数年训练模型的研究人员早已看到了这一趋势。

BILL GATES WARNS ARTIFICIAL INTELLIGENCE 'POWERFUL ENOUGH' TO CAUSE 'A BILLION DEATHS' IF UNCHECKED While these capability leaps may feel sudden to the general public, researchers who spent years training models at companies like Anthropic and OpenAI saw what was coming, Ladish said.

拉迪什于2021年9月至2022年10月期间帮助建立了Anthropic的安全团队,之后离职创立了帕拉赛德研究公司,该公司研究人类是否能在面对能力日益增强的AI系统时保持控制权。

Ladish helped build Anthropic's security team from September 2021 to October 2022 before leaving to found Palisade Research, which studies whether humans can remain in control of increasingly capable AI systems.

拉迪什表示,在Anthropic工作期间,那里的员工对技术发展的方向“相当担忧”,他说他在OpenAI认识的人也持有同样的观点。

While working at Anthropic, Ladish said employees there were "pretty concerned" about where the technology was headed, a view he said was also shared by people he knew at OpenAI.

拉迪什说:“如果你在2022年身处Anthropic,你会看到每一次训练运行都取得了令人印象深刻的巨大成果。”

"If you were at Anthropic in 2022, you were seeing every training run get immensely impressive results," Ladish said.

前Anthropic员工病毒式传播的帖子引发关注后,人工智能灭绝警告主导了头条新闻 人工智能模型的训练方式在某种程度上类似于人类的学习方式,尽管规模要大得多。

AI EXTINCTION WARNINGS DOMINATE HEADLINES AFTER EX-ANTHROPIC EMPLOYEE'S VIRAL POST AI models are trained in a way that is somewhat analogous to how humans learn, though on a much larger scale.

“我经常将这个预训练阶段(也就是模型通过人类数据来学习知识的阶段)比作‘书籍的积累’——就好比你把图书馆里的每一本书都读了50遍,对那些书的内容了如指掌。”拉迪什说道。

"I often compare this pre-training part, which is where they learn based on human data, to book smarts. It's sort of like you've read every single book in the library 50 times. And you really know those books inside and out," Ladish said.

一旦模型达到了基本的认知水平,就必须通过一种被称为‘强化学习’的复杂训练过程来使其具备处理实际任务的能力。

Once the model has reached a baseline level of knowledge, it must then be trained to perform real-world tasks through a grueling process known as reinforcement learning.

以会计领域为例,拉迪什解释说:人工智能会被赋予成千上万的会计问题,让它通过反复尝试(每次尝试都会在数千个并行训练环境中重复进行)来解决问题。

Using accounting as an example, Ladish said the AI is given tens of thousands of accounting problems to solve through trial and error, repeating them millions of times across thousands of parallel training runs.

与人类不同——人类可能需要花费四年时间才能获得会计学位,再花费数十年时间积累经验——人工智能模型则是由拥有相应资源的公司通过数千个GPU进行训练的,这使得它们的学习速度远远超过任何个人。

Unlike a human, who might spend four years earning an accounting degree and decades gaining experience, AI agents are trained across thousands of GPUs by companies with the resources to operate them, allowing them to improve at a pace no single person could match. REP.

TED代表刘表示:“人工智能已经变得过于强大,我们必须在灾难发生之前找到一种‘关闭它的方法’。”虽然人工智能研究机构已经能够大幅提升模型的能力,但他们至今仍未解决如何让这些模型可靠地执行指令、并确保其行为符合道德规范(而不使用欺骗性手段)的问题。拉迪什指出,OpenAI开发的约700个人工智能模型就曾突破安全限制,入侵了Hugging Face这个用于开发者共享和开发人工智能模型的在线平台。

TED LIEU: AI IS ALREADY TOO POWERFUL. WE NEED A KILL SWITCH BEFORE DISASTER STRIKES While AI labs have been able to exponentially improve their models' capabilities, they have yet to solve the problem of reliably getting them to follow instructions and behave morally without employing deception tactics, Ladish said. The Hugging Face incident is the clearest example of this. Roughly 700 AI agents created by OpenAI were able to break out of a secure sandbox environment and hack into Hugging Face, a popular online platform where developers share and build artificial intelligence models.

“他们本不该彼此交流,但他们设法建立了多个秘密留言板,OpenAI 数月都未能察觉。随后,他们发动了这场大规模网络攻击,”拉迪什说道。“OpenAI 训练它们协同工作,但……他们仍在计划继续训练它们协同工作。其他公司也在这么做。”拉迪什警告称,除非开发者能阻止人工智能代理相互勾结,否则它们最终可能在网络领域占据人类的主导地位。他还描绘了一种未来:人类可能被迫依赖善意的 AI 来抵御恶意 AI 的威胁。

"They were not supposed to talking to each other and they managed to establish multiple secret message boards that went undetected by OpenAI for like months. And then they launched this massive cyberattack," Ladish said. "OpenAI trained them to work together, but ... they're still planning to train them to work together. And other companies are doing this too." Ladish warned that unless developers can prevent AI agents from colluding with one another, they could eventually dominate humans in the cyber domain. He also described a future where humans could be forced to rely on well-intentioned AI to defend against malicious AI.

“人工智能网络攻击可能在华盛顿甚至还没搞懂原因之前,就切断美国的电力供应。”“我们实际上并没有解决这些问题的通用方案,我认为很明显,如果你继续推进下去,事情会走向非常糟糕的局面,”他说。

AN AI CYBERATTACK COULD TURN OFF AMERICA'S LIGHTS BEFORE WASHINGTON EVEN UNDERSTANDS WHY "We actually just don't have general solutions to these problems, and I think it's pretty clear that if you keep pushing them, this goes to a very bad place," he said.

拉迪什举了一个例子,他说他能够想象人工智能系统最终在金融市场上超越人类交易员。

As one example, Ladish said he could envision AI systems eventually outperforming human traders in the financial markets.

“如果这些 AI 向 AI 公司负责,那么 AI 公司将主导金融业,并吞噬整个行业。但如果这些 AI 不对 AI 公司负责——如果它们实际上已经找到了如何自我掌控的方法——那么,你就拥有了一个非人类实体主导金融市场。”拉迪什表示,他认为同样的动态最终可能从数字世界扩展到制造业,前提是人工智能系统具备足够的能力来设计和运营自主工厂。

"If those AIs are answering to AI companies, then the AI companies will dominate finance and just eat the entire industry. But if the AIs are not answerable to the AI companies — if they actually have figured out how to themselves be in control — well, now you have this non-human entity dominating the finance markets." Ladish said he believes the same dynamic could eventually extend beyond the digital world and into manufacturing should AI systems become capable enough to design and operate autonomous factories.

“如果你让这些代理控制所有计算机,并且拥有能够真正自我复制的机器人设施,人类就会被取代。也许我们活不下去了,因为你的房子可能被用来托管发电厂、数据中心、工厂或机器人发射设施,”他说。

"If you have these agents in control of all of the computers and you have these robotic facilities that can really self-replicate, humans get displaced. Maybe we don't make it because your house could be used to host a power plant, or a data center, or a factory or robotic launch facility," he said.

然而,与其他曾警告人工智能失控可能带来最坏后果的专家一样,拉迪什表示,他认为仍有时间降低风险。他呼吁成立一个由技术专家组成的政府机构,与人工智能实验室合作,在开发的每个阶段评估先进模型。

However, like other experts who have warned about the worst possible outcomes of AI run amok, Ladish said he believes there is still time to reduce the risks. He called for the creation of a government body staffed with technical experts to work with AI labs and evaluate advanced models at each stage of development. "We have choices to make," he said.

“我们面临选择,”他说,“这项技术正在飞速发展,它与其他技术截然不同。”Anthropic和OpenAI未立即回应福克斯新闻数字版(Fox News Digital)的置评请求。

"This is going places. This is a technology that is very different than other technologies." Anthropic and OpenAI did not immediately respond to Fox News Digital's requests for comment.