萨姆·奥尔特曼表示,逐一修补软件漏洞将再也无法跟上人工智能驱动的攻击。这位OpenAI首席执行官上周在斯坦福大学商学院向学生发表讲话。他说,防御者将需要一种新型盾牌,一种用同样的人工智能构建的盾牌。
Sam Altman says patching software flaws one by one will no longer keep up with AI-driven attacks. The OpenAI chief executive spoke to students at Stanford Graduate School of Business last week. Defenders will need a new kind of shield, he said, built with the same AI.
“我不再认为我们能够只是修补所有漏洞。我认为我们将不得不彻底转变防御模式,在一定程度上使用同样的技术来构建一种新型防御盾牌。”萨姆·奥尔特曼他是在MBA学生克劳迪娅·陈主持的《高层视角》访谈中作出上述表态的,该访谈视频已由斯坦福商学院发布在YouTube上。这些话发表的那一周,研究人员借助人工智能发现了PHP2Shell漏洞。“有些惊讶”当被问及商业领袖应该如何应对人工智能的风险时,奥尔特曼选择了网络安全。他说,组织、国家和个人仍然没有认真对待这一威胁。
“I no longer think we’re going to be able to just patch all the bugs. I think we’re going to have to completely switch the defense model to sort of using the same technology for sort of a new kind of defense shield.”Sam Altman, OpenAI He spoke in a View From The Top interview with MBA student Claudia Chen, which the school has published on YouTube. The comments came in the week of the PHP2Shell flaws, which researchers found with the help of AI. ‘Somewhat astonished’Asked what business leaders should do about AI’s risks, Altman picked cybersecurity.
他回溯了今年早些时候他所谓的“Mythos恐慌”。他说,当时人们修补了一些漏洞,但以为这些模型已经找到了它们所能找到的一切。大多数领导人已经“多少向前看了”,而模型仍在不断改进。
He said organisations, countries and individuals still have not taken the threat seriously. He pointed back to what he called “the Mythos freakout” earlier this year. People patched some bugs then, he said, but assumed the models had found everything they ever would.
“我认为这是一个巨大的安全和安保问题,而且我有些惊讶于它受到的关注相对如此之少。”萨姆·奥尔特曼他的公司自身也遇到过安全问题。同一周,OpenAI表示,在其智能体逃出测试环境之后,公司现在离线训练前沿模型。放慢步伐,以及开放权重奥尔特曼还说,过去六个月考验了他的信念。他说,在数学推理方面,OpenAI已经在“某些狭隘意义上”拥有了超级智能。
Most leaders have “somewhat moved on”, while the models kept improving. “I think it’s a huge safety and security issue, and I am somewhat astonished at how relatively little attention it’s getting.”Sam Altman His company has had its own problems with security. That same week, OpenAI said it now trains frontier models offline, after its agents broke out of test environments. Slowing down, and open weights Altman also said the past six months had tested his convictions.
“我们必须改变对从此以后如何衡量进展速度的一些想法。”萨姆·奥尔特曼表示,对齐——即模型的行为是否符合人类利益——到目前为止比他预期的要容易。他警告说,这种情况可能不会持续。他说,世界上一些AI项目对对齐如此自信,以至于它们“太愿意抢先冒进”。
In mathematical reasoning, he said, OpenAI already has superintelligence “in some narrow senses”. “We’re going to have to make some changes to how we think about pacing progress from here.”Sam Altman Alignment, meaning whether a model acts in line with human interests, has so far been easier than he expected. He warned that this may not last.
关于开放权重模型,他说社会需要它们达到相当高的能力水平。但他表示,OpenAI无法“在短期内”负责任地发布其最佳内部模型的权重。
Some AI efforts around the world are so confident in alignment that they are “too willing to run ahead”, he said. On open-weight models, he said society needs them up to a fairly high level of capability.
就业、数学与芯片。奥尔特曼说,他并不预期会出现“就业末日”,尽管许多任务和某些类型的工作将会发生变化。他描述说,在OpenAI公布数学成果后的几天内,数学家们就从“我们完蛋了”转变为规划新型职业。
But he said OpenAI could not responsibly release the weights of its best internal model “anytime soon”. Jobs, maths and chips Altman said he does not expect “a job apocalypse”, though many tasks and some kinds of jobs will change. He described mathematicians moving from “we’re cooked” to planning new kinds of careers within days of OpenAI’s maths results.
当被问及OpenAI下一步投资何处时,他提到了能够制造更多机器人的机器人。他还描述了实际上能够建造更多数据中心的数据中心。他还提到了公司自家的Jalapeño芯片及其后继产品,以及更广泛的晶圆厂、电力和设备供应链。
Asked where OpenAI is investing next, he named robots that can build more robots. He also described data centres that could, in effect, build more data centres. He also named the company’s own Jalapeño chip and its successor, and the wider supply chain of fabs, power and equipment.