
8月,OpenAI召集了大约40名数学家,讨论如果人工智能在该领域的能力超过了人类该怎么办。与会人士表示,该公司暗示其强大的模型已经解决了数百个长期存在的数学问题,但公司代表向与会者保证,它不会一次性发布所有解决方案--OpenAI发言人林赛·麦卡勒姆(Lindsay McCallum)表示,该公司“不知道”--并且,担心社区可能会如何反应,寻求有关如何发布调查结果的建议。
In August, OpenAI convened around 40 mathematicians to discuss what to do if AI outpaces human capabilities in the field. The company hinted that its powerful models had solved hundreds of longstanding math problems, say people who were in attendance, but company representatives assured attendees it would not release the solutions all at once—an assurance OpenAI spokesperson Lindsay McCallum says the company is “not aware of”—and, worried by how the community might react, sought advice on how to publish the findings.
西北大学数学家布莱娜·克拉回忆道,与会者的反应是“既兴奋又恐惧”,但这次会议是充满希望的第一步。她告诉《连线》,该组织要求该公司不要像本月早些时候处理10个问题那样,只是在博客或推文中发布这些问题。克拉表示,相反,OpenAI发表解释这项工作的论文非常重要,以便数学家能够吸收、消化和使用结果。“显然,这些输入被忽视了,”她说。
Attendees responded with “a mixture of excitement and dread,” but the meeting was a promising first step, recalls Northwestern University mathematician Bryna Kra. The group, she tells WIRED, asked the firm not to just publish them in a blog or tweet, like they had done with 10 problems earlier that month. Instead, it would be important for OpenAI to publish papers explaining the work so that mathematicians could absorb, digest, and use the results, according to Kra. “Apparently, that input was ignored,” she says.
知情人士告诉《连线》杂志,OpenAI已告诉人们,它计划周二在GitHub上丢弃其在8月份会议上引用的数百个结果。随着前沿模型变得越来越强大,该版本将是人工智能今年生成的数万个数学解决方案中的最新一个。
OpenAI has told people it plans to dump hundreds of the results it referenced in the August meeting on GitHub on Tuesday, people familiar with the plans tell WIRED. The release would be the latest of tens of thousands of mathematical solutions generated by AI this year, as frontier models become increasingly capable.
“8月28日,我们开始训练新的内部模型。除了解决纳维尔-斯托克斯千年奖问题外,这个模型现在还解决了大多数数学领域的100多个长期存在的悬而未决的问题,”麦卡勒姆说。“我们正在努力负责任地发布我们模型中的下一个数学结果,并借鉴高等研究所数学和人工智能咨询小组的建议和公众建议,为我们如何发布这些结果提供信息。我们还没有确定发布时间。”但对于几位领先的数学家来说,即将推出的产出也表明该公司从之前版本的争议中吸取了很少的教训。
“On August 28, we began training a new internal model. In addition to resolving the Navier—Stokes Millennium Prize problem, this model has now resolved more than 100 long-standing open problems across most areas of mathematics,” says McCallum. “We are working to responsibly release the next math results from our model, drawing on advice and public recommendations from the Advisory Group on Mathematics and Artificial Intelligence at the Institute for Advanced Study to inform how we release these results. We have not set a release time.”But for several leading mathematicians, the impending output is also a sign that the company has learned little from the controversies over previous releases.
在与WIRED的对话中,学者们表示,他们认为该领域已成为OpenAI及其竞争对手Anthropic展示其模型的游乐场,因为两者都在为重磅炸弹的首次公开募股做准备。数学家们表示,在急于超越对方的过程中,传统的发布和归因结果的科学过程被抛弃了。
In conversations with WIRED, the academics say they feel the field has become a playground for OpenAI and its rival Anthropic to show off their models as both prepare for blockbuster initial public offerings. In their rush to outdo each other, mathematicians say, traditional scientific processes for releasing and attributing results have been cast aside.
迄今为止最引人注目的病例发生在9月份。在听到其他人正在接近解决方案的“谣言”后,OpenAI部署了数千名代理来解决一个传奇的百万美元千禧奖问题。纽约大学数学家兼教授特里斯坦·巴克马斯特(Tristan Bucmaster)指责该公司在与Anthropic员工莱文斯特·阿尔波格(Levent Alpöge)的个人合作中抢先完成了他为解决问题的一个要素所做的工作。两人没有发表他们的工作,但一直在使用OpenAI的工具来帮助他们。
The most striking case so far came in September. OpenAI deployed thousands of agents to solve a legendary million-dollar Millennium Prize problem after hearing “rumors” that others were closing in on solutions. Tristan Buckmaster, a mathematician and professor at New York University, accused the company of front-running the work he had done toward solving an element of the problem in a personal collaboration with Anthropic employee Levent Alpöge. The pair hadn’t published their work, but had been using OpenAI’s tools to help them.
巴克马斯特声称,在尝试就信用进行谈判时,OpenAI研究员塞巴斯蒂安·布贝克似乎暗示阿尔波格应该被排除在任何论文之外,因为这会让事情变得复杂。(In在回应置评请求时,布贝克指出了之前的一份公开声明,其中他否认要求阿尔波格不被列为作家。)巴克马斯特说他拒绝了。根据《连线》看到的会议记录,布贝克在一次电话会议中声称,人们对Anthropic的所作所为有些担忧。
During an attempt to negotiate credit, Buckmaster claims, OpenAI researcher Sébastien Bubeck seemed to imply that Alpöge should be excluded from any paper, since that would make things complicated. (In response to a request for comment, Bubeck pointed to a previous public statement in which he denied asking for Alpöge to not be listed as an author.) Buckmaster said he refused. In a call, Bubeck claimed that there is some worry about what Anthropic is doing, according to meeting notes seen by WIRED.
根据笔记,莱文特现在一定正在与他的领导层交谈,让他们知道他妈的OpenAI可能会出现千禧奖问题。是什么可以阻止Anthropic为获得千年奖问题而投入所有计算?
Levent must be talking to his leadership right now letting them know fucking OpenAI can get a Millennium Prize problem, he said, per the notes. What’s to stop Anthropic from giving all their compute to get a Millennium Prize problem?
根据笔记,当巴克马斯特威胁要告诉媒体他相信OpenAI窃取了他的作品时,布贝克似乎还暗示巴克马斯特会毁掉他的职业生涯。根据会议记录,布贝克说,如果你不希望我表现得很好,那我就不必表现得很好。
According to the notes, Bubeck also seemed to suggest that Buckmaster would be ruining his career when Buckmaster threatened to tell the press about his belief that OpenAI had stolen his work. If you don't want me to be nice, then I don't have to be nice, Bubeck said, according to the meeting notes.
纽约大学客座数学教授内斯特·吉伦告诉《连线》,数学家中“有一种来自人工智能公司的暴徒行为的看法”。“我们不同意这种描述,”麦卡勒姆说。
Nestor Guillen, a visiting math professor at NYU, tells WIRED that “there's a perception of mobster behavior” from the AI companies among mathematicians. “We disagree with that characterization,” says McCallum.
吉伦说:“我感到非常焦虑,我在数学领域的同事身上越来越多地看到这种情况,不是人工智能,而是人工智能公司。”“我认为很多焦虑都与权力在一个地方的积累有关。”OpenAI在9月中旬组建了一个咨询小组,以帮助确定公司如何评估和传达新成果,维护学术和专业标准,并构建支持数学研究和学习的工具。但数学家们说,该公司似乎没有取得多大进展。
“I feel a lot of angst, and I see this more and more in my colleagues in mathematics, not over AI, but over the AI companies,” Guillen says. “I think a lot of the angst is about the accumulation of power in one place.”OpenAI assembled an advisory group in mid September to help determine how the company assesses and communicates new results, upholds academic and professional standards, and builds tools that support mathematical research and learning. But the company doesn’t seem to have made much progress, mathematicians say.
许多人对OpenAI和Anthropic继续通过博客文章而不是科学论文发布结果感到沮丧,这使得它们更难验证,并且经常排除其他数学家之前的工作。零碎的公告并不局限于实验室:阿尔波格本人在世界杯决赛后不久发布的一条推文中宣布,他已经反驳了一项87年前的猜测。
Many are frustrated that OpenAI and Anthropic continue to release results through blog posts, rather than scientific papers, which makes them harder to verify and often excludes prior work from other mathematicians. Piecemeal announcements aren’t limited to the labs: Alpöge himself announced he had disproved an 87-year-old conjecture through a tweet sent shortly after the World Cup final.
克拉说:“对我来说,通过推文进行数学和通过新闻稿进行数学并不是培育生态系统的方法,而生态系统创造了他们训练的沃土。”
“Math by tweet and math by press release to me is not the way to nurture the ecosystem that created the fertile ground that they have trained on,” says Kra.
一些人今年设置了新工具,以应对机器辅助证明的增加;其想法是帮助社区使用新结果并整理需要进一步消化的内容。这些工具包括Hexagon(一个主要由人工智能生成的材料的存储库)和Palomar(一个机器验证数学的注册库)。
Some have set up new tools this year in reaction to the increase in machine-assisted proofs; the idea is to help the community both use new results and sort through what needs to be further digested. The tools include Hexagon, a repository for primarily AI-generated material, and Palomar, a registry of machine-verified mathematics.
虽然OpenAI被直接鼓励使用这些工具,但“他们没有改变自己的行为,”克拉指出。她也不认为该公司的行动符合莱顿宣言,该宣言是4,000多名数学家呼吁人工智能公司达到她帮助撰写的数学家标准的。
While OpenAI has been directly encouraged to use these tools, “they haven't changed their behavior,” Kra notes. Nor does she feel the company’s actions are actions aligned with the Leiden declaration, a call by more than 4,000 mathematicians for AI companies to meet mathematicians’ standards that she helped write.
据与OpenAI交谈过的人士透露,OpenAI的几名员工认为,他们的技术无论如何已经让数学消亡。(“我们不相信数学的未来是确定的,”麦卡勒姆说。“我们正在与数学界合作,共同探索未来。虽然在8月份的会议上,人工智能能力超过人类研究人员的情况被认为是假设的,但与WIRED交谈的与会者将其解释为对未来的警告。该公司已经向数学家介绍了其能力和突破,就像“警察在报告车祸死亡之前可能想通知家人一样,”该人士指出。
Several employees within OpenAI believe their technology has rendered math dead anyway, according to people who have spoken with them. (“We don’t believe the future of mathematics is set,” says McCallum. “We’re working with the math community to navigate the future collaboratively.”) While the scenario where AI capabilities outpace those of human researchers was framed as hypothetical during the August meeting, attendees who spoke to WIRED interpreted it as a warning about what was to come. The company has briefed mathematicians about its capabilities and breakthroughs in the same way “police might want to notify family before reporting a death in a car accident,” the person noted.
据一位熟悉布贝克想法的人士透露,布贝克似乎相信他公司的技术将迅速结束大多数数学家的职业生涯。布贝克告诉《连线》,他相信更强大的人工智能可以帮助数学家解决更雄心勃勃的问题,更好地将他们的工作与解决现实世界的挑战联系起来,并使数学更容易理解。“我认为这是一个扩大数学家可以做的事情及其工作可以产生的影响的机会,”他说。
Bubeck appears to believe that his firm’s technology will swiftly end most mathematicians’ careers, according to a person familiar with his thinking. Bubeck tells WIRED he believes more capable AI could help mathematicians tackle more ambitious questions, better connect their work to solve real-world challenges, and make mathematics more accessible. “I see this as an opportunity to expand what mathematicians can do and the impact their work can have,” he says.
数学家知道他们需要适应,特别是为年轻一代提供装备,但不相信他们的领域已经消亡。“它改变了我们的运营方式,但我认为这是我们可以思考更大的时刻,”克拉说。她很高兴有一个新的、强大的工具可供她使用来解决问题--她只是希望公司的披露更好,这样她就可以信任并在结果的基础上再接再厉。
Mathematicians know they need to adapt, especially to equip younger generations, but do not believe that their field is dead. “It changes how we're going to operate, but I think it's a moment that we can think bigger,” says Kra. She’s happy to have a new powerful tool at her disposal to solve problems–she just wants companies’ disclosures to be better so that she can trust and build on the results.
“这是一个可怕的时刻,”她说,“但这也确实是一个非常令人兴奋的时刻。”
“It's a scary time,” she says, “but it's also really a deeply exciting time.”