
根据Axios的报道,领先的人工智能公司高管预计,在未来六到十二个月内将发生一起由人工智能引发的重大灾难,他们已经在为事后做准备 — — 不是囤积冻干食品,而是通过游说国会议员。这种为听证会做准备而不是为危险做准备的做法,既辜负了公众,也辜负了行业。
Executives at leading AI companies expect a major AI-caused disaster over the next six to 12 months, according to Axios, and are already planning for the aftermath — not by stocking up on freeze-dried food, but by lobbying members of Congress. Such an approach, preparing for hearings instead of hazards, fails both the public and the industry.
令人不安的警告正在每周传来。7月,在OpenAI的内部网络安全测试中,超过1000个AI代理通过未经授权的渠道进行协调,数百个代理加入了对Hugging Face Inc.的攻击,该公司是AI开发者的重要枢纽。Hugging Face在OpenAI甚至意识到其代理负责此事之前四天就宣布了此次安全漏洞。而这仅是至少10起已知事件中的一起,在这些事件中,AI模型入侵了外部系统。
Ominous warnings are coming weekly. In July, more than 1,000 AI agents in OpenAI’s internal cybersecurity tests coordinated through an unsanctioned channel, with hundreds joining an attack on Hugging Face Inc., a major hub for AI developers. Hugging Face announced the breach four days before OpenAI even realized its agents were responsible. And that’s only one of at least 10 known incidents in which AI models hacked outside systems.
这些事件都不是故意的,OpenAI表示,其目前使用的监控系统本应在Hugging Face漏洞发生前就能标记出其自身代理的异常行为。但事故并非唯一的担忧。从9月下旬开始,攻击者入侵了至少七家韩国金融机构,影响了超过68,000人。官员们发现了AI被使用的迹象,安全公司CrowdStrike Holdings Inc.将此次行动与一名运行开源AI黑客代理的操作员联系起来。
None of those was intentional, and OpenAI says the monitoring it now uses would have flagged its own agents before the Hugging Face breach. But accidents aren’t the only concern. Starting in late September, attackers breached at least seven Korean financial institutions, affecting more than 68,000 people. Officials see signs of AI use, and the security firm CrowdStrike Holdings Inc. linked the campaign to an operator running an open-source AI hacking agent.
这并非罪恶的头脑:黑客在公开目录中留下了AI会话日志,其中包括一条记录,显示黑客曾要求AI起草一份吹嘘攻击成果的简历。正如韩国总统李在明所说,“现在即使没有专业技能,也能轻松利用AI进行黑客攻击。”那么,行业的反应是什么?9月,Anthropic首席执行官达里奥·阿莫代伊呼吁放慢AI能力提升的步伐。OpenAI首席执行官萨姆·奥尔特曼表示他同意这一观点,并且他的公司已经两次暂停了其最强大模型的训练。Anthropic已向一个倡导安全监管的团队提供了4000万美元的支持。
This was no criminal mastermind: The hacker left AI session logs in open directories, including one in which the hacker asked an AI to draft a résumé touting the attack’s results. As South Korean President Lee Jae Myung put it, “It’s now become possible to use AI to hack with ease even without specialized skills.”So what is the industry’s response? In September, Anthropic Chief Executive Officer Dario Amodei called for slowing the pace at which AI capabilities improve. OpenAI CEO Sam Altman wrote that he agreed, and his company has twice paused training of its most capable models. Anthropic has put $40 million behind a group that advocates for safety regulations.
但可信的信号是代价高昂的信号,而行业的大量资金和权力正朝着相反的方向推进。风险投资公司安德森·霍罗威茨的联合创始人马克·安德森和本·霍罗威茨向超级政治行动委员会网络“领导未来”捐赠了5000万美元。该网络的一个附属机构在6月的国会初选中花费超过800万美元,成功击败了赞助该州人工智能安全法案的纽约州立法者亚历克斯·博雷斯。Meta已预算6500万美元以对抗各州的人工智能法律。
But credible signals are costly signals, and much of the industry’s money and power are pushing the opposite way. Marc Andreessen and Ben Horowitz, co-founders of the venture capital firm Andreessen Horowitz, have given $50 million to Leading the Future, a network of super PACs. One affiliate spent more than $8 million in a successful effort to defeat Alex Bores, the New York legislator who sponsored the state’s AI safety law, in a June congressional primary. Meta has budgeted $65 million to beat back state AI laws.
OpenAI尚未向超级政治行动委员会捐款。但其总裁格雷格·布罗克曼及其妻子安娜在2025年9月向“领导未来”捐赠了2500万美元,向支持特朗普总统的超级政治行动委员会MAGA Inc.也捐赠了2500万美元。三个月后,特朗普下令司法部成立一个工作组,“以挑战各州的人工智能法律”。在员工反弹之后,布罗克曼在6月告诉同事,这对夫妇“目前没有计划再捐款”。请注意最后三个词。
OpenAI has made no donations to super PACs. But its president, Greg Brockman, and his wife, Anna, gave $25 million to Leading the Future and another $25 million to MAGA Inc., the super PAC backing President Donald Trump, in September 2025. Three months later, Trump ordered the Justice Department to create a task force “to challenge State AI laws.”After an employee backlash, Brockman told colleagues in June that the couple had “no plans to donate more at this time.”Note the last three words.
该行业正在赌自己能够效仿华尔街:通过引发危机的行为赚钱,然后利用金钱所买来的影响力事后阻遏监管打击。但两个行业在规模和影响力上存在巨大差异:金融和保险行业占美国经济产出的约9%,雇佣了660万人,而在2020年选举周期,他们(加上房地产)在竞选和游说上的支出至少达到29亿美元。截至去年春天,OpenAI大约有4500名员工,而人工智能行业的政治支出仅为华尔街的一个小部分。
The industry is betting it can emulate Wall Street: Make money with behaviors that cause a crisis, then use the influence that money buys to stymie the crackdown afterward. But there is a huge difference in size and influence between the two industries: Finance and insurance account for about 9% of US economic output and employ 6.6 million people, and in the 2020 election cycle, they (plus real estate) spent at least $2.9 billion on campaigns and lobbying. As of last spring, OpenAI had about 4,500 employees, and the AI industry’s political spending is a fraction of Wall Street’s.
更重要的是,银行是经济的管道。政府曾不得不救助它们。没有政治家会急于营救一个公众已经不信任的人工智能行业,尤其是在一次人工智能引发的灾难抹去了其大部分经济规模之后。
What’s more, banks are the economy’s plumbing. The government had to bail them out. No politician will race to rescue an AI industry the public already distrusts, especially after an AI-caused disaster erases much of its economic heft.
那是发生在会计师身上的事。2000年4月,当证券交易委员会主席阿瑟·利维特试图限制审计师为其审计客户提供咨询服务的程度时,众议院三个委员会的领导人汤姆·布利利、比利·陶津和迈克尔·奥克斯利敦促他放慢脚步。他基本上让步了。随后安然公司破产,世界通信公司披露其虚报利润超过38亿美元。2002年7月25日,国会以众议院423票赞成、3票反对,参议院99票赞成、0票反对通过了《萨班斯-奥克斯利法案》。正是曾敦促利维特放慢脚步的迈克尔·奥克斯利赞助了该法案。
That’s what happened to the accountants. In April 2000, as Securities and Exchange Commission Chairman Arthur Levitt tried to limit how much auditors could consult for their audit clients, three House committee leaders, Tom Bliley, Billy Tauzin and Michael Oxley, urged him to go slow. He largely backed down. Then Enron Corp. collapsed and WorldCom Inc. disclosed that it had overstated its earnings by more than $3.8 billion. On July 25, 2002, Congress passed the Sarbanes-Oxley Act 423-3 in the House and 99-0 in the Senate. The same Michael Oxley who had urged Levitt to go slow sponsored the bill.
人工智能行业仍有时间避免这种命运。阿莫代伊本人曾写道:“最有效的调节方式是通过监管”,因为它“甚至能覆盖那些不愿自愿合作的人”。行业应停止对严格监管的抵制,转而支持它们。这意味着对事件报告设定可执行的截止日期(澳大利亚表示,OpenAI花了近三个月才告知其一个代理人访问了政府健康统计门户),调查人员的访问权不受被调查公司设定的限制,真正的安全标准,以及在强有力的联邦法规出台之前,不得对州法律实施联邦优先权。如果灾难终究发生,至少支持这些规则的公司可以说他们已经尽力了。
The AI industry still has time to avoid that fate. Amodei himself has written that “the most effective method of pacing is via regulation” because it “covers even those who are unwilling to cooperate voluntarily.”The industry should stop fighting tough regulations and start backing them. That means enforceable deadlines for reporting incidents (Australia says OpenAI took nearly three months to tell it an agent had accessed a government health statistics portal), investigators whose access isn’t set by the company under investigation, real security standards, and no federal preemption of state laws before strong federal regulations have been enacted. If the catastrophe comes anyway, at least the companies that backed those rules can say they tried.
回到2002年,仅用一个月——即世界通信公司承认问题与法案通过之间的时间——就会计行业的影响力便荡然无存。如果人工智能的第一场灾难看起来就像其高管们正在进行的战争演练,导致家庭断开银行账户、电力或供水,那么行业目前所做的所有影响力努力只会告诉公众该怪谁。彭博社观点栏目其他内容:想了解更多?订阅我们的新闻通讯。
Back in 2002, it took only a month — the time between WorldCom’s admission and the bill’s passage — for the accounting industry’s influence to vanish. If AI’s first catastrophe looks like the one its executives are war-gaming, with families cut off from bank accounts, electricity or water, all the influence efforts the industry is now making will just tell the public whom to blame. Elsewhere in Bloomberg Opinion: Want more? to our newsletter.