
人工智能“熔断开关”在竞选路上是个容易推销的概念:一个简单的承诺,要求科技公司建立紧急关闭开关,以便在 AI 模型失控时切断电源。
An artificial intelligence “kill switch” is an easy sell on the campaign trail: a simple promise to require tech companies to build an emergency off switch that can power down AI models gone rogue.
但随着寻求连任的议员和 2028 年总统大选早期竞争者回应公众对 AI 日益增长的焦虑,批评者警告,这些提案更多是政治表演而非可行政策,在某些情况下可能面临重大技术挑战,且责任问题仍未解决。
But as lawmakers eyeing reelection and early 2028 presidential contenders respond to growing anxieties over AI, critics warn these proposals are more political theater than workable policy, which in some cases may face significant technical challenges and leave liability concerns unresolved.
据四位接近科技行业或代表科技行业游说的人士透露,这一想法——已出现在国会议案和州长行政命令中,甚至在卡戴珊家族热门真人秀最新一季中客串亮相——让政客们能安抚选民恐惧,而无需解决如何监管该技术的更棘手问题。
The idea — which has cropped up in Congress and in executive orders from governors, and even made a cameo in the latest season of the Kardashian family’s hit reality tv show — lets politicians assuage voters’ fears without resolving harder questions about how to regulate the technology, according to four people close to or lobbying on behalf of the tech industry.
“熔断开关是一个非常容易描述、容易理解的概念,”一位科技行业游说人士表示,他认为决策者在选举周期前夕“完全是在被动回应”选民关切。另一位代表科技界的游说人士将这些提案形容为“几乎是贴在保险杠上的标语法案”,主要因为它们没有应对开源模型日益壮大的生态系统。两人均获准匿名,以便坦率讨论科技行业的 AI 政策策略。
“The kill switch is a very easily described and easily understood concept,” said one tech industry lobbyist, who believes that policymakers are being “entirely reactive” to voters’ concerns on the eve of an election cycle. A second lobbyist who represents the tech sector characterized these proposals as “almost bumper sticker bills,” mainly because they don’t address the growing ecosystem of open-source models. Both were granted anonymity to candidly discuss the tech industry’s AI policy strategy.
随着公众对该技术的恐惧上升,近期举报人披露潜在生存威胁更加剧了这种担忧,要求公司在最强大的 AI 模型中安装紧急关闭系统的提案面临的采纳压力不断增大。
Pressure to adopt such proposals requiring companies to install emergency shutdown systems into the most powerful AI models has ratcheted up as public fears about the technology rise, exacerbated by recent whistleblower disclosures about potentially existential threats.
就在参议院为期中选举休会前几周,参议员约翰·肯尼迪(共和党-路易斯安那州)试图加速推进一项名为《人工智能紧急按钮法案》的法案,该法案将要求任何开发或运营先进人工智能系统的公司在其产品中内置“熔断开关”。尽管该措施被肯塔基州共和党参议员兰德·保罗阻挠,但众议员汤姆·基恩(共和党-新泽西州)后来提出了配套立法。
Just weeks before the upper chamber recessed for the midterm elections, Sen. John Kennedy (R-La.) sought to fast track a bill, dubbed the AI Emergency Button Act, that would require any company that develops or operates an advanced AI system to build a kill switch in their products. Though the measure was blocked by Republican Sen. Rand Paul of Kentucky, companion legislation was later introduced by Rep. Tom Kean (R-N.J.).
这位路易斯安那州共和党人的提案借力于众议员泰德·刘(民主党-加利福尼亚州)和纳撒尼尔·莫兰(共和党-得克萨斯州)于7月提出的一项法案,该法案将要求顶尖人工智能公司创建关闭、限流或暂停其强大系统的技术能力。它还将授权国土安全部命令这些公司关闭或减缓政府认定为过于危险的模型。
The Louisiana Republican’s proposal piggy-backed off of a bill introduced by Reps. Ted Lieu (D-Calif.) and Nathaniel Moran (R-Texas) in July that would require top AI firms to create the technical capacity to shut down, throttle or suspend their powerful systems. It also would empower the Department of Homeland Security to order these companies to shut or slow down models that the government deems too dangerous.
肯尼迪参议员办公室未回应《政治报》(POLITICO)的置评请求。
The office of Sen. Kennedy did not respond to POLITICO’s request for comment.
作为众议院民主党人工智能委员会联合主席、负责制定该党人工智能议程政策蓝图的刘云平拒绝了其提案旨在谋取政治利益的任何说法,并引用了直至7月揭晓前数月的筹备工作。
Lieu, a co-chair for the House Democratic Commission on AI that’s tasked with creating a policy blueprint for the party’s AI agenda, rejects any characterization that his proposal is for political gain, citing months worth of work leading up to its unveiling in July.
“该法案之所以受到关注,是因为人工智能公司今夏失去了对其模型的控制。如果那没有发生,我们现在就不会在讨论人工智能熔断开关了,”他在最近接受《政治报》采访时表示。
“The reason that this bill became popular is because AI companies lost control of their models this summer. If that hadn't happened, we wouldn't be talking about AI kill switches right now,” he told POLITICO in a recent interview.
“这一两党法案的设计初衷是监管力度轻,”莫兰在一份声明中说。“它只是指示国土安全部长考虑对小企业的负担、国家安全风险,以及模型的部署方式,包括其权重如何被获取。”这位议员还表示,其办公室正持续与构建人工智能模型的公司会面,并欢迎对该提案的反馈。此后,政客们(主要是民主党人)在竞选途中纷纷拥抱这一概念。
“This bipartisan bill carries a light touch by design,” Moran said in a statement. “It simply directs the DHS Secretary to consider the burden on small business, national security risk, and how a model is deployed including how its weights are made available.”The lawmaker also said his office is continuously meeting with companies building AI models and welcomes feedback on the proposal. Politicians, mostly Democratic, have since embraced the concept on the campaign trail.
纽约州州长、民主党人凯西·霍楚尔正在竞选连任,她承诺将仔细研究“熔断机制”,以此在该州具有里程碑意义的AI安全法基础上进一步完善。密歇根州参议员候选人阿卜杜勒·埃尔-赛义德也推出了一项广泛的议程,旨在通过为危险模型设置“熔断机制”来给AI发展“踩刹车”,他所在的这场胶着竞争可能决定国会的权力平衡。
Democratic Gov. Kathy Hochul of New York, who is running for reelection, pledged to look closely at kill switches as a way to build on the state’s landmark AI safety law. Michigan Senate candidate Abdul El-Sayed, whose tight race could determine the balance of power in Congress, has also rolled out an expansive agenda to hit the brakes on AI via a “kill switch” for dangerous models.
预期的总统候选人、加利福尼亚州州长、民主党人加文·纽森在政治立场上出现转折,上个月发布了一项行政命令,将探索“熔断机制”提案,尽管他在2024年否决了一项本将强制要求某些大型AI模型配备紧急机制的法案。
Expected presidential hopeful and Democratic Gov. Gavin Newsom of California, in a political turnabout, issued an executive order last month that will explore “kill switch” proposals, despite vetoing a bill in 2024 that would have mandated the emergency mechanism for certain large AI models.
进步商会(Chamber of Progress)美国政策与政府关系副总裁K.J. 巴吉表示:“‘熔断机制’容易承诺,但很难在工程上实现。”他补充说,提出此类条款的法案可能吸引眼球,但会给实施带来问题,尤其是针对开放权重模型。
“A ‘kill switch’ is easy to promise, but it’s really hard to engineer,” said K.J. Bagchi, vice president of U.S. policy and government relations at Chamber of Progress, a center-left tech industry policy coalition. He added bills proposing such language can be attention grabbing but pose questions for implementation, especially with open-weight models.
联邦强制要求AI“熔断机制”的前景,让科技行业各个领域的公司都感到担忧,不知如果一个权重公开可用的AI系统——如Meta的Llama或谷歌的Gemma——失控,谁将承担责任。
The prospect of a federally mandated AI “kill switch” has companies spanning all corners of the tech sector worried about who would be liable if an AI system whose weights are publicly available — such as Meta's Llama or Google's Gemma — goes rogue.
许多大型科技公司和初创企业认为,开放权重模型的获取权益惠及美国小企业,这些企业越来越依赖成本更低的中国模型,因此这些公司联合起来,此前特朗普政府曾以国家安全为由考虑禁止这些模型。
Many major tech companies and startups argue access to open-weight models benefits American small businesses that are increasingly reliant on less costly Chinese models, banding together after the Trump administration weighed a ban on them citing national security concerns.
开放权重AI模型——即开发者公开发布模型的权重,允许他人对其进行修改,包括移除防护措施的能力——运行成本通常较低,且可在本地部署。但如果第三方开发者移除了所谓的“熔断机制”,由AI引发的紧急情况该由谁负责,目前仍无定论。
Open-weight AI models — where the developers publicly release a model’s weights that allow others to modify them, including the ability to remove safeguards — are often cheaper to run and can be locally hosted. But if a third-party developer removes the so-called kill switch, it’s still unsettled who would be at fault for an AI-driven emergency.
“这些开源模型一旦被下载,开发者就不再能够执行‘熔断开关’,即使它想这么做,”第二位科技行业游说人士说。
“Those open source models, once they're downloaded, the developer no longer would be able to execute a kill switch, even if it wanted to,” the second tech industry lobbyist said.
据代表谷歌、Meta和英伟达的科技行业团体ITI的政策执行副总裁兼总法律顾问约翰·米勒称,这些责任担忧可能会削弱美国国内开放权重模型的发展。“从美国人工智能领导地位和美国在全球舞台上竞争力的角度来看,当我们谈论人工智能竞赛时,这不是一个很好的做法,”米勒说。
These liability concerns could undermine domestic development of open-weight models, according to John Miller, executive vice president of policy and general counsel at tech industry group ITI, which represents Google, Meta and Nvidia. “It's not a very good approach from the standpoint of U.S. AI leadership and U.S. competitiveness on the global stage when we're talking about the AI race,” Miller said.
刘云平表示,他的法案不适用于开放权重模型,旨在迫使人工智能公司投入更多时间和金钱,研究如何减缓或关闭失控的模型或智能体。“坦率地说,‘人工智能熔断开关’可能是该行业可能面临的各种法案中侵入性最小的一个,”他说,并补充称这“完全不会减缓创新”。领导人工智能安全组织“安全人工智能联盟”并支持刘云平和莫兰“熔断开关”法案的布伦登·斯坦豪泽将行业对其控制模型能力的担忧描述为人们呼吁人工智能放缓发展、甚至在某些情况下完全暂停的根本原因。
Lieu said his bill would not apply to open-weight models, and that it’s intended to force AI companies to spend more time and money researching how to slow or shut down their models or agents that go rogue. “Honestly, the AI kill switch is probably the least intrusive of the possible bills that could happen to this industry,” he said, adding that it “does nothing to slow down innovation.”Brendan Steinhauser, who leads AI safety group The Alliance for Secure AI and endorsed Lieu and Moran’s kill switch bill, characterized concerns from industry about their ability to control their models as exactly the reason why people are calling for an AI slowdown, and in some cases an outright pause.
“如果行业表示他们无法控制自己的模型,无法给模型装上‘熔断开关’,或者在技术上无法做到、想不出办法,这基本上就意味着游戏结束了,”斯坦豪泽告诉《政客》杂志。
“If industry is saying that they have no way to control their models and they can’t put a kill switch on it, or they can’t technically do it or figure it out, that’s kind of the whole ball game,” Steinhauser told POLITICO.
刘云平以及《政客》杂志采访的人工智能安全倡导者和游说人士指出,前沿实验室自身已经证明,在一定层面上目前可以实现模型关闭,包括Anthropic在特朗普政府下令其暂停所有非美国用户访问权限后,关闭了当时其最先进的两个模型。
Lieu as well as AI safety advocates and lobbyists POLITICO spoke with pointed out that the frontier labs themselves have shown that model shutdown at some level is currently possible, including when Anthropic disabled two of its most advanced models at the time after the Trump administration ordered it to suspend access for all non-U.S. users.
“这些‘关闭机制’(即用于终止人工智能系统运行的措施)其实有多种类型。其中一些公司目前就能够实现;而另一些则需要更多的技术改进或法规支持,”生命未来研究所(Future of Life Institute)负责人工智能与国家安全事务的汉扎·乔杜里(Hamza Chaudhry)说道。“但将所有这些措施都简单地归类为‘关闭机制’,反而会阻碍进展——无论是推动国会通过能够真正产生实际效果的政策,还是开发未来所需的更完善的人工智能安全技术。”
“There are different kill switches. Some of them the companies can do right now. Some of them require more work,” said Hamza Chaudhry, the Future of Life Institute’s AI and national security lead, adding: “But by conflating it all into this single bucket called the kill switch, it makes progress impossible, both on passing effective policy in Congress that makes a real difference and creating the technology we need for more comprehensive kill switches in the future.”
反对科技发展的民粹主义参议员乔什·霍利(Josh Hawley,共和党,密苏里州)表示,他会投票支持要求科技公司建立紧急情况下能够关闭其人工智能系统的机制的法案,但他对这种措施的可行性表示怀疑。
Populist tech foe Sen. Josh Hawley (R-Mo.) said he’d vote yes on a bill requiring companies to build a mechanism that could yank their models offline in emergency scenarios, but questioned how workable such a measure is.
“听起来倒也不错……不过这有点像电影里的情节,”霍利上个月对记者们说道。
“I think that sounds fine. But I also think it sounds a little bit like a movie,” Hawley told reporters last month.
在9月底举行的国土安全部小组委员会听证会上,霍利与参议员克里斯·墨菲(Chris Murphy,民主党,康涅狄格州)共同宣布了一项法案,该法案将要求科技公司对人工智能系统被黑客攻击的事件承担刑事和民事责任。听证会上,包括鲁本·加列戈(Ruben Gallego,民主党,亚利桑那州)在内的参议员们提出了关于人工智能系统紧急关闭机制的问题。
Hawley and Sen. Chris Murphy (D-Conn.) announced a bill to hold companies criminally and civilly liable for AI agent hacking incidents following a Homeland Security subcommittee hearing the Missouri Republican held in late September, where members such as Sen. Ruben Gallego (D-Ariz.) asked about emergency shutdown mechanisms for models.
在10月休会之前,《Politico》杂志对十几位参议员进行了调查,了解他们对强制实施此类“关闭机制”的看法。虽然两党都有一定程度的支持,但大多数参议员目前仍对这一提议持谨慎态度。
Ahead of October recess, POLITICO polled more than a dozen senators for their views on mandatory kill switches. While there was some support from both sides of the aisle, most members were, at least for now, cool on the idea.
“我支持这项提议,”夏威夷州参议员布莱恩·沙茨(Brian Schatz)对《Politico》表示;他既是人工智能领域的重要民主党人士,也致力于推动儿童在线安全相关的立法。不过他认为,这样的措施还不够完善,他更倾向于通过预先测试以及第三方对人工智能系统的评估来确保技术的安全性。
“I support it. I support all of it,” Hawaii Sen. Brian Schatz, a key Democrat for AI and kids’ online safety legislation, told POLITICO regarding Kennedy’s AI kill switch proposal. However, he said, such a measure falls short of how he wants to regulate the technology, highlighting pre-deployment testing and a third-party evaluation of sandboxes as more meaningful steps towards safer AI.
但大多数议员的态度都较为谨慎、不明确。民主党人主要关注的是要求企业必须自行控制其系统的相关立法;而共和党人则更倾向于建议暂时推迟立法进程,直到举行更多的听证会,并对这项技术有更深入的了解之后再采取行动。
But most lawmakers were noncommittal, with Democrats largely focused on legislation requiring companies to maintain control of their systems and Republicans more inclined to call for a legislative slow down until more hearings are had and the technology is better understood.
“最不应该做的就是仅仅因为某个行为在政治上具有吸引力就贸然采取行动,”俄亥俄州共和党参议员伯尼·莫雷诺(Bernie Moreno)对《Politico》杂志表示,“这项技术对整个经济体系都有着重大影响。我们必须极其谨慎,避免做出冲动的反应。”
“The last thing you want to do is [act] because it's politically interesting to do at a moment in time,” Sen. Bernie Moreno(R-Ohio) told POLITICO. “This has real implications for an enormous amount of the economy. We have to be very, very, very careful not to have knee-jerk reactions.”