硅谷的民主党众议员罗·卡纳（Ro Khanna）将提出一项法案，以规范人工智能技术。该法案规定了严格的责任追究标准，并禁止在政府尚未制定相应保障措施之前使用那些能够“自我优化”的人工智能系统。
Silicon Valley Democratic Rep. Ro Khanna will introduce a bill to regulate artificial intelligence, which includes strict liability standards and a ban on "recursive" self-improving AI until the government creates safeguards.
这项法案的提出，正值华盛顿方面努力加强对人工智能监管的背景下——因为多家科技公司的高层管理人员警告称，这项技术可能失控。迄今为止，国会几乎未采取任何措施来规范人工智能的发展。虽然人工智能正在推动经济发展，但如果管理不当，它也可能造成灾难性后果。
The bill comes amid a push for Washington to regulate AI after top executives warned the technology could become out of their control. Congress has largely done nothing to regulate the technology, which is undergirding the economy but could cause catastrophic damage if it goes wrong.
卡纳在周一接受CNBC采访时表示：“实际上，人工智能技术存在导致文明毁灭的风险；首先是有失控的安全风险，其次是被滥用的风险，我们必须认真对待这两个问题。”她提交的法案被命名为《人类对人工智能的管控法案》（Human Control Over AI Act），该法案将禁止那些能够自我优化或自主修改自身目标的人工智能模型在相关监管机制到位之前投入使用。
"There's actually a civilizational extinction risk," Khanna said Monday in an interview with CNBC. "There's a safety risk of loss of control, and then there's a misuse risk, and we need to take both seriously." Khanna's bill, a summary of which was shared exclusively with CNBC, is dubbed the "Human Control Over AI Act" and would ban models that recursively self-improve or autonomously modify their own core objectives, containment or shutdown controls until federal guardrails exist and an agency approves the activities.
该法案还计划设立一个新的联邦机构，专门负责监管OpenAI、Anthropic、Google DeepMind和xAI等公司开发的人工智能模型。这些公司因日益严重的安全问题而备受关注。该机构的职责包括制定安全规范、建立许可制度以审批模型的训练和部署流程、对前沿人工智能模型进行审计，并制定持续的安全测试标准，以确保人类能够有效控制这些技术。
The bill would also create a new federal agency to focus on AI models from OpenAI, Anthropic, Google DeepMind and xAI as the companies find themselves in the spotlight amid rapidly escalating safety concerns.
此外，每家前沿人工智能实验室都必须配备独立审计人员，这些审计人员需直接向该机构汇报工作。该机构还将制定相关标准，规范沙箱测试环境（即将测试环境与互联网隔离开来的安全措施）、设置“紧急关闭机制”以防止模型失控并扩散到互联网上，同时监管前沿实验室使用的高级芯片，并制定相应的监控和控制机制。
The agency would be tasked with creating safety regulations, a licensing system to approve model training and deployment, frontier AI model audits and setting security standards for continuous testing and effective human control.
该法案还将为那些运行失控的人工智能系统设定新的法律处罚措施。
Independent auditors would also be required to be embedded at every frontier lab and report to the agency directly. The agency would also create standards covering sandbox testing environments; air gaps, or isolating testing environments from the internet; kill switches; and controls that prevent models from escaping lab settings and roaming on the Internet. It would also be responsible for regulating the advanced chips that frontier labs use, including mechanisms to monitor or control their use.
如果人工智能系统的使用导致平民人口遭受伤害，相关行为将被视为“反人类罪行”并受到刑事处罚；同时，人工智能公司的员工若故意关闭安全防护机制、破坏系统的控制功能，或明知故犯地使用未经授权的系统，也将被追究法律责任。
The bill would also create new legal penalties for AI gone awry.
人工智能公司还需购买高额的责任保险才能发布自己的产品（即必须为可能带来的风险承担相应的法律责任）。
It would criminalize "crimes against humanity" for the deployment of AI models that result in the destruction of civilian populations. The bill would also impose criminal penalties on employees of AI companies who disable safeguards, kill switches, logging or containment systems, or who knowingly deploy an unauthorized system.
该法案还要求政府推动具有强制力的协议，并实施针对性的出口管制措施，以阻止中国及其他对手国家开发危险的人工智能系统。
AI companies would also be required to hold extensive liability insurance to release their models.
卡纳表示，这项法案是迄今为止提出的“最全面的人工智能安全立法”。他表示，该法案的制定参考了与多家人工智能安全组织的讨论意见（如非营利组织 Model Evaluation and Threat Research、Machine Intelligence Research Institute 以及 Palisade Research），而非大型人工智能公司高管的建议。
The bill also calls for the administration to pursue enforceable agreements and targeted export controls to deter China and other adversaries from developing dangerous AI systems.
“我希望这项法案能成为代表人工智能安全界声音的典范，”卡纳说，“长期以来，人工智能安全问题常被忽视或被视为‘科幻题材’，他们其实应该成为这场讨论的主角，而不是那些大型实验室的高管们。”
Khanna said the bill represents "the most comprehensive AI safety legislation" that has been proposed. He said it is modeled on his conversations with AI safety organizations like the independent nonprofits Model Evaluation and Threat Research, Machine Intelligence Research Institute and Palisade Research rather than the asks of executives from large AI companies.
目前，这项法案已与其他多项人工智能安全提案共同构成了完整的立法体系，其中包括由加州共和党众议员杰伊·奥伯诺尔特（Jay Obernolte）和马萨诸塞州民主党众议员洛里·特拉汉（Lori Trahan）共同提出的《FRONTIER 法案》——该法案提议在前沿人工智能实验室派驻独立审计人员，并允许政府关闭那些具有潜在灾难性风险的人工智能系统。
"I want this to be a model to give voice to the AI safety community," Khanna said. "I believe they have been unfairly dismissed as science fiction and haven't been taken seriously enough ... they need to be driving this debate, the AI safety community, not the executives of frontier labs." It now joins a number of other AI safety proposals, including the FRONTIER Act, a bipartisan proposal from Reps. Jay Obernolte, R-Calif., and Lori Trahan, D-Mass., that would put independent auditors in frontier labs and allow the government to shut down models that have the potential for catastrophic risk.
根据目前的安排，众议院的任何法案都需等到中期选举之后才能进行投票；而参议院则计划在本周结束后离开华盛顿，直到选举结束后才会重新返回。
No House bills are expected to receive a vote until after the midterm election, and the Senate is expected to leave Washington and not return until after the election after this week.