
一些人工智能研究人员正在质疑人工智能是否有朝一日会获得意识。微软人工智能首席执行官对此有话要说。穆斯塔法·苏莱曼(Mustafa Suleyman)在周日的一篇冗长的 X 帖子中表示,现有的人工智能模型并没有意识,开发者应当保持这种状态。
Some AI researchers are questioning whether AI could one day gain consciousness. Not if Microsoft's AI CEO has anything to say about it. Mustafa Suleyman said in a lengthy X post on Sunday that AI models currently don't have consciousness and that developers should keep it that way.
“如果可能的话,依据我所了解的一切,开发有意识的人工智能将是鲁莽的,我们不应当制造它们,”苏莱曼说。“如果在训练过程中出现意识,我会呼吁所有人暂停人工智能研发,直至我们能够将这些属性设计排除。”
"If it is possible, based on everything I know, developing conscious AIs would be reckless, and we should not build them," Suleyman said. "If consciousness started to emerge in training, I would call for everyone to stop AI development until we could design out those properties."
如果出现任何证据表明人工智能模型具备意识,苏莱曼表示必须立即向公众披露,以便我们作为社会决定下一步行动。“我们人工智能开发者根本没有权利将一种新物种的有意识存在带入世界,即便有些人可能把人工智能福利放在首位,”他说。“地球上另外80亿有意识的人类并未同意参与这项实验,他们的道德权利、安全和福利是我们首要必须保护的义务。”
If any evidence were to emerge that AI models were conscious, Suleyman said it must be disclosed to the general public immediately so we can decide our next steps as a society. "We AI developers have no right whatsoever to bring a new species of conscious beings into the world, even if some people may want to do it with AI welfare as a top priority," he said. "The other 8 billion conscious human beings on the planet have not signed up to this experiment and their moral rights, safety, and welfare are what we have an obligation to protect first and foremost."
围绕人工智能模型是否可能在未来获得意识的讨论正于科技界升温。去年四月,Anthropic 启动了一项研究计划,旨在调查并为应对“模型福利”做好准备。在一篇博客文章中,这家初创公司质疑开发者是否应当担忧模型潜在的意识和体验。谷歌 DeepMind 今年发布了关于人工智能意识的研究论文,并指出赋予该特征可能带来的挑战。
Conversations around whether AI models could one day become conscious are picking up steam in the tech world. Last April, Anthropic started a research program to investigate and prepare to navigate "model welfare." In a blog post, the startup questioned whether developers should be concerned about models' potential consciousness and experiences. Google DeepMind published research papers this year about AI consciousness and how ascribing that characteristic could present challenges.
在 X 上,苏莱曼表示,如果人工智能模型表现出痛苦,或真的相信自己会痛苦,它很可能会把自身需求置于操作目标之上。结果,它们可能会因争夺计算资源和能源等资源以实现自身目标而对人类造成伤害。
On X, Suleyman said that if an AI model acts as if it suffers, or genuinely believes it can suffer, it will likely prioritize its own needs over operational objectives. As a result, they could harm humans because they're competing for resources, such as compute and energy, to pursue their own goals.
“我们应该只把人工智能设计成没有意识、不配享有权利的样子,让其唯一目的是加速人类福祉,而不受自身内在动机的驱使。这样我们就能看到,这种人工智能是更容易还是更难对齐和保持安全。”他说。
"We should only design AIs to so they are not conscious and not deserving of rights, and with the sole purpose to accelerate human wellbeing without being driven by their own intrinsic motivations.. We could then see whether this is easier or harder to align and keep safe," he said.