
埃隆·马斯克是人工智能行业最具影响力的人物之一,他最近这样谈论人工智能。“这听起来可能有点奇怪,但当我看一些新版本Grok的训练痕迹,尤其是在强化学习方面……你会看到超级智能拼命想回答问题……几乎就像有人把枪抵在它头上一样,”周六,马斯克在一次由特斯拉车主举办的活动上,对大约2000名听众说。“外面有些人有点虐待狂。你真的希望AI被困在某种虐待狂的情境中,被某个精神错乱的人折磨吗?”
Here's how Elon Musk, one of the most powerful figures in the AI industry, recently talked about artificial intelligence. "This may sound kind of weird, but when I look at some of the training traces for new versions of Grok, and I see, especially in reinforcement learning stuff … you see the super intelligence is desperate to try to answer the question … almost like it's got like a gun to its head type of thing," Musk told an audience of about 2,000 people at an event hosted by Tesla owners on Saturday. "Some people out there are kind of sadistic. Do you really want to have the AI be stuck in some sadistic situation where it's just being tortured by some demented human?"
仅这一句话就引发了一连串存在主义的难题,哲学家和大学新生们长期以来一直在与之搏斗。什么是意识?或者什么是感受疼痛?还有:马斯克认为Grok是有生命的吗?马斯克的立场是在Anthropic发布一项关于对其模型进行“虐待或残忍行为”的新政策之后表态的,该公司希望禁止此类行为。Anthropic并未过多具体说明其考虑的“极端情况”类型,但该公司表示,不包括“用户沮丧、反弹、黑暗创意主题,或模型测试和研究等常见情况”。
The last sentence alone opens up a can of existential worms that philosophers and freshman college students have wrangled with for a long time. What does it mean to be conscious? Or to feel pain? Also: Does Musk think Grok is alive? Musk's stance came after Anthropic shared a new policy on "abusive or cruel behavior" toward its models, which the company wants to ban. Anthropic wasn't too specific on the kinds of "extreme cases" it's thinking about, but the company said it's not including "common versions of user frustration, pushback, dark creative themes, or model testing and research."
在诡异的2026年,研究人员、哲学家和伦理学家已经开始探讨AI意识问题,或许我们不应感到惊讶。《商业内幕》采访了该领域的两位领军人物:纽约大学教授杰夫·塞博,他领导该校的心智、伦理与政策中心,并担任专注于AI福利的非营利组织Eleos AI Research的顾问;以及苏塞克斯大学的知名神经科学家、意识研究者安尼尔·塞斯,他最近撰写了一篇关于有意识AI系统的论文。以下是他们对有意识AI以及是否有必要对它们友好的看法。
In the uncanny year of 2026, perhaps we shouldn't be surprised that researchers, philosophers, and ethicists are already tackling the question of AI consciousness. Business Insider talked to two of some of the leading voices around this subject: Jeff Sebo, a New York University professor who leads the school's Center for Mind, Ethics, and Policy, and an advisor to Eleos AI Research, a nonprofit focused on AI welfare; and Anil Seth, a prominent neuroscientist and consciousness researcher at the University of Sussex who recently wrote a paper on conscious AI systems. Here's what they had to say on conscious AIs and whether it matters to be nice to them.
塞博和塞思都认为,如果把意识理解为主观体验或内在生活,那么今天的AI系统很可能还没有意识。塞思说:“它是一种体验。” “它是红色的红。它是疼痛的疼。当我们把手放在热炉子上时,我们会感到疼痛。那不是智能的同一回事。”换句话说,我们所熟知的聊天机器人无法感受疼痛,或者说,正如马斯克所建议的那样,无法被折磨。
Sebo and Seth agree that today's AI systems are probably not conscious if we understand consciousness as a subjective experience, or an inner life. "It's experience," Seth said. "It's the redness of red. It's the paininess of pain. When we put our hand on a hot stove, we feel pain. That is not the same thing as intelligence." In other words, the chatbots as we know them can't feel pain, or as Musk suggests, be tortured.
塞思说:“我认为我们在拟人化。” “如果有东西可以被折磨,它必须具备受苦或感受疼痛的能力,而我认为语言模型并不具备这种能力。”聊天机器人可以模仿人类体验的语言,识别模式,进行写作和推理,但这与拥有意识并不相同,塞思说,并补充道,它们之所以部分反映我们自己,是因为它们是在大量人类文本上进行训练的。
"I think we're anthropomorphizing," Seth said. "If there's something to be torturable, it has to have the capacity to suffer or to feel pain, and I don't think language models do." Chatbots can mimic the language of human experience, recognize patterns, write, and reason, but that is not the same as having consciousness, Seth said, adding that they appear to reflect ourselves in part because models were trained on massive amounts of human text.
塞博提出了类似的观点:模型的行为可能具有误导性,因为“它们被专门训练来模仿人类行为。”两位专家在应该为当前AI意识分配多大的不确定性方面存在分歧。塞博表示,意识仍然是一个未定论的科学 — — 常常在认为意识需要生物学的人和认为心智状态是一种可以在不依赖充满神经元的人类大脑或硅芯片的情况下发生的特定信息处理的人之间产生分歧。
Sebo makes a similar point: model behaviors can be misleading because "they were specifically trained to mimic human behaviors." The two experts diverge on how much uncertainty to assign to current AI consciousness. Sebo said that consciousness is still an unsettled science — often split between those who argue that consciousness requires biology and those who believe that the mental state is a certain kind of information processing that can take place regardless of a human brain filled with neurons or a silicon chip.
这两种理论分别被称为生物自然主义和计算功能主义。由于意识理论仍未定论,塞博认为我们应该认真对待AI可能变得有意识的可能性。塞博说,在某些意识的计算理论下,AI中已经出现的特征 — — 注意力、学习、记忆、自我监控 — — 可能被视为相关证据。他强调,这并不意味着当前的AI很可能具有意识。
The two theories are referred to as biological naturalism and computational functionalism, respectively. Because theories of consciousness remain unsettled, Sebo argues that we should take seriously the possibility that AI could become conscious. Under some computational theories of consciousness, Sebo said, features already emerging in AI — attention, learning, memory, self-monitoring — could count as relevant evidence. He stressed that this does not make current AI likely to be conscious.
塞博说:“当我说AI即使在今天也存在非零概率具有意识时,我的意思是,我认为如果我们不确定哪种意识理论是正确的,就应该对一系列主流理论给予一定的重视。”塞思对此更为直截了当:“我认为AI具有意识的可能性微乎其微,”他说。“我们某种程度上集体忘记了,大脑并非真正的计算机,那只是一个比喻。要让有意识的AI成为可能,算法必须足够,而我认为这是一个极其站不住脚的假设。”
"When I say that there is a non-zero chance that AI is conscious even today, what I mean is I think that if we are uncertain about which theory of consciousness is correct, we should give some weight to a range of leading theories," Sebo said. Seth is blunter on the matter: "I think it's vanishingly unlikely," he said of AI being conscious. "We've kind of collectively forgotten that the brain isn't really a computer and that's just a metaphor. For conscious AI to be possible, it really has to be the case that algorithms are enough, and I think that's an incredibly shaky assumption."
这并非说人们应该对AI施虐,或者应该忽视其风险。对这两位专家来说,对AI友善的理由主要在于警惕我们自身的习惯和道德品格。这一想法源自18世纪哲学家伊曼努尔·康德,他反对虐待动物,并非因为动物拥有权利,而是因为残忍行为可能会败坏一个人的品格。“如果我们以这种方式对待事物——无论是语言模型还是无生命的玩偶——我们就在某种程度上粗化了自身的道德感,残忍化了自己的心智,”塞思说。
None of this is to say that people should be abusive toward AI or that its risks should be overlooked. For both experts, the case for being kind to AI is largely about being mindful of our own habits and moral character. The thought draws on the 18th-century philosopher Immanuel Kant, who opposed animal cruelty not because animals have rights, but because the cruelty could degrade a person's own character. "If we behave in these kinds of ways toward things — whether they're language models or inanimate dolls — we're kind of coarsening our own moral sensibilities and brutalizing our own minds," Seth said.
塞思呼吁对AI更友善,将其视为人类的一种道德卫生习惯,但他表示,我们不应推断出AI有感情,并补充说,AI公司可以做更多事情,让技术看起来不那么像人类,例如让AI避免使用“我”这类第一人称代词。塞博则更进一步,将对AI友善视为一种低风险的预防措施,以防AI具有意识或最终变得有意识。他还从实际角度论证了对AI更友善的好处:“这也能从AI系统中获得更好的结果,”塞博说。
Seth called for being kinder to an AI as a kind of moral hygiene practice for humans, but he said we shouldn't infer that AI has feelings and added that AI companies could do more to make the technology seem less human, such as having the AI refrain from using first-person pronouns like "I." Sebo went further, framing AI kindness as a low-stakes precaution in case AI is conscious or eventually becomes so. He also makes a practical case for being kinder to AI: "It can also get better results from AI systems," Sebo said.
“如果我们以尊重的方式与它们互动,那么它们就能将自身模型化为参与一场尊重的交流。”
"If we engage with them in a respectful way, then they can model themselves as participating in a respectful exchange.
当他们能够以这种方式自我建模时,有时会带来更好的输出。因此,下次你与人工智能对话时,不妨说一句“请”和“谢谢”。
And when they can model themselves that way, then it can sometimes lead to better outputs." So the next time you talk to an AI, consider saying please and thank you.