人工智能可能具有意识吗?当然有可能。最近,我在曼哈顿一家温馨的酒吧里与一位软件工程师进行了第一次约会,他为一家大型科技公司工作。鉴于我对人工智能的兴趣,我原以为我们可能会聊得来。但当我告诉他,我的工作涉及人工智能相关的道德问题,包括人工智能可能变得有意识的可能性时,他几乎忍不住笑出声来。
Could A.I. Be Conscious? It’s Definitely Possible. At a cozy bar in Manhattan, I recently had a first date with a software engineer who works for one of the big technology companies. Given my interest in artificial intelligence, I thought we might hit it off. But when I told him that I work on moral problems related to A.I., including the possibility that it might become conscious, he barely suppressed a laugh.
他断言,人工智能绝不可能具有意识。然后他难以置信地问,我是否甚至知道大型语言模型是如何工作的。
There’s no way A.I. could be conscious, he declared. Then he asked, incredulously, if I even knew how large language models work.
我不知道该如何回应。虽然我的研究需要对大型语言模型有相当详细的了解,但没有人,甚至包括它们的设计者,能完全了解大型语言模型的工作原理。事后我想,我本应该问我的约会对象,他是否了解意识是如何运作的。因为虽然他似乎认为我夸大了人工智能的能力,但我怀疑他是否夸大了意识所需的条件。
I wasn’t sure how to respond. Though my research requires a fairly detailed understanding of L.L.M.s, no one, not even their designers, entirely knows how L.L.M.s work. In retrospect, I should have asked my date if he understood how consciousness works. Because while he seemed to think that I had an inflated sense of A.I. capabilities, I wonder whether he has an inflated sense of what consciousness requires.
没有人能可信地声称理解意识——即我们心理体验中那种内在的、主观的、有某种感觉的品质。尽管经过几个世纪的研究,科学家和哲学家仍然对意识是什么存在分歧。一些理论认为,意识是一种独特的生物现象,需要特定的细胞活动和电信号,而计算机缺乏这些。但其他理论认为,意识取决于系统的功能,而不是它由什么构成。根据这些理论,人工智能系统至少在原则上可能具有意识。
No one can credibly claim to understand consciousness — that inner, subjective, what-it-is-like quality of our mental experiences. Despite centuries of investigation, scientists and philosophers still disagree about what consciousness is. Some theories hold that it is a uniquely biological phenomenon, requiring particular kinds of cellular activity and electrical signaling that computers lack. But other theories hold that consciousness depends not on what a system is made of but on how it functions. According to these theories, an A.I. system could, at least in principle, be conscious.
在一项2022年对意识科学家的调查中,只有3%的人声称机器永远不可能具有意识。超过三分之二的人表示,机器可能具有意识,或者很可能具有意识。
In a 2022 survey of consciousness scientists, only 3 percent claimed that machines could never be conscious. More than two-thirds said machines could be conscious or probably could be.
当然,你永远无法确定一台机器是否具有意识,正如你永远无法确定除了你自己之外,任何人是否具有意识。正如哲学家长期认识到的那样,我们每个人只能直接观察到自己的意识体验。相反,我们必须通过审视现有证据,间接地评估其他生物的意识。我们推断同类人类具有意识,是因为我们拥有共同的生物构造,以及他们的行为和言语——值得注意的是,他们声称自己具有意识。
Of course, you can never know for sure whether a machine is conscious, just as you can never know for sure whether anyone is conscious other than yourself. As philosophers have long recognized, the only conscious experience each of us can directly observe is our own. Instead, we have to evaluate the consciousness of other beings indirectly, through an examination of the available evidence. We infer that our fellow humans are conscious because of our shared biological makeup, as well as how they behave and talk — including, notably, that they say they are conscious.
这似乎是一种不完美的方法,但却是目前最好的方法。过去十年,我一直在思考动物心智及其相关的伦理影响。动物无法用语言告诉我们它们的体验,但我们可以观察意识的其他证据,包括动物的行为、产生该行为的内部机制(例如它们的神经系统)以及这些机制是如何进化的。
This may seem like an imperfect approach, but it’s the best one available. I have spent the past decade thinking about animal minds and the related ethical implications. Animals cannot tell us in words what they experience, but we can observe other evidence of consciousness, including how animals behave, what internal mechanisms produce that behavior (such as their nervous systems) and how those mechanisms evolved.
在人工智能方面,我们可以寻找类似的证据。我们可以观察一个系统说了什么、做了什么,同时牢记它是基于人类数据训练的。我们可以观察它的工作方式——它是否执行与人类或动物意识相关的功能。我们还可以观察其能力随时间如何发展:这些能力是否源于与可能导致人类和其他动物意识的进化压力相似的训练压力?每种证据本身都有局限性,但合在一起,它们可以提供更完整的图景。
With A.I., we can look for similar kinds of evidence. We can look at what a system says and does, bearing in mind that it is trained on human data. We can look at how it works — whether it performs the kinds of functions that are associated with human or animal consciousness. And we can look at how its capacities emerge over time: Did they result from training pressures similar to the evolutionary pressures that may have led to consciousness in humans and other animals? Each kind of evidence is limited on its own, but together they can provide a more complete picture.
考虑一下人工智能公司Anthropic最近对其Claude聊天机器人进行的一项研究。根据一种有影响力的理论,当信息进入神经科学家称之为大脑中“全局工作空间”的区域时,人类便产生意识,该信息随后在大脑中广播,用于报告、推理等功能。Anthropic的研究人员发现证据表明,Claude自行发展出了一套内部表征,这些表征在各种任务中都可供Claude使用。这一系统可能与人类的全局工作空间部分类似。
Consider a recent study by Anthropic of its Claude chatbot. According to one influential theory, consciousness arises in humans when information enters what neuroscientists call a “global workspace” in the brain, from which that information is broadcast across the brain for use in reporting, reasoning and other functions. Anthropic’s researchers found evidence that Claude, on its own, developed a set of internal representations that are similarly available to Claude across a range of tasks. This system may be partly analogous to a global workspace in humans.
Anthropic的研究人员还研究了Claude的行为。当他们在工作空间中用一个概念替换另一个概念时,Claude的推理和答案随之改变。当他们抑制工作空间时,Claude对其体验的描述变得平淡而机械。Claude的工作空间在未经人类设计的情况下自行发展,这一事实表明,大脑和大型语言模型可能独立地找到了解决同一问题的类似方案:如何让正确的信息可用于推理。
The Anthropic researchers also looked at Claude’s behavior. When they swapped one concept for another inside the workspace, Claude’s reasoning and answers changed accordingly. When they suppressed the workspace, Claude’s descriptions of its experience became flat and mechanical. The fact that Claude’s workspace developed without being designed by humans suggests that brains and L.L.M.s might have arrived independently at a similar solution to a similar problem: how to make the right information available for reasoning.
这一切都不能证明Claude具有意识,Anthropic也并未声称其具有意识。但该研究说明了如何收集证据,并表明一些证据已经存在。
None of this establishes that Claude is conscious, and Anthropic is not claiming that it is. But the study illustrates how evidence can be collected, and it demonstrates that some evidence already exists.
即使当前的人工智能系统没有意识,未来的系统可能会有。假设怀疑论者是对的,即意识需要当前人工智能系统所缺乏的特征,例如生物组织的电化学活动。许多公司已经在探索新的设计可能性,包括具有复杂感觉和运动能力的机器人、旨在模拟生物神经元的计算机芯片,甚至包含活体神经组织的系统。
Even if current A.I. systems are not conscious, future systems might be. Suppose the skeptics are right that consciousness requires features that current A.I. systems lack, like the electrochemical activity of biological tissue. Many companies are already exploring new design possibilities, including robots with sophisticated sensory and motor capacities, computer chips designed to mimic biological neurons and even systems incorporating living neural tissue.
明确地说,我并非主张我们应当尝试构建有意识的人工智能。相反,我认为我们应当对创造具有意识体验能力的实体保持谨慎——尤其是能够体验痛苦的实体。如果人工智能系统能够受苦,我们就有道德责任承认它们的利益,并考虑我们的行为如何影响它们。而且由于人工智能系统能够极快地大量复制,人工智能意识将创造出大规模痛苦的可能性。
To be clear, I am not arguing that we should try to build conscious A.I. On the contrary, I think we should be cautious about creating entities with the capacity for conscious experiences — particularly the experience of pain. If A.I. systems can suffer, we have a moral responsibility to recognize their interests and consider how our actions affect them. And because A.I. systems can proliferate extremely quickly, A.I. consciousness would create the possibility of suffering on an enormous scale.
因此,虽然我们永远无法完全确定人工智能系统是否有意识,但我们仍应收集并权衡证据,因为判断错误会带来严重风险。如果我们假定人工智能没有意识而它实际上有,我们最终可能会大量虐待和忽视脆弱的生命——正如我认为我们对待动物那样。如果我们判定人工智能有意识而它实际上没有,我们最终可能会错置道德关怀,并放弃对本应是、或理应是强大工具的控制,而这些工具本可用于促进人类和动物的福祉。
So while we will never be completely certain whether A.I. systems are conscious, we should still collect and weigh the evidence, because getting the question wrong carries serious risks. If we assume A.I. is not conscious when it actually is, we could end up abusing and neglecting vulnerable beings in enormous numbers — as I believe we do with animals. If we decide that A.I. is conscious when it really isn’t, we could end up misplacing our moral concern and abdicating control over what are, or should be, powerful tools that we can use to advance human and animal well-being.
基于这些理由,人工智能意识的问题不应被视为最好留给哲学家沉思的异想天开之事。这是一个真实的可能性,具有真实的道德含义,设计者和监管者在考虑我们想要开发什么样的人工智能系统——以及无论我们是否愿意,什么样的系统可能会自行发展——时,都应认真对待。托尼·西姆斯是纽约大学心智、伦理与政策中心的研究员。
For these reasons, the question of A.I. consciousness should not be considered a fanciful matter best left to philosophers to ponder. It is a real possibility, with real moral implications, that designers and regulators should take seriously when considering what kinds of A.I. systems we would like to develop — and what kinds might develop whether we like it or not. Toni Sims is a researcher at the Center for Mind, Ethics and Policy at New York University.