字号·· | 护眼
南华早报

在这个人工智能虚假信息的时代,真相需要一项条约Truth needs a treaty in this age of AI disinformation

点「原文对照」整页切到原文,或双击某段只看那段的原文。

想象一下:一个大国在敏感的战略区域对一个国家的船只发起行动,其依据是情报显示该船正在运输受制裁的货物。这次行动引发了一场重大的国际事件,使两国几乎走向战争。

Imagine this: one major power launches an operation against another’s ship in a sensitive strategic zone, acting on intelligence that the vessel is carrying sanctioned goods. The operation sparks a major international incident that brings the two powers to the brink of war.

在当今这个充满高科技感知能力的时代,这听起来或许难以置信,但它几乎真的发生了。9月中旬有报道称,美军曾计划在伊朗附近对中国船只采取行动,情报显示该船正在运输核武器计划的零部件。这些情报来自位于夏威夷的美国太平洋特种作战司令部,一名分析师当时使用AI聊天机器人审查了该船的货物清单,而系统错误地将这批货物判定为与核项目相关。

Unlikely as this may sound in today’s hi-tech world of sensory awareness, it did almost happen. In mid-September, it was reported that the US military was on the verge of launching an operation against a Chinese ship near Iran, which intelligence suggested was carrying components for a nuclear weapons programme. The intelligence came from the US Special Operations Command Pacific in Hawaii, where an analyst had used an AI chatbot to examine the vessel’s manifest. The system wrongly identified the cargo as nuclear-linked.

这些信息以情报报告的形式被提交,并由此引发了一场军事行动。据媒体报道,美军飞机已经升空,军事人员正准备登船,但后来发现AI生成的识别结果有误,行动随即被叫停。

Filed as an intelligence report, the information set a military operation in motion. According to media reports, US aircraft were already airborne with military personnel preparing to board the Chinese ship when the AI-generated identification was finally found to be false and the operation halted.

无论是有意还是无意,信息的操控与管理已成为全球和平与安全的一大威胁。如今,虚假信息更容易被使用,且更难被察觉和应对;而真相的压制与操纵,则成为升级和延长冲突的重要手段。

Whether intentionally or otherwise, the management and manipulation of information has become a major threat to global peace and security. Disinformation is now easier to use in ways that are harder to detect and harder to combat, while the suppression and manipulation of the truth has become an important means of escalating and prolonging conflict.

那么,我们该如何保护真相呢?说谎和误导他人的冲动,与追求开放和诚实的冲动一样,都是人类的本能,甚至可能更为强烈。正如20世纪的政治哲学家汉娜·阿伦特所指出:“从未有人……将诚实视为一种政治美德。”然而,正如国际公约保障人们获得医疗、庇护和食物的权利一样,我们或许同样迫切需要保障人们获取基于事实的信息的权利,以便人们能够信任自己所见所闻,并判断所获信息的真伪。

How, then, can truth be protected? The urge to lie and misinform is as natural a human instinct as the urge to be open and honest, perhaps more so. As 20th century political philosopher Hannah Arendt observed: “No one … has ever counted truthfulness as a political virtue.”Yet just as international conventions safeguard access to health, asylum and food, so there is arguably an urgent need to safeguard access to fact-based information, so that people can trust what they see and hear, and judge the veracity of what they are told.

今年早些时候,学生们在日本参加了一个关于错误信息和虚假信息的研讨会,屏幕上显示了一张由生成式人工智能创建的图片。照片:共同社Students take part in a workshop on misinformation and disinformation earlier this year in Japan with an image created by generative AI shown on a screen. Photo: Kyodo

准确、基于证据的信息是和平的基本要素。先进技术,包括人工智能,使得歪曲、误导和完全捏造信息比以往任何时候都更容易,其结果迅速成为散布恐惧和加剧冲突的武器。虚假信息——不仅是彻头彻尾的谎言,还有被操纵的片面真相——现在可以被用来决定真实事件的走向,并且像其他大规模杀伤性武器一样,可能需要受到国际公约的约束。

Accurate, evidence-based information is an essential ingredient of peace. Advanced technology, artificial intelligence included, has made it easier than ever to distort, to mislead and to entirely fabricate information, with the result fast becoming a weapon for sowing fear and escalating conflict. Disinformation – not only outright falsehoods, but also manipulated partial truths – can now be used to determine the course of real events and, like other weapons of mass destruction, may need to be governed by international convention.

曾经,我们可以通过接触独立媒体来对抗所谓的宣传。但如今的信息行动,利用无处不在的社交媒体、人工智能和网络工具,更难防御。撇开当代媒体面临的财政和政治限制不谈,越来越多的政府,即使是那些受到公众监督的政府,也在试图误导其人民并隐瞒准确信息。

It was once possible to combat what we called propaganda using access to independent media. But today’s information operations, employing the tools of pervasive social media, AI and cyber tools, are much harder to defend against. Setting aside the financial and political constraints on contemporary media, it is increasingly governments, even those subject to public scrutiny, that seek to mislead their people and withhold accurate information.

出于这些原因,在日益严峻的环境中捍卫信息获取并确保其畅通无阻,成为全球共同体的责任。

For these reasons, defending access to information and ensuring its unimpeded flow in ever more challenging environments becomes a responsibility of the global commons.

一种方法是让联合国承担保护准确信息流通的责任,作为其维护和平与人类安全使命的一部分。

One approach would be to make it the duty of the United Nations to protect the flow of accurate information as part of its mission to safeguard peace and human security.

这可以从扩大联合国数字和新兴技术特使、副秘书长阿曼迪普·辛格·吉尔的任务授权开始。他曾警告说,新技术可能很快绕过网络安全防御,加速武装冲突,并通过深度伪造和虚假信息侵蚀公众信任。“当我们无法分辨真假,无法区分现实与想象时,我们就失去了对事实的共同理解,”他在5月的一次伦理与技术会议上说。

That could begin with broadening the mandate of the UN’s special envoy for digital and emerging technologies, Under-Secretary-General Amandeep Singh Gill. He has warned that new technology could soon bypass cybersecurity defences, accelerate armed conflict and erode public trust through deepfakes and misinformation. “When we cannot tell the difference between what is true and untrue, what is reality or imaginary, then we lose this shared sense of an understanding of facts,” he said at an ethics and technology conference in May.

吉尔的观点十分中肯,但他需要相应的权限来牵头确保民众能够获得准确信息——正如他们享有健康与安全权利一样。首要举措便是制定一套各方都能认同的流程,用于标记那些具有欺骗性或误导性的内容,这类似于现有媒体事实核查机制的做法。联合国还可以为数字素养培训项目筹集资金,尤其是针对贫困国家。在虚假信息泛滥的当下,数字新闻素养理应成为教育体系的核心组成部分。

Gill is spot on, but he needs the authority to lead on ensuring that people have access to accurate information, much as they have rights to health and safety. A first step would be to outline processes that everyone can agree on for labelling deceptive or misleading content, much like media fact-checkers already do. The UN could also raise funds for digital literacy programmes, especially in poorer countries. In a world swamped with disinformation, digital news literacy should be a core component of education.

上述措施及其他相关举措最终可被纳入联合国大会决议之中,从而确立新的信息保护标准。这些标准可基于现有的网络行为规范加以完善,并延伸至各类人工智能实验室的输出成果——如今这些实验室正不断研发出愈发精密的模型,用以制造极具迷惑性的虚假内容。

These and other measures could eventually be framed as a General Assembly resolution to codify new standards of information protection. Such standards could build on existing norms of cyber behaviour and extend to the output of AI labs, which are churning out ever more sophisticated models that help to confect convincing fakery.

联合国总部。作为其维护和平使命的一部分,联合国可能被赋予保护准确信息流动的任务。照片:加拿大通讯社/美联社United Nations headquarters. The UN could be tasked with protecting the flow of accurate information as part of its mission to safeguard peace. Photo: The Canadian Press/AP

实现这一目标绝非易事。由于操纵信息能带来诸多利益,达成信息保护共识几乎难以想象。事实及其呈现方式显然带有主观性,究竟哪种说法才是正确的也常引发争议。各类平台、深受当地民众信赖的传播者以及人工智能企业均需参与其中。例如,对人工智能生成的内容添加更显眼的水印或许能发挥一定作用。

It will not be easy. The usefulness of manipulating the truth makes agreements on information protection hard to imagine. Facts, and the way they are presented, can obviously be viewed subjectively. Whose truth prevails is often contested. Platforms, locally trusted messengers and AI companies would all need to play a part. More visible watermarking of AI-generated content could be helpful, for example.

一个获得国际认可的信息保护机构需要具备相应职权与资源,以便有效监督、提供培训支持,并确保各类场景下民众都能获取经过验证的真实信息。该机构可效仿世界粮食计划署或联合国人道主义事务协调厅的模式,为各方提供监测与维护信息真实性的必要手段。

An internationally recognised information protection agency would need a mandate and the means to effectively monitor, provide the resources for training and ensure access to verified truth in any given context. Just like the World Food Programme or the UN Office for the Coordination of Humanitarian Affairs, it would equip stakeholders with the means to better monitor and protect truth.

目前联合国虽设有全球传播部,但其职能仅局限于发布有助于“实现联合国宗旨与工作”的信息。当今世界面临的挑战并非缺乏有效的沟通渠道,而是如何保护信息并确保其真实性。

The UN already has a Department of Global Communications, but its mission is narrowly defined as providing information that supports “the aims and work of the United Nations”. Offering a platform for effective communication is not the challenge the world faces; protecting information and ensuring its veracity is.

或许有人会认为,世界并不需要新的国际机制。但此事绝不能仅由民间社会来承担——它需要国际法律与公约的强力支撑。倘若真相得不到保护,未来将愈发危险:两极分化与分歧极易演变为冲突,而缓解矛盾与进行调解的障碍也将变得难以逾越。

Some might say the world doesn’t need a new international mechanism. But this cannot be left to civil society alone – it requires the force of international law and convention. If the truth goes unprotected, the future becomes more dangerous: polarisation and disagreement more easily escalate into conflict, and the obstacles to mitigation and mediation will be insurmountable.