这是一段巴西前右翼领导人为其儿子的总统竞选背书的“深度伪造”视频,尽管他因试图发动政变而被禁止在网上发帖。
This is a “deepfake” of Brazil’s former right-wing leader endorsing his son’s presidential campaign, even though he is barred from posting online for trying to stage a coup.
这是身着高顶礼帽、拎着一袋现金的“山姆大叔”出现在巴西海滩上,而战斗机在头顶呼啸而过,轰炸附近的社区。
Here is Uncle Sam, in a top hat and lugging a bag of cash, on a Brazilian beach while fighter jets swoop overhead and blast a nearby neighborhood.
这是两位在巴西总统大选中展开激烈角逐的政治对手,并肩跳着一首在TikTok上走红的歌曲。由人工智能生成的选举视频正淹没巴西,它们能左右选情吗?
And here are the two political rivals locked in a bitter battle for Brazil’s presidency, dancing side by side to a viral TikTok song. Supported by A.I. Election Videos Are Flooding Brazil. Could They Sway the Vote?
巴西多年来一直致力于打击网络上的选举谎言。如今,人工智能让选举当局束手无策,并正在重塑这场高风险的竞选。
Brazil spent years targeting electoral lies on the internet. Now, artificial intelligence is stumping the election authorities and reshaping a high-stakes race.
在周日举行的这场高风险总统大选前夕,利用人工智能制作的视频——从滑稽荒诞到阴险欺骗——淹没了巴西互联网。
Videos made with artificial intelligence, ranging from the amusing and absurd to the grim and deceitful, have flooded the Brazilian internet ahead of a high-stakes presidential election on Sunday.
这使拉美最大的民主国家成为了人工智能在选举中应用的实时实验室,为美国即将到来的关键中期选举,以及其他正在应对强大新技术对政治生活影响的国家,提供了参照。
This has turned Latin America’s largest democracy into a real-time laboratory for the electoral use of A.I., offering parallels to the United States, where critical midterm elections approach, and to other nations grappling with the effect of powerful new technologies on political life.
但在巴西,这个长期沉浸网络的2.14亿人口大国,虚假信息近十年来一直定义着选举,候选人、策略师和普通公民制作的人工智能内容如潮水般涌来,已成为检验该国管控网络内容能力的严峻标尺。
But in Brazil, a chronically online nation of 214 million where disinformation has defined elections for nearly a decade, the deluge of A.I. — made by candidates, strategists and ordinary citizens — has become a stark gauge of the nation’s capacity to police online content.
网络虚假信息已是巴西选举季的标志性特征,但人工智能的普及及其日益精进的技术,给致力于维护国家投票公正性的巴西当局带来了重大新挑战。
Online disinformation is already a hallmark of Brazil’s electoral season, but A.I.’s prevalence and advancing sophistication are posing a major new challenge for the Brazilian authorities working to protect the integrity of the country’s vote.
巴西拥有全球最严格的打击选举谎言法规之一,也针对选举期间的人工智能使用出台了同样严格的规则。但这些护栏直到现在才首次面临实战检验。
Brazil, which has some of the world’s strictest regulations against electoral falsehoods, has issued equally stringent rules on A.I. use during elections. But these guardrails have remained largely untested until now.
巴西选举法院首席大法官卡西奥·努内斯·马尔克斯表示:“我们制定了规则,现在正观察会发生什么。”该法院负责监督选举投票。
“We made the rules, now we’re watching to see what happens,” said Kássio Nunes Marques, chief justice of Brazil’s electoral court, which oversees the vote.
巴西大选将左翼总统路易斯·伊纳西奥·卢拉·达席尔瓦与右翼挑战者弗拉维奥·博索纳罗推向一场势均力敌的总统之争。这也是该地区对一股崛起中的右翼势力的最大考验——过去18个月里,这股势力已连续赢得七次总统选举。
The Brazilian election is pitting President Luiz Inácio Lula da Silva, a leftist, against Flávio Bolsonaro, a right-wing challenger, in a tight contest for the presidency. It is also the biggest test in the region for an ascendant right, which has won seven straight presidential votes in the past 18 months.
在争取摇摆不定的、深度分裂的巴西公众的竞选中,社交媒体已成为关键的政治战场。而在巴西,如同世界其他地方一样,人工智能已成为传播政治信息和塑造网络舆论的有力工具。或者只是为了纯粹的娱乐——就像下面的表情包一样。
In the race to sway a deeply divided Brazilian public, social media has become a key political battleground. And in Brazil, like elsewhere around the world, A.I. has emerged as a potent tool for spreading political messages and shaping the online conversation. Or just for plain amusement — as in the memes below.
巴西选举法院禁止候选人在竞选期间使用“深度伪造”——即合成但逼真的视频或音频信息。法院还要求竞选活动必须明确标注由人工智能生成的视频。
Brazil’s electoral court bars candidates from using “deepfakes,” synthetic but realistic videos or audio messages, while campaigning. It also requires campaigns to clearly label videos generated by A.I.
“当选民听到一位经过人工智能增强的候选人时,他们听到的真的是那位候选人吗?”努内斯·马尔克斯大法官说。“看似无害的东西,实际上可能对选举过程造成伤害。”包括Meta、谷歌和OpenAI在内的科技公司遵照法院要求,提供了详细计划,说明它们将如何处理在其平台上制作和传播的人工智能内容。
“When a voter hears a candidate who has been enhanced through artificial intelligence, are they truly hearing the candidate?” said Justice Nunes Marques. “Something that might appear harmless could, in fact, cause harm to the electoral process.”Tech companies, including Meta, Google and OpenAI, complying with a court request, provided detailed plans about how they would handle A.I. produced and shared on their platforms.
此外,在选举前,选举当局禁止企业允许聊天机器人对政客进行排名或推荐,尽管独立监督机构发现一些平台违反了这一规定。
And, ahead of the elections, the electoral authorities banned companies from allowing chatbots from ranking or recommending politicians, though independent watchdogs have found that some platforms have broken that rule.
该国更广泛的社交媒体法规还要求数字平台迅速删除普通用户发布的散布选举谎言、攻击民主机构或以其他方式违反巴西法律的帖子。
The country’s broader social media regulations also require digital platforms to swiftly remove posts by regular users who spread electoral lies, attack democratic institutions or otherwise break Brazilian laws.
但据在巴西代理社交媒体平台的律师安德烈·贾凯塔(André Giacchetta)称,这些规则尚未经过微调,以区分旨在误导的AI生成内容与用于创意表达的AI。
But the rules haven’t been fine-tuned to distinguish A.I.-generated content meant to mislead from A.I. used for creative expression, according to André Giacchetta, a lawyer who represents social media platforms in Brazil.
贾凯塔表示:“该法规并未设定门槛,明确AI的使用何时开始构成对选举进程的潜在干预。”批评人士认为,这可能导致对AI生成内容的过度监管,从而限制言论自由。
“The regulation,” said Mr. Giacchetta, “doesn’t set a threshold for when exactly the use of A.I. begins to constitute potential interference in the electoral process.”This, critics argue, can lead to the overzealous policing of A.I.-generated content that may limit freedom of speech.
为应对AI虚假信息带来的新挑战,谷歌和OpenAI等公司已开发出标记其聊天机器人生成视频的方法,例如自动添加水印。YouTube等平台也在利用生物识别技术来捕捉并删除选举深度伪造视频。但实际上,遏制AI谎言的快速传播一直很困难。
To address the new challenges posed by A.I. disinformation, companies like Google and OpenAI have developed ways to flag videos made with their chatbots, such as automatically adding watermarks. Platforms like YouTube are also using biometric identification to catch and remove electoral deepfake videos. In reality, though, curbing the rapid spread of A.I. falsehoods has been difficult.
如果平台未能发现并删除AI生成的欺骗性内容,选举法院可以且已经命令它们将其撤下。然而,专家表示,这一流程缓慢且繁琐,无法与能在互联网上像野火一样蔓延的病毒式AI视频抗衡。
If platforms fail to spot and remove deceptive content generated by A.I., the electoral court can and has ordered them to take it down. Yet, experts say that process, sluggish and bureaucratic, is no match for viral A.I. videos that can spread like wildfire across the internet.
“我们现在面对的坏人真的非常非常快,”虚假信息学者、巴西事实核查机构Lupa通讯社创始人克里斯蒂娜·塔尔达吉拉(Cristina Tardáguila)表示。她补充说,公司也未能在自家平台上捕捉违规内容,她机构的一项调查显示,政治候选人创建的AI内容中约有10%缺少标签。
“The bad guy we’re now up against is really, really fast,” said Cristina Tardáguila, a disinformation scholar and founder of Agência Lupa, a Brazilian fact-checking agency. Companies are also failing to catch infractions on their own platforms, she added, with a survey by her organization identifying roughly 10 percent of A.I. content created by political candidates was missing a label.
监测巴西错误信息的研究小组Aos Fatos负责人泰·纳隆(Tai Nalon)表示,机器人产出的海量内容使得追踪AI虚假信息及其真实影响变得更加困难。
And the sheer volume of content being churned out by bots is making it harder to track A.I. disinformation and its true effects, according to Tai Nalon, head of Aos Fatos, a research group monitoring misinformation in Brazil.
专家表示,由于社交媒体平台发生了变化,监管人工智能的工作变得更加复杂。这些平台过去向用户展示线性的帖子时间线,现在则依赖高度个性化且不透明的算法,这些算法能够激进地向人们的信息流推送内容,并扩大人工智能虚假信息的传播范围。
Experts say that the work of policing A.I. is complicated by the way social media platforms have changed. While they once showed users linear timelines of posts, they now rely on highly personalized and secretive algorithms that can aggressively push content onto people’s feeds and widen the reach of A.I. disinformation.
近几天来,科技公司的中立性也受到质疑,此前卢拉和独立监督机构指责 Meta 偏袒他的对手。
The impartiality of tech companies has also come into question in recent days, after Mr. Lula and independent watchdogs accused Meta of favoring his rival.
与此同时,科技公司已缩减其内容审核力度,纳隆补充道。“我们正处于一个问题膨胀、而手头工具却减弱的阶段,”她说。
At the same time, tech companies have scaled back their moderation efforts, Ms. Nalon added. “We are at a point where the problem has ballooned, while the tools we have on hand are diminished,” she said.
专家表示,巴西人对表情包情有独钟,且是全球社交媒体使用最重度的国家之一,因此特别容易受到人工智能的吸引。约 56% 的巴西人表示信任人工智能,而美国人这一比例为 40%。这使得人工智能生成的视频在巴西格外有效且流行。
Experts say Brazilians, with their deep love of memes and one of the heaviest social media usage in the world, have been particularly susceptible to the allure of A.I. Some 56 percent of Brazilians say they trust A.I., compared with 40 percent of Americans. This has made A.I.-generated videos especially effective, and popular, in Brazil.
为了误导公众,其中一些视频展示虚假民调,或安排虚构选民在类似新闻报道的片段中抨击候选人。还有视频利用逼真的 AI 画面,展示虚假人群挤满巴西城市街道,以夸大各候选人的声势。
Seeking to mislead, some of these videos present fake polls or fictitious voters bashing candidates in segments that resemble news reports. Others exaggerate the popularity of each candidate using realistic A.I. videos of fake crowds filling the streets of Brazilian cities.
仍受数百万人拥戴的前右翼总统雅伊尔·博尔索纳罗也频繁现身其中。在一个农贸市场和总统府前,博尔索纳罗的 AI 版本正在为其子助选,尽管实际上他因在上届大选失利后密谋政变被判处 27 年监禁,目前正处于居家监禁状态。
Jair Bolsonaro, the former right-wing president who is still adored by millions, also features prominently. At a farmer’s market and in front of the presidential palace, an A.I. version of Mr. Bolsonaro has been rallying support for his son, even though he is, in fact, under home confinement as part of his 27-year prison sentence for plotting a coup after losing the last election.
博尔索纳罗本人此前利用选举舞弊虚假信息,煽动数千名支持者在败选后冲击巴西首都,要求军方推翻选举结果。
The elder Mr. Bolsonaro’s own use of disinformation about election fraud inspired thousands of his supporters to storm Brazil’s capital after his defeat, demanding the military overturn the result.
这一次,许多病毒式传播的选举视频抓住并放大了腐败指控,或是对美国可能干预巴西选举以帮助小博尔索纳罗的担忧。
This time around, many viral election videos have seized on, and amplified, accusations of corruption or fears that the United States may be meddling in the Brazilian elections to help the younger Mr. Bolsonaro.
在一个播放量超过80万次的视频中,一位壮硕的卢拉救下了一只名为“PIX”的狗,PIX是巴西的即时支付系统,特朗普政府曾攻击该系统,并以此部分理由为由征收关税。
In one video viewed over 800,000 times, a buff Mr. Lula saves a dog bearing the name of Brazil’s instant payment system, PIX, which the Trump administration has attacked and used to partly justify tariffs.
博尔索纳罗的支持者则利用人工智能将他塑造成超级英雄,通过严厉打击犯罪和启动经济来拯救巴西,同时将对手描绘为腐败分子。
Mr. Bolsonaro’s supporters, for one, have employed A.I. to cast him as a superhero who will save Brazil by cracking down on crime and kick-starting the economy, while painting his rival as corrupt.
在一个将卢拉与贪污联系起来的视频中,总统被展示为与一位最高法院大法官一起逃避警方追捕,该大法官与笼罩选举的腐败丑闻有关联。国家最高法院的危机损害了卢拉在部分选民心中的形象。
In one video linking Mr. Lula to graft, the president is shown running from the police alongside a Supreme Court justice linked to a corruption scandal hanging over the elections. The crisis in the nation’s top court has damaged Mr. Lula’s image among some voters.
在另一个视频中,那起腐败丑闻核心人物、被囚禁的银行家丹尼尔·沃尔卡罗对着一张与博尔索纳罗的合影落泪,而候选人博尔索纳罗则在一盆现金中嬉戏。博尔索纳罗因涉嫌从沃尔卡罗处筹集数百万美元资助一部关于其父亲的传记片而正接受调查。
In a different video, the imprisoned banker at the center of that corruption scandal sheds tears over a photo taken with Mr. Bolsonaro, as the candidate frolics in a tub full of cash. Mr. Bolsonaro is being investigated for raising millions of dollars from the banker, Daniel Vorcaro, to finance a biopic about his father.
学者们表示,归根结底,人工智能只是让制造本已在网络上流传的误导性或虚假政治叙事变得更快、更廉价、更容易。
Ultimately, scholars say, A.I. has simply made it faster, cheaper and easier to create misleading or false political narratives that were already circulating online.
除了互联网上虚假信息的扩散,人工智能还掌握着另一种、或许更强大的影响力。据巴西人工智能观察站负责人路易斯·亚历山大·雷亚利·科斯塔称,每天向数百万人提供个性化建议的流行聊天机器人很容易影响政治决策。
And beyond the proliferation of disinformation on the internet, A.I. also holds a different, perhaps more powerful, kind of sway. The popular chatbots dishing out personalized advice to millions of people each day can easily influence political decisions, according to Luiz Alexandre Reali Costa, who runs the Brazilian Observatory for Artificial Intelligence.
“A.I. 带来的问题没有一个是完全新的,”科斯塔说。“但它放大了我们已经面临的挑战。” Thayz Guimarães 在巴西利亚、Leonardo Coelho、Isabela Cruz 和 Lis Moriconi 在里约热内卢参与了报道。Gray Beltran 进行了额外工作。
“No problem that A.I. brings is totally new,” said Mr. Costa. “But it multiplies the challenges that we already faced.”Reporting was contributed by Thayz Guimarães from Brasília, and by Leonardo Coelho, Isabela Cruz and Lis Moriconi from Rio de Janeiro. Additional work by Gray Beltran.