字号·· | 护眼
英国广播公司

人工智能的不慎使用才是真正的威胁——而非那些无稽之谈'Careless use of AI is the real threat - not the ghost stories'

点「原文对照」整页切到原文,或双击某段只看那段的原文。

梅雷迪思·惠特克认为,科学并不支持人工智能会反噬人类的观点Meredith Whittaker believes science doesn't support the idea that AI will turn against humans

告:本文包含粗俗用语。梅雷迪思·惠特克对那些充斥于各大新闻标题中的“人工智能带来灾难”的论调毫无耐心——在她看来,所谓“人工智能会反噬人类”的警告其实“毫无科学依据”。

Meredith Whittaker has little patience for the AI doom that dominates headlines - she thinks warnings of AI turning on humanity is a fear "not anchored in science".

作为运营加密通讯应用Signal的Signal基金会负责人,她表示:“相关风险确实存在,但并非那些狂热分子口中描述的那种骇人听闻的恐怖场景。”

"The risk is very real," says the boss of the Signal Foundation, which runs the encrypted messaging app of the same name, "but it's not the shiny ghost stories the wild-eyed boys are talking about".

她认为,眼下更紧迫的威胁在于人们对这项技术的滥用与不当使用。

Instead, she believes the more immediate danger is the technology being used carelessly.

她提到了据称由美国有线电视新闻网报道的一起事件:美国情报部门使用的聊天机器人编造出一艘载有核材料的中国船只的相关信息,结果导致美国一度准备采取军事行动。

She cites an alleged incident, reported by CNN, in which a chatbot used by US intelligence invented information about a Chinese vessel carrying nuclear material, reportedly leading the US to prepare a military response.

她在接受BBC《全球女性》栏目采访时说道:“我们差点就和中国开战了。”

"We almost went to war with China," she tells BBC Global Women.

“一个会生成错误情报、甚至险些引发中美战争的系统,无论如何都称不上是‘超级智能’。”目前,Signal的用户数量估计在4000万至7000万之间,与拥有数十亿用户的WhatsApp相比只是九牛一毛。

"A system that produces faulty intelligence and almost gets us into a war with China should not be considered super-intelligent by any standards." Signal has an estimated 40-70 million users - a drop in the ocean next to WhatsApp, which has billions.

不过,该应用以保护用户隐私著称:它甚至不会在自己的服务器上记录消息发送者的信息,从而最大限度减少外部观察者或黑客获取相关数据的可能性。

But it is renowned for its tough stance on protecting users' privacy - it hides who is sending a message from its own servers, limiting the data available to outside observers or hackers.

《时代》周刊曾将惠特克评为人工智能领域最具影响力的人物之一。从硅谷的董事会会议室到英国唐宁街、达沃斯论坛乃至梵蒂冈,但凡讨论人工智能未来的场合都能见到她的身影。

Time magazine named Whittaker one of the most powerful people in AI. She moves through the rooms where its future is discussed, from Silicon Valley boardrooms to Downing Street, Davos and the Vatican.

她大学时攻读文学专业,2006年毫无计算机科学相关学历背景的她以临时工身份进入谷歌工作。

She studied literature at university and joined Google in 2006 as an entry-level temp with no computer science degree.

2017年末,一位同事向她透露了“Maven项目”的相关信息——这是谷歌与美国国防部签署的一项秘密协议,旨在开发用于无人机瞄准的人工智能系统。此事让她声名大噪。

In late 2017, she made her name when a colleague told her about Project Maven, a secret Google contract with the US Department of Defense to build AI for drone targeting. She understood what it meant to "compress the kill chain": to shrink the time between a machine flagging a target and someone deciding to fire, reducing deliberation.

她深知“缩短杀伤链”意味着什么:即缩短机器识别出目标与决策者下达开火指令之间的时间差,从而减少决策所需的考量时间。于是她联合数千名同事共同抵制这一项目。

With thousands of colleagues, she pushed back.

“这只会导致劣质情报和错误数据被滥用,”她回忆起自己当时公开提出的担忧。

"This is going to launder bad intelligence and bad data," she remembers arguing publicly.

次年,惠特克协助组织了一次大规模罢工,约2万名员工参与抗议,不满公司处理多项事务的方式,尤其是他们认为公司仓促引入新技术。最终谷歌取消了相关合同,帕兰蒂尔则接手了这项工作。

The following year Whittaker helped organise a walkout, in which some 20,000 staff protested against the company's handling of several issues, including what they felt was the rushed introduction of new technology. Google dropped the contract and Palantir picked it up.

她明确指出,今年的美军对伊朗一所学校的导弹袭击与“Maven”系统有直接关联。她指出,此次袭击正是依赖该系统以及那些早已过时的情报信息,而这些信息将该学校误判为军事目标。“这正是我们在2017年就曾警告过的情况,”她说道。

She draws a direct line from Maven to the US missile attack on a school in Iran this year, which she says relied on the system and on outdated intelligence that identified the school as a military target. "This is exactly what we were warning about in 2017," she says.

惠特克批评风险投资家对女性领导的初创企业缺乏支持Whittaker criticises venture capitalists' lack of support for startups led by women

对此,帕兰蒂尔向《Global Women》回应称:“没有任何证据表明帕兰蒂尔的软件在这场惨剧中负有责任。”

In response, Palantir told Global Women there was "no evidence that Palantir's software was at fault in this terrible tragedy".

该公司还补充道:“帕兰蒂尔对基础数据以及情报信息的准确性概不负责。”今年早些时候,其英国及欧洲区负责人路易斯·莫斯利在接受BBC采访时称:“整个流程始终有人类参与,最终决策也由人做出。”

It added that "Palantir is not responsible for the underlying data nor identifying intelligence deficiencies". And earlier this year it's UK and Europe boss, Louis Mosley told the BBC that "there's always a human in the loop, so there is always a human that makes the ultimate decision".

目前美军尚未公布针对米纳布袭击事件的调查结果,但国防部长皮特·赫格塞斯表示,美军“绝不会以平民目标为攻击对象”。

The US military has yet to release the findings of its investigation into the Minab strike, but Defense Secretary Pete Hegseth has said it would "never target civilian targets".

包括英国在内的多国政府均主张获得访问即时通讯应用内对话内容的权限,称此举旨在保护妇女与儿童。

Governments, including the UK's, argue for more access to conversations on messaging apps. They say this is to protect women and children.

在2026年的伦敦科技周上,时任首相基尔·斯塔默表示,科技企业必须承担起检测并拦截儿童设备上出现的裸照的责任,否则将面临法律制裁。

At London Tech Week 2026, then Prime Minister Keir Starmer said technology companies would be expected to detect and block nude images on children's devices, or face legislation.

惠特克则认为儿童完全能够绕过此类限制措施,她将政府的做法称为“史无前例的通信与信息管控体系”。

Whittaker argues children would be able to circumvent any such measures, calling the government's approach "an unprecedented regime of communication and information controls".

英国科学、创新与技术部向BBC证实,相关立法工作正在筹备中。

The Department for Science, Innovation and Technology told the BBC it is preparing legislation.

如果某个国家——包括英国——强制要求削弱加密技术,Signal会选择退出该国市场吗?

Would Signal leave any country, the UK included, that forced it to weaken its encryption? "Yes!

“没错!我的天啊,我确实有自己的原则和底线,”她说,“这些原则不会因为我的情绪或外界的建议而改变。”当面临需要揭露那些“在生死攸关的关头依赖我们的人”时——这些人可能会遭到被利用的监控时,她表示:“我们会选择退出这个市场。”这款应用程序在俄罗斯、中国和伊朗已被完全或部分封锁。

My God, I have a backbone," she says. "It doesn't change based on mood. It doesn't change based on consultants." Faced with exposing people "who rely on us, sometimes in the context of life or death, to surveillance that could be weaponised against them", she says, "we would leave the market". The app is fully or partially blocked in Russia, China and Iran.

英国国家防止虐待儿童协会(National Society for Prevention of Cruelty to Children)的儿童在线安全负责人拉尼·戈文德(Rani Govender)告诉BBC,他们收到了许多儿童的求助信息:这些儿童被诱骗进入经过端到端加密处理的平台,随后被迫制作儿童性虐待相关的内容。

Rani Govender, Head of Child Safety Online at the National Society for Prevention of Cruelty to Children, told the BBC it hears from children who have been groomed and moved on to end-to-end encrypted platforms, where they are coerced into creating child sexual abuse material.

惠特克建议科技行业的女性勇敢面对欺凌者Whittaker advises women in tech to stand up to bullies

“科技公司必须对自己的设计决策负责,他们不能忽视这些决策可能给儿童带来的风险。”不过,Signal应用程序确实得到了一些女性组织的支持,尤其是来自全球南方地区的那些使用该应用程序的女性。

"Tech companies are responsible for the design choices they make, and they cannot ignore the risks those choices can create for children." But Signal does have support from some women's groups, often those from the Global South who use the app themselves.

“在国家和网络攻击频发的时代,Signal成为了一种生存工具,”赫拉·侯赛因(Hera Hussain)说。她是致力于打击性别虐待的慈善机构Chayn的创始人,该机构在南亚地区非常活跃。

"In a time of state surveillance and cyber-attacks, Signal is a tool for survival," says Hera Hussain, founder of the gender abuse charity Chayn, which is active throughout South Asia.

“任何平台都可能被坏人利用,我们必须正视这一事实。”我向惠特克(Whittaker)提到了一个发生在加拿大的案例:一些警察在Signal群组中分享了种族主义和厌女言论,直到其中一名警察将这些言论泄露给媒体后,这些言论才被公之于众。

"With any platform, it can be used by bad actors too, and we have to hold that truth too." I put to Whittaker a case from Canada, where police officers shared racist and misogynistic messages in a Signal group which leaked only when one of them passed it on to the media.

其中一名警察的律师表示,这些警察认为Signal就像他们的家一样私密和安全。

A lawyer for one officer said the men believed Signal was as private and safe as their own home.

“如果他们在厨房里进行了这样的对话,而他们的兄弟告发了他们,他们会怎么回应呢?‘我们到底该怎么做呢?’”她问道。

"If they had that conversation in the kitchen and their bro snitched, would it be: 'What are we doing about kitchens?'" she asks.

“这个系统必须对所有人公平有效,否则它就毫无意义。这就是基本人权的原则——这些原则同样适用于那些品行恶劣的人。”她提到了一位美国女性:由于Meta公司交出了她帮助女儿获取堕胎服务的信息,这名女性被关进了监狱(在那个州,堕胎是被定为犯罪的行为)。

"It has to work for everyone or it works for no-one. This is the principle of fundamental rights. They apply even to assholes." She points to a US woman jailed after Meta handed over messages showing she helped her daughter access abortion in a state where it had been criminalised.

她说,私密的通讯方式能保护人们免受多种伤害——“比如遭受家暴的配偶、能接触到数据库的厌女主义执法者,或是认为女性不该接受教育的专制政府。”

Private communication, she says, protects people from many kinds of harm - "an abusive spouse, a misogynist law enforcement officer with access to a database, or an authoritarian government that doesn't think women should get educated".

如果有一位想进入科技行业却因行业内的性别问题而心生畏惧的女性,她想对对方说些什么呢?“你喜欢这份工作吗?”她问道。

What would she want to say to a woman who wants to enter the tech field but is intimidated by the gendered aspect of the profession? "Do you love it?" she says.

“当你坐在电脑前时,是否会感到热血沸腾?你是否乐于摆弄并定义各类人工智能系统呢?”

"Do you sit down at a terminal and feel a rush of energy? Do you enjoy playing with and defining AI systems?"

稍作停顿后,她又补充道:“你能否适应那些环境复杂且并非人人友善的场合呢?因为面对霸凌者时,懦弱才是最危险的。”我询问她这样的环境里是否到处都是霸凌者。

Then she pauses and says: "Are you able to navigate interesting and gnarly environments where not everyone is going to be chill? Because there's nothing more dangerous than being a coward in front of a bully." I ask her if these environments are full of bullies.

她的同事说道:“我想现在两点了”——这正是我们约定结束采访的时间。

Her colleague says, "I think that's 2pm" - the time we agreed to end the interview.

梅雷迪思微笑着说道:“我建议别做个‘马屁精’,”她用的这个词指的是那些对权威人物极度顺从的人。

Meredith smiles. "I'd say don't be a simp," she says, using a term for someone who shows extreme deference to authority figures.

“那样做对你毫无益处。如果某个笑话并不好笑,也别勉强自己笑出来。”

"It's not going to help you. Don't laugh at the joke if you don't think it's funny."

紫色背景上用白色字体写着“全球女性”的图形,右侧有取自同心排列圆圈的蓝紫色弧线。Graphic with Global Women written in white on a purple background, with blueish-purple arcs taken from concentrically arranged circles on the right.

本文属于BBC世界广播台的“全球女性”系列报道,旨在讲述世界各地那些鲜为人知却意义重大的女性故事。

This is part of the Global Women series from the BBC World Service, sharing untold and important stories from around the globe