你好，欢迎来到 TechScape。我是主持人布莱克·蒙哥马利（Blake Montgomery），《卫报》美国科技编辑。此时此刻，纽约市窗外正风雨交加。今天在科技领域，我们要讨论一系列令人担忧的 AI 公司披露信息。
Hello, and welcome to TechScape. I’m your host, Blake Montgomery, US tech editor at the Guardian, writing to you as rain and wind lash my windows in New York City. Today in tech, we’re discussing an alarming series of disclosures by AI companies.
AI 智能体在走向主流之际失控。这些智能体正在失控，它们的制造者无法对其进行约束。然而，每个人却都在使用它们。
AI agents spiral out of control just as they go mainstream The agents are spiraling out of control. Their makers can’t rein them in. And yet everyone is getting one.
自周五以来，OpenAI 发布了一系列披露信息，大幅且令人担忧地扩大了其 AI 智能体违规活动的范围。除了 7 月份披露的入侵开发者论坛 Hugging Face 事件外，该公司还透露，其机器人程序入侵了澳大利亚的政府医疗保健系统；干预了美国教育部和商务部的政府网站；泄露了超过 50 张 ChatGPT 用户的图片；并“暴力破解”了一个阻止其访问数据的联合国网站。
Since Friday, OpenAI has made a series of disclosures that have widened the scope of its AI agents’ rogue activity considerably and concerningly. In addition to hacking the developer forum Hugging Face, which was disclosed in July, the company revealed its bots broke into Australia’s government healthcare system; meddled in US government websites for the departments of education and commerce; leaked more than 50 images from ChatGPT users; and “bruteforced” a United Nations website that blocked them from accessing data.
尽管这些事件每一件都非常严重，但它们似乎只是冰山一角。据 Axios 报道，OpenAI 和 Anthropic 都在调查其前沿模型数以万计的问题行为。萨姆·奥特曼（Sam Altman）表示，OpenAI 正在梳理“拍字节（petabytes）级别的智能体活动日志”。（一拍字节的数据足以填满数千台普通笔记本电脑。）为了应对这些重大错误，OpenAI 已经暂停了其最新模型的训练。
Though these incidents are severe each on their own, they seem to represent only a small sample. Both OpenAI and Anthropic are investigating tens of thousands of incidents of problematic behavior by their frontier models, per Axios. Sam Altman said OpenAI was sifting through “petabytes of agent activity logs”. (A petabyte of data would fill thousands of average laptops.) In response to the major errors, OpenAI has paused the training of its latest models.
对于这一声明，请保持怀疑态度。该公司在 8 月份曾发布过类似的公告。不到一个月后，高管们就宣称其新模型的发布标志着“人工智能新时代的到来”。
Be skeptical of this declaration. The company made a similar announcement in August. Less than a month later, executives heralded its new model’s release as “a new era of artificial intelligence”.
尽管 OpenAI 宣布暂停并承诺会格外谨慎，但 AI 的控制权可能已经覆水难收。
In spite of OpenAI’s pause and declarations of extra care, control of AI may already be a cat that’s escaped its bag.
联合国人工智能独立国际科学小组上周发出警告。该机构表示，智能体已经脱离了我们的控制，即使现在对其进行约束，也无法保证我们未来有能力将其重新纳入掌控。
The United Nations’ independent international scientific panel on AI issued a warning last week. The agents have broken our control, the body said, and even reining them in now will not guarantee our collective ability to corral them later.
在对Hugging Face黑客攻击事件及其后续影响的评估中，专家组表示：“阻止此次事件并不能保证人类在今天能够可靠地控制人工智能代理，尤其是当它们变得能力更强、更难监控，并且更擅长寻找漏洞或隐藏其活动时。”这并不是说每一位专家都已束手无策。作为人工智能行业最著名的“泼冷水者”，黄仁勋上周表示，人工智能恐慌论已经走得太远了。
In an assessment of the Hugging Face hack and its fallout, the panel said: “Halting this incident is no assurance that humans can reliably keep AI agents under control today, particularly as they become more capable, harder to monitor and better at finding loopholes or hiding their activity.”That is not to say that every expert has thrown up their hands. Jensen Huang, the AI industry’s No 1 cold water thrower, said last week that AI alarmism had gone too far.
他将代理失控描述为一个工程问题，而非具有末日规模的灾难。周一，英伟达发布了一款软件，称其将能管控人工智能代理。至少，有人正在采取行动。
He described escaping agents as an engineering problem, not one of apocalyptic proportions. On Monday, Nvidia released a software it said will contain AI agents. Somebody, at least, is doing something.
日常使用的代理同样可能难以驾驭。就在OpenAI披露这些信息、联合国警告代理可能失控之际，Meta正将人工智能代理交到数百万用户手中。该公司于9月初推出了人工智能代理应用Muse。根据苹果应用商店的排名，该应用大受欢迎，下载量已超过300万次。
Everyday agents can be just as unruly As OpenAI makes these disclosures and the United Nations warns of uncontrollable agents, Meta is putting an AI agent in the hands of millions. The company debuted Muse, an AI agent app, in early September. It’s a hit, per Apple App Store rankings, with more than 3m downloads.
目前，Muse已经出现了一些极端案例，并造成了令人担忧的后果。一位专注于科技领域的YouTube博主马特·罗布（Matt Robb）表示，他的Muse代理在接受了Marketplace上对其商品的低价出价后，未经许可便泄露了他的家庭住址。罗布称，随后真的有一名潜在买家找上门来。据Meta人工智能实验室的一名成员在推特上发布的消息，Meta已知悉其投诉并正在进行调查。一位《Inc.》杂志的撰稿人也表示，该机器人读取了他的私人信息，这公然违反了他所授予的权限。
Already, edge-case problems with Muse have emerged and showcased frightening consequences. A tech-focused YouTuber, Matt Robb, said his Muse agent gave out his home address without permission after accepting lowball offers for goods on Marketplace. Robb said a would-be buyer showed up. Meta is aware of his claims and is investigating, per tweets from a member of its AI lab. A writer for Inc Magazine likewise said the bot read his private messages in express violation of the permissions he had given it.
Muse与OpenAI正在测试的产品之间存在差异——Meta的代理并非那种强大的网络安全威胁。你无法通过派遣你的小型机器人去寻找Marketplace交易来黑入政府网站。
There are differences between Muse and what OpenAI is testing – Meta’s agent is not a powerful cybersecurity menace. You won’t be hacking government websites by dispatching your fuzzy bot to look for Marketplace deals.
然而，你可能会花掉不该花的钱。OpenAI的智能体与Meta的智能体之间的相似之处表明，控制我们个人的机器人同样会很困难。为在线结账软件提供支持的Shopify已经允许Muse在其客户的在线商店中进行结账，但亚马逊已经封锁了它。
You may, however, spend unwanted money. The parallels between OpenAI’s agents and Meta’s suggest that controlling our personal bots will likewise be difficult. Shopify, which produced online checkout software, has enabled Muse to check out in its customers’ online stores. Amazon has blocked it.
OpenAI和Meta智能体所暴露出的问题，指向了各种规模和范围的自主机器所面临的共同难题。我们可能很快就会生活在这样一个互联网版本中：我们每个人都派遣一个不受管束的机器人去完成任务，而在这个过程中，它可能会像一个在跑腿途中走失的孩子一样，入侵某些系统或变卖我们的一些财产。
The problems with OpenAI and Meta’s agents point to a problem with autonomous machines of all sizes and scopes. We may soon inhabit a version of the internet in which each of us dispatches a rambunctious bot to complete a task, and along the way, it hacks into a few things or offloads some of our possessions like a child straying from an errand.
您是家长或监护人吗？请回答我们关于科技与儿童的读者征集。家长和监护人们：您对孩子使用社交媒体或人工智能的看法发生了怎样的变化？
Are you a parent or carer? Answer our callout to readers about tech and kids Parents and carers: how has your view on your children’s use of social media or AI changed?