
问问任何在安全运营中心工作过的人这份工作实际要做什么,你听到的无非是大量告警。数以千计的告警,其中大多数最终都不了了之。过去十年,人工智能的作用一直是帮助处理这堆积如山的告警:发现异常、标记异常,然后把决定权交给人。这种模式正开始失灵。
Ask anyone who has worked in a security operations center what the job actually involves, and you’ll hear a lot about alerts. Thousands of them, most of which turn out to be nothing. For the past decade, AI’s role has been to help with that pile: spot something odd, flag it, and leave the decision to a person. That arrangement is starting to break down.
新一代人工智能工具通常被称为智能体系统,它们不会止步于标记异常。想象一下凌晨3点出现异常告警的情况。较旧的模型会发出告警,而智能体可以查询设备信息、核查其以往的登录地点、将相关数据与威胁情报源进行比对,判定账户已遭攻陷并将其暂停——这一切都可能在分析师打开工单之前完成。到这时,你完全可以问自己:究竟是在使用一种工具,还是在监督一名同事。
The newer generation of AI tools, usually called agentic systems, doesn’t stop at the flag. Picture a strange at 3 am. An older model would raise an alert. An agent can look up the device, check where it has logged in from before, compare it against threat intelligence feeds, conclude the account has been compromised, and suspend it, all before an analyst has opened the ticket. At that point, it’s fair to ask whether you’re still using a tool or supervising a colleague.
CertiK的一份新报告为后一种情况提供了依据。报告认为,一旦人工智能系统能够开展调查、作出决定并采取行动,模型是否“好用”便只是问题的一部分。企业还必须决定智能体能够做什么、何时需要人工介入,以及出错时由谁承担责任。
A new report from CertiK makes the case for the second. Once an AI system can investigate, decide, and act, the report argues, whether the model “works” is only part of the picture. Companies also have to decide what the agent can do, when a human steps in, and who takes the blame when it gets something wrong.
从副驾驶到操作员 不难看出安全团队为何需要这种能力。攻击以机器速度推进,人才短缺依然存在,而指望通过增聘分析师来消化误报从来都无法实现规模化。
From copilot to operator It’s not hard to see why security teams want this. Attacks move at machine speed, the talent shortage hasn’t gone away, and hiring more analysts to clear false positives was never going to scale.
智能体可以先对调查进行初步处理,汇总不同安全工具中的数据,只将需要人工介入的案件升级处理。更激进的配置会进一步采取行动,例如隔离受感染的笔记本电脑或使会话令牌失效,而人工复核则留待之后进行。
Agents can take the first pass at an investigation, pulling together data from different security tools and escalating only the cases that need a human. More aggressive setups go further, isolating an infected laptop or killing a session token and leaving human review for later.
合规团队也在经历类似变化。以前,对新客户进行尽职调查,意味着分析师要手动核查制裁名单、企业登记信息和新闻档案。如今,智能体可以并行执行这些检查,梳理可疑账户之间的关联,并移交一份现成的案件资料。有些系统甚至会起草可疑活动报告,因此合规人员的工作变成了审阅,而不是从空白页开始撰写。根据CertiK的研究,仅2025年上半年,反洗钱罚款就超过9亿美元,因此,以规模化方式做好这项工作的压力确实存在。
Compliance teams are going through something similar. Due diligence on a new customer used to mean an analyst manually checking sanctions lists, corporate registries and news archives. An agent can now run those checks in parallel, map out how suspicious accounts connect to each other, and hand over a ready-made case file. Some systems even draft suspicious activity reports, so the compliance officer’s job becomes reviewing andg rather than writing from a blank page. With AML penalties topping $900 million in the first half of 2025 alone, according to CertiK’s research, the pressure to do this well at volume is real.
再比如加密货币领域,速度问题尤为极端。区块链交易一经确认便无法撤销,闪贷攻击可以在单笔交易中掏空某个协议。CertiK此前的研究发现,在Bybit攻击事件中,与朝鲜有关联的黑客在一个月内将被盗ETH中的86.29%转换为比特币,并通过混币器、跨链桥和场外经纪商进行转移。任何人工团队都无法实时追踪这条资金链。
Then there’s crypto, where the speed problem gets extreme. Blockchain transactions can’t be reversed once confirmed, and a flash-loan attack can drain a protocol in a single transaction. CertiK’s earlier research found that North Korea-linked hackers converted 86.29% of the ETH stolen in the Bybit exploit into Bitcoin within a month, routing it through mixers, bridges, and OTC brokers. No human team can follow that trail in real time.
一些协议正在将检测直接接入响应流程。如果智能体发现预言机操纵的特征或流动性异常流失,就可以在同一个区块内暂停存在漏洞的功能或触发熔断器。等人工人员看到警报时,无论结果如何,事情都已经结束了。谁在监督AI?
me protocols are wiring detection directly to a response. If an agent spots the signature of oracle manipulation or an unusual drain on liquidity, it can pause the vulnerable function or trip a circuit breaker within the same block. By the time a person sees the alert, it’s already over, one way or the other. Who watches the AI?
问题在这里。一旦把系统密钥交给智能体,并允许其自主行动,你就制造了一个极具吸引力的攻击目标。CertiK指出,提示词注入或被篡改的输入,可能诱使智能体批准一笔欺诈交易,或关闭某项合法的安全控制措施。
Here’s the catch. Give an agent the keys to your systems and permission to act on its own, and you’ve created a very attractive target. CertiK points out that prompt injection or tampered inputs could trick an agent into approving a fraudulent transaction or switching off a legitimate security control.
即使没有攻击者,人工智能也会出错。一个智能体可能会因为一次真实的入侵看起来像它见过上百次的误报,而将其轻易放过。反洗钱系统可能会生成一份看似清晰、自信的交易记录分析,但实际上却完全错误。智能合约审计智能体可能会批准一份合约根本不具备的安全特性,导致该合约带着漏洞发布。
Even without an attacker, AI gets things wrong. An agent might wave through a real intrusion because it resembles a false positive it has seen a hundred times. An AML system might produce a tidy, confident account of a transaction trail that’s simply incorrect. A smart contract auditing agent might sign off on a security property the contract doesn’t actually have, and the contract ships with the bug.
更大的风险可能在于人类会面临怎样的后果。当一个系统连续99次判断正确时,审核人员就会开始对第100次判断不再那么仔细。这就是自动化偏见,而且它往往恰恰在罕见且代价高昂的错误最有可能被忽略时出现。
The bigger risk may be what happens to the humans. When a system is right 99 times in a row, reviewers stop checking the hundredth as carefully. That’s automation bias, and it tends to set in just when the rare, expensive mistake is most likely to slip through.
审计审计者本身:随着人工智能智能体开始直接参与经济活动——代表个人和企业交易资产、管理资金池以及与去中心化金融协议互动——事情变得愈发复杂。这也引出了一个监管机构尚未真正回答的问题:如何审计智能体本身?CertiK将这一问题归为一个新的类别:为人工智能劳动力制定合规要求,而不是由人工智能本身执行合规。实际上,这意味着需要记录智能体看到了哪些数据、它是如何做出决策的,以及它具体执行了哪些操作。
Auditing the auditor Things get stranger as AI agents start operating in the economy directly: trading assets, managing treasuries, and interacting with DeFi protocols on behalf of people and businesses. That raises a question regulators haven’t really answered yet. How do you audit the agent itself? CertiK frames this as a new category: compliance for the AI workforce rather than compliance done by it. In practice, that means keeping records of what data an agent saw, how it reached its decision, and what it did.
当出现问题时,这些记录显得尤为重要。如果智能体错误地冻结了客户的账户、对无辜者提交了不准确的报告,或毫无理由地暂停了某个协议,“是算法干的”这一说法既无法说服监管机构,也无法让法庭信服。部署该系统的组织,以及配置和监督该系统的人员,仍然需要承担责任。而且,由于各司法管辖区对自主系统的责任规则尚未明确,无法证明谁批准了哪些操作的公司将处于极为不利的地位。
Those records matter most when something goes wrong. If an agent wrongly freezes a customer’s account, files an inaccurate report against someone innocent, or pauses a protocol for no good reason, “the algorithm did it” won’t satisfy a regulator or a court. The organization that deployed the system, and the people who configured and supervised it, are still on the hook. And because liability rules for autonomous systems are far from settled across jurisdictions, a company that can’t show who approved what is in a weak position.
像管理员工一样管理软件 结果是,公司最终可能会像管理员工一样管理 AI 智能体。CertiK 建议,每个智能体都应拥有明确的权限范围、清晰的移交给人类的节点、完整的重大决策记录、定期的对抗性测试以防范操纵(而不仅仅是准确性基准测试),以及一名对其表现负责的指定负责人。
Managing software like staff The upshot is that companies may end up managing AI agents a lot like they manage people. CertiK recommends that each agent have a defined scope of authority, a clear point at which it hands off to a human, a full record of its consequential decisions, regular red-teaming against manipulation (not just accuracy benchmarks), and a named person responsible for how it performs.
对安全专业人员而言,这指向一种不同的工作模式:花在处理每个警报或执行每个响应上的时间减少,而花在监督那些运行速度超越任何人类的系统上的时间增加。
For security professionals, that points to a different kind of job: less time working through every alert or executing every response, and more time overseeing systems that move faster than any person can.
AI 能自动化多少安全工作,正变得不再是最有趣的问题。更棘手的问题是:企业愿意授予多少权力,以及它们能否在出现严重问题之前建立相匹配的监管机制。
How much security work AI can automate is becoming the less interesting question. The harder one is how much authority enterprises are willing to hand over, and whether they can build the oversight to match before something goes badly wrong.
投稿文章。非 TNW 编辑部出品,不代表 TNW 的编辑立场。
Contributed article. Not produced by the TNW newsroom and does not reflect the editorial stance of TNW.