
AI 代理正在许多高科技工作场所开始超过人类数量,并且它们的监控可能要复杂得多。AI 安全与治理初创公司 Opsin 周四宣布,已筹集 2100 万美元以应对当前形势。随着企业界员工将来自 OpenAI、微软等公司的 AI 代理接入更多工作流程,Opsin 正在帮助管理这批潜在风险的新来者。对于非技术人员来说,部署代理 — — 基于 AI 的能够完成任务的自主软件 — — 从未如此简单。
AI agents are starting to outnumber humans in many high-tech workplaces, and they can be far trickier to monitor. Opsin, an AI security and governance startup, announced Thursday it raised $21 million to meet the moment. As employees across the corporate world plug AI agents from the likes of OpenAI and Microsoft into more of their work, the company is helping to wrangle the new crop of potentially risky interlopers. It's never been easier for non-technical workers to deploy agents — autonomous software built on AI that can complete tasks.
随着员工将这些软件植入公司的工作、代码和数据库中,他们可能会失去对 AI 实际行为的洞察。当 Opsin 首席执行官兼联合创始人 James Pham 意识到安全顾虑正在减缓 AI 的使用时,他决定是时候扩大公司规模了,他对《商业内幕》如是说。“代理实际上比你想象的更像人类,” Pham 说。“原因在于,你不了解人类大脑内部发生了什么,但你可以通过他们的行为来评判他们。”
As employees pump the software into their companies' work, code, and databases, they can lose sight of what the AI is actually doing. When Opsin's CEO and cofounder, James Pham, realized security fears were slowing down AI use, he decided it was time to scale up his company, he told Business Insider. "Agents are actually more similar to humans than you think," Pham said. "And the reason is because you don't understand what is going on in a human head, but you can judge them by their actions."
Opsin 的目标是提供一个全面视图,以了解 AI 代理在组织内部实际上在做什么,以及其行为可能带来的风险。SYN Ventures 和 Race Capital 领投了这家约 20 人规模公司的新一轮融资,该笔资金将用于扩大其销售和工程团队。Pham 是麻省理工学院校友,他的另一位联合创始人 Oz Wasserman 曾在异常安全公司(Abnormal Security)任职,两人均于 2022 年离职。
Opsin aims to provide a comprehensive view of what AI agents are actually doing within an organization and the risks that behavior might pose. SYN Ventures and Race Capital led the roughly 20-person company's new funding round, which will go toward expanding its sales and engineering teams. Pham, an MIT alum, and one of his cofounders, Oz Wasserman, met at the firm Abnormal Security and each left in 2022.
当他们决定创办公司时,Pham 表示他们曾与数百人交谈,以了解企业引入 AI 时的担忧。敏感数据问题凸显出来。Pham 说,一人又一人提出担忧,认为 AI 代理可能会访问并滥用个人或机密信息。如今,Opsin 帮助客户展示代理活跃的位置、它们访问的工具和数据、它们最初被设计用来做什么,以及哪些可能需要清理。
When they decided to launch a company, Pham said they spoke with hundreds of people to understand the concerns about bringing AI into businesses. The issue of sensitive data leaped out. Pham said that person after person raised concerns that AI agents might access and misuse personal or confidential information. Now, Opsin helps clients show where agents are active, which tools and data they access, what they were originally created to do, and which ones might need cleaning up.
该公司提供持续监控企业工作、监督代理人并标记高风险行为。“说到底,关键在于用户的行为,代理人的行为”,Pham 说。他表示,即便是技术相对不太熟练的公司,其代理人的规模也令一些客户感到震惊。Pham 说,在 Opsin 合作的一家公司里,由首席财务官开发的代理人不慎让其他员工获得了财务信息的最高权限。
Then, the firm offers to continuously monitor companies' work, watch over agents, and flag risky behavior. "At the end of the day, it's all about the behaviors of the users, the behavior of the agent," Pham said. He said the scale of agents, even in relatively less tech-savvy companies, has stunned some customers. At one firm Opsin worked with, an agent made by a chief financial officer inadvertently gave other employees top-level access to financial information, Pham said.
网络安全行业此前已处于高度活跃状态,而代理人的增长进一步加剧了这一局势。SYN Ventures 的风险投资人、支持 Opsin 的 Glenn Chisholm 告诉 Business Insider 称,随着企业使用更多 AI 产品,黑客将发现更多攻击目标。“参与人数越多,攻击者获取访问权限并购买的难度就越小”,Chisholm 说。今年网络安全股票走势强劲,Chisholm 表示他已看到更多风险投资的投入。
The cybersecurity industry has been in a frenzy, and now the growth of agents is adding to that storm. Glenn Chisholm, a cyber investor backing Opsin with SYN Ventures, told Business Insider that as companies use more AI products, hackers will find more targets. "The more people that are doing it, the easier it is for an attacker to gain access and purchase," Chisholm said. Cyberdefense stocks have soared this year, and Chisholm said he's seen more venture capital investment.
Anthropic 和 OpenAI 正积极扩充网络安全人员。Opsin 希望能让企业在使用 Microsoft Copilot、ChatGPT Enterprise 等产品时感到更安全。Chisholm 对行业适应 AI 持乐观态度。“未来几年我们将在如何最大化其价值上进行探索,而不是害怕这个概念”,他说。
Anthropic and OpenAI are each hiring aggressively in cybersecurity. Opsin hopes it can make companies feel safer using Microsoft Copilot, ChatGPT Enterprise, and other products. Chisholm is optimistic that the industry will adapt to AI. "The next couple of years are us working out how to get the most out of it, rather than sort of fearing the concept of it," he said.