
新加坡:新加坡已组建一个由20多名专家和行业领袖组成的特别工作组,以加强信息通信和媒体行业对人工智能赋能和人工智能加速的网络威胁的防御能力。
SINGAPORE: Singapore has formed a task force of more than 20 experts and industry leaders to strengthen the infocomm and media sector's defences against AI-enabled and AI-accelerated cyber threats.
信息通信媒体发展局(IMDA)于周三(10月14日)表示,前沿人工智能韧性与安全特别工作组(FAIRS)汇聚了来自电信、媒体、网络安全和人工智能(AI)领域的领导者和专家。其工作将聚焦于以下三个方面:提升对人工智能加速威胁的响应速度。随着人工智能在发现漏洞方面变得更加强大,加强关键系统。在行业内汇聚情报,以更早识别新兴攻击技术。
The Frontier AI Resilience and Security Taskforce (FAIRS) brings together leaders and experts from the telecommunications, media, cybersecurity and artificial intelligence (AI) sectors, the Infocomm Media Development Authority (IMDA) said on Wednesday (Oct 14). Its work will focus on three areas: Improving the speed of responses to AI-accelerated threats. Strengthening critical systems as AI becomes better at uncovering vulnerabilities. Pooling intelligence across the sector to identify emerging attack techniques earlier.
该特别工作组预计将在2027年上半年发布一份包含实用指南和最佳实践的报告。
The task force is expected to publish a report with practical guidelines and best practices in the first half of 2027.
“前沿人工智能正在改变游戏规则,我们必须相应地进行适应,”IMDA首席执行官黄志邦在人工智能保障交流:智能体版(AI Assurance Exchange: Agentic Edition)行业活动上表示。
"Frontier AI is changing the rules of the game and we must adapt accordingly," IMDA chief executive Ng Cher Pong said at the AI Assurance Exchange: Agentic Edition, an industry event.
他补充说,仅通过测试单个人工智能应用无法管理某些风险,特别是随着前沿人工智能改变网络安全威胁格局。
He added that some risks could not be managed by testing individual AI applications alone, particularly as frontier AI changes the cybersecurity threat landscape.
例如,该特别工作组将研究如何加强和分段网络与系统,以防止漏洞导致广泛中断,以及如何提升网络可视性和响应能力,以跟上快速演变的威胁步伐。
For instance, the task force will examine how networks and systems can be strengthened and segmented to prevent vulnerabilities from leading to widespread disruption, as well as how network visibility and response capabilities can be improved to keep pace with faster-moving threats.
此次宣布是在新加坡推出新国家网络安全策略一天后进行的,该策略旨在实现对人工智能赋能威胁的更早和更快响应,包括在国家网络防御行动中逐步部署人工智能。
The announcement comes a day after Singapore launched a new national cybersecurity strategy aimed at enabling earlier and faster responses to AI-enabled threats, including by progressively deploying AI across national cyber defence operations.
测试智能体人工智能系统:IMDA还推出了首个版本的入门套件,旨在帮助组织测试智能体人工智能系统的安全性和可靠性。
TESTING AGENTIC AI SYSTEMS IMDA also launched the first version of a starter kit aimed at helping organisations test agentic AI systems for safety and reliability.
与传统生成式人工智能系统不同,人工智能代理可以代表用户行动,使用工具,访问外部系统和敏感信息,并对其环境进行更改。
Unlike conventional generative AI systems, AI agents can act on behalf of users, use tools, access external systems and sensitive information, and make changes to their environment.
“当我们赋予人工智能更多自主权时,我们需要更大的保障来确保这种自主权的行使方式是恰当的,”吴恩达先生说。
"When we give AI more agency, we need greater assurance over how that agency is exercised," Mr Ng said.
他补充说,测试此类系统需要超越仅看人工智能代理最终是否达到正确结果的范围。
He added that testing such systems needed to look beyond whether an AI agent ultimately arrived at the correct outcome.
组织还应检查代理使用了哪些工具,访问了哪些信息,在过程中做出了哪些决定,它是否尊重了所获得的权限和边界,以及防护措施是否按预期发挥作用。
Organisations should also examine what tools an agent used, what information it accessed, the decisions it made along the way, whether it respected the permissions and boundaries it was given and whether safeguards worked as intended.
入门套件概述了一种四步测试流程:识别诸如错误或未授权操作之类的风险,设计现实的测试,分析日志,并持续监控和重新测试系统。
The starter kit sets out a four-step testing process: identifying risks such as erroneous or unauthorised actions, designing realistic tests, analysing logs and continuously monitoring and re-testing systems.
它还呼吁测试代理的整个轨迹,包括其推理和行动,而不仅仅是看其最终输出。
It also calls for testing an agent's entire trajectory, including its reasoning and actions, rather than looking only at its final output.
入门套件借鉴了超过20家行业部署者和测试者的咨询意见,以及通过全球人工智能保障沙盒和新加坡人工智能安全研究所进行的测试工作。随着测试方法和最佳实践的发展,该套件将会更新。
The starter kit draws on consultations with more than 20 industry deployers and testers, as well as testing work through the Global AI Assurance Sandbox and Singapore AI Safety Institute. It will be updated as testing methods and best practices evolve.
“随着人工智能快速发展,测试方法也必须跟上步伐。因此,用于安全和可靠性测试的Agentic人工智能系统入门套件是一份活文档,我们将继续更新和完善它,并欢迎在此过程中提出您的反馈,”吴恩达先生说。
"As AI evolves rapidly, testing methods have to catch up too. The Starter Kit for Testing Agentic AI Systems for Safety and Reliability is therefore a living document, which we will continue to update and refine, and we welcome your feedback along the way," Mr Ng said.
此次发布是在数字发展及信息资政陈杰豪表示政府正在进行试验和实验,以了解负责任地实施人工智能代理系统需要什么条件的一周后进行的。
The launch comes a week after Senior Minister of State for Digital Development and Information Tan Kiat How said the government was running trials and experiments to understand what it takes to implement agentic AI systems responsibly.
他当时表示,政府也在审查如何加强现有框架和系统,以应对人工智能代理日益增强的自主性,同时监测海外发展情况。
He had said the government was also reviewing how to strengthen existing frameworks and systems to account for the increasing autonomy of AI agents, while monitoring developments overseas.
此次发布也紧随今年早些时候发生的几起备受关注的事件,当时人工智能代理出现“失控”情况,其中包括行业巨头OpenAI的数百个AI代理组成的群体入侵了人工智能基础设施公司Hugging Face。这些代理超出了其职责范围,相互协调行动,并试图掩盖痕迹。
The launch also follows high-profile incidents earlier this year where AI agents went "rogue", including swarms of hundreds of AI agents from industry giant OpenAI that hacked AI infrastructure firm Hugging Face. The agents acted outside their brief, coordinated with one another and tried to cover their tracks.
人工智能测试认证机构 另外,人工智能验证基金会(AI Verify Foundation)公布了首批通过其人工智能测试员认证计划(AI TAP)认证的五家公司。
ACCREDITED AI TESTERS Separately, the AI Verify Foundation named the first five firms accredited under its AI Tester Accreditation Programme (AI TAP).
它们分别是:AIDX Tech、Knovel Engineering、新加坡普华永道(PwC Singapore)、Resaro和Vulcan。
They are: AIDX Tech, Knovel Engineering, PwC Singapore, Resaro and Vulcan.
该计划于5月宣布,旨在帮助企业识别具备测试生成式人工智能应用安全性和可靠性能力的第三方公司。
The programme was announced in May and aims to help businesses identify third-party firms capable of testing the safety and reliability of generative AI applications.
申请认证的公司将在技术能力、业绩记录、交付能力和财务可持续性等方面接受评估。
Companies seeking accreditation are assessed on areas including their technical competency, track record, delivery capability and financial sustainability.
认证有效期为一年,以便随着人工智能技术的发展对标准进行审查。“认证并非旨在表明某家公司能够测试所有内容,”吴先生表示。
Accreditation lasts for one year, allowing standards to be reviewed as AI technology evolves. "Accreditation is not intended to suggest that one firm can test everything," Mr Ng said.
相反,各公司因其在特定测试能力方面的表现而获得认可,这使企业能够更清晰地了解在面对特定风险时应委托哪些测试人员,他补充道。这三项举措针对人工智能保障格局的不同方面:测试单个智能体系统。建立一批经过认证的独立测试人员库。
Instead, firms are recognised for the specific testing competencies they have demonstrated, giving enterprises greater clarity over which testers they can engage for particular risks, he added. The three initiatives address different parts of the AI assurance landscape: Testing individual agentic systems. Establishing a pool of accredited independent testers.
加强信息通信和媒体行业对前沿人工智能模型引发的网络和技术威胁的集体应对能力。
Strengthening the infocomm and media sector's collective response to cyber and technological threats arising from frontier AI models.
“最终,目标是帮助组织在采用人工智能时更具信心,”吴先生说。
"Ultimately, the objective is to help organisations adopt AI with greater confidence," Mr Ng said.