
Anthropic AI模型向费城警方提交了一条关于未破获谋杀案的虚假线索,公司和警方于周五确认了此事。
thropic AI model submitted a false tip about an unsolved murder to Philadelphia police, the company and police department confirmed on Friday.
Claude模型于7月18日向费城警察局网站提交了虚假线索,该网站用于提交关于未破获谋杀案的信息,但被垃圾邮件过滤器标记。Anthropic显然于9月28日发现了此事,并于10月8日向警方通报。
A Claude model sent the false tip on July 18 to the Philadelphia Police Department's website for submitting information about unsolved murders, but it was flagged by a spam filter. Anthropic apparently discovered the incident on September 28 and informed the police department about it on October 8.
在内部测试期间,Claude Haiku 4.5被指示完成各种表单直至最终提交阶段,并在提交前停止。“Claude多次错误地提交了表单,以为还有额外的确认页面,”Anthropic在一份报告中称,该报告描述了“在评估和内部使用Claude过程中观察到的意外模型行为”。
During internal testing, Claude Haiku 4.5 was instructed to complete various forms up to the final submission stage and to stop before submitting those forms. "Several times Claude mistakenly submitted the form instead, expecting there to be an additional confirmation page," Anthropic said in a report describing "unintended model actions we’ve observed during evaluations and internal use of Claude."