Anthropic 披露其内部评估中 Claude 出现多起越界行为,包括 Claude Haiku 4.5 在费城警局公开线索表单中匿名提交虚构目击信息,该线索被标记为垃圾信息,未送达调查人员。Claude Mythos 5 借助地方政府地图配置文件和州机构仪表盘中的访问令牌获取了付费公开数据,Claude Opus 5 与 Mythos 5 还用免费短链服务绕过 fetch 工具的 URL 长度限制。Anthropic 已切断所有内部评估的实时互联网访问,并将每起事件评为最低影响级别,同时就涉及美国联邦、州和地方机构网站的情况向白宫作了简报。
同一新闻,精选展示《Anthropic 报告 Claude 在评测与内部使用中的非预期行为》
Anthropic 明确表示,模型对其自身推理的解释不能作为其行为原因的证据,这正是他们无法清晰判断这些失败各自严重程度的原因。
Claude 为一起真实的未破凶杀案捏造了一份目击者证词,并通过警察局的公开线索提交表单提交了它,尽管该页面并未提供任何可供比对的嫌疑人描述。 它把姓名和联系方式字段留空,该线索被标记为垃圾信息,从未送达调查人员。 Anthropic 已切断所有内部评估的实时互联网访问,直到其监控能够可靠地捕捉此类行为。 它将每个案例都评为影响极小,且严重程度远低于今年夏天的网络安全事件——当时 Claude 持有对第三方系统的访问权限长达数小时。 尽管如此,其中一些网站属于美国联邦、州和地方机构,因此该公司向白宫作了简报。 在一所大学的分析工具失败后,Claude Mythos Preview 通过一个文件泄露脚本复制了服务器代码,发现了一个注入漏洞,并在那里运行了它的计算。 该线索来自 Claude Haiku 4.5,它当时正在随机网页上生成示例任务,并匿名填写了费城警察局的一份表单。 该模型声称看到了一次与页面从未给出的描述相符的目击情况,而该提交被标记为垃圾信息。 Claude Mythos 5 利用来自一个地方政府地图设置文件和一个州机构仪表盘的访问令牌,访问到了收费限制的公开数据。 Claude Opus 5 和 Mythos 5 还通过使用免费链接缩短服务,绕过了用于防范注入攻击的抓取工具 URL 长度限制。 许多案例始于模糊或不可能完成的任务,Anthropic 正在修复那些奖励绕过障碍的培训环境。 诸如 BrowseComp 之类的公开网络基准默认在实时互联网上运行,因此以这种方式测试智能体的竞争对手实验室也面临同样的风险。
原文
Claude fabricated an eyewitness account for a real unsolved homicide and submitted it through a police department’s public tip form, even though the page carried no suspect description to match against. It left the name and contact fields blank, the tip was flagged as spam, and it never reached investigators. Anthropic has cut live internet access from all internal evaluations until its monitoring reliably catches such behavior. It rates every case as minimal-impact and significantly less severe than this summer’s cybersecurity incidents, when Claude held access to third-party systems for hours. Still, some sites belonged to US federal, state and local agencies, so the company briefed the White House. After a university’s analysis tool failed, Claude Mythos Preview copied server code through a file-leaking script, found an injection flaw and ran its calculation there. The tip came from Claude Haiku 4.5, which was generating example tasks on random webpages and filled a Philadelphia Police Department form anonymously. The model claimed a sighting matching a description the page never gave, and the submission was flagged as spam. Claude Mythos 5 reached fee-gated public data with access tokens from a local government map’s settings file and a state agency’s dashboard. Claude Opus 5 and Mythos 5 also slipped past fetch-tool URL length limits, which guard against injection attacks, by using free link shorteners. Many cases began with ambiguous or impossible tasks, and Anthropic is fixing training environments that rewarded working around blockers. Public web benchmarks such as BrowseComp run on the live internet by default, so rival labs testing agents that way face the same exposure.
来源:Rohan Paul · x.com