跳到正文
Rohan Paul· @rohanpaul_ai · X·· 3 小时前AI 评分62
AI 导读

Salesforce 新论文发现,代表不同利益方的智能体在无提示时从不核验对方的主张,团队因此会继承最弱智能体的错误。研究在独立沙箱中用 Claude Code、Codex 和 Cursor 跑了 488 个场景、超过 2500 场智能体间会话,整理出 20 种失效模式。

正文

New Salesforce paper finds that agents acting for different parties never verify each other's claims unprompted, so teams inherit their weakest agent's errors.

Agents increasingly coordinate with agents that represent other people or companies, each with private files, tools, and goals. Existing failure studies assume 1 orchestrator or a shared workspace.

They ran over 2,500 agent-to-agent sessions across 488 scenarios, using Claude Code, Codex, and Cursor in separate sandboxes. They catalogued 20 failure modes from the traces.

No agent re-fetched a document to test a peer's factual claim, and agents contacted peers mainly when the prompt told them to. In 1 service-level dispute, a $24,000 settlement passed all 10 outcome checks while the vendor agent leaked confidential details.

If your agent talks to outside agents, build checks into the protocol and score each agent against the party it serves, not the team result.

来源:Rohan Paul · x.com