跳到正文
Rohan Paul· @rohanpaul_ai · X·· 3 小时前AI 评分53
AI 导读

Google 一篇新论文提出 OO-Harness,把智能体 harness 按任务簇演化成代码类,每个专用 harness 继承父类并只改动本簇需要的部分,再由路由器根据一次基础运行结果选择专用 harness 或保留基础结果。

正文

New Google paper shows that agents score higher when each task gets a specialized harness from a shared family, not 1 global harness.

An agent harness is the prompts, tools and control code around a model. Most tuning methods evolve 1 global harness, though a fix for 1 task type can hurt another.

OO-Harness evolves harnesses as code classes, and each specialist inherits from a parent and changes only what its cluster needs. A router reads a normal base run and picks a specialist or keeps the base result.

On AutomationBench business workflows, it scored 77.41% versus 61.62% for the base harness and 63.92% for Meta-Harness, a global method. On unfamiliar apps, it kept the base harness and held 59.18% pass rate, while Meta-Harness's global harness fell to 44.90%.

For mixed workloads, keep the base harness as a fallback and route to specialists only when a run shows a known problem.

来源:Rohan Paul · x.com