Nvidia 新论文提出 VERA,让长流程、多步骤任务的智能体在模型训练与技能文件编辑之间交替更新,并用真实证据的逐步评分决定每次修复方向。论文称只训练模型或只改 harness 都会丢掉约一半收益,VERA 构建了 9000 多个可重启沙箱,逐步对照真实文件和日志打分。在医学研究基准上,9B 智能体同时做两类更新得分为 69.1,仅改技能为 56.1,仅训练为 43.3。
New Nvidia paper shows agents for long, multi-step work improve most when you alternate between training the model and editing its skill files, using step-by-step scores from real evidence to pick each fix.
Training only the model or only the harness leaves about half the gain on the table, compared with updating both in alternating rounds.
Most environments score only the final result, which hides which step broke. VERA builds over 9,000 restartable sandboxes that check each step against real files and logs, then improves the agent in rounds.
VERA turns benchmark runs into over 9,000 restartable sandboxes where each step of a long workflow gets its own checklist score from real evidence.
On a medical research benchmark, a 9B agent scored 69.1 with both kinds of updates, versus 56.1 with skill edits alone and 43.3 with training alone.
Score each step against real artifacts, and let those scores decide whether the next fix goes into the model or its skills.
来源:Rohan Paul · x.com