跳到正文
elvis· @omarsar0 · X·· 3 小时前AI 评分68
AI 导读

IBM 的论文提出 JevAct 决策门,在工具调用型智能体与其工具之间加入运行时校验,模型和工具本身保持不变。LLM 先把领域策略转成代码检查和是/否问题,工具调用执行前由代码核对工具记录中的事实、由决策模型回答对话相关问题,未通过则带反馈退回智能体修改。

正文

Banger paper from IBM on decision gates for agents.

They add a runtime gate to tool-using agents and keep the models and tools the same.

JevAct is a check that sits between the agent and its tools. An LLM first turns the domain policy into code checks and yes/no questions. Before a selected tool call runs, the code checks the facts in the tool records, and a Jev-like decision model answers the questions about the conversation. If the call fails a check, it goes back to the agent with feedback so the agent can revise it.

On τ²-bench Telecom, Opus 4.6's success across all three runs rose from 39.5% to 80.7%.

On Telecom, all eight agents improved by 16.9 points on average in three-run success. All nine improved on BFCL. Airline results were smaller and mixed.

They show that the gains come from the harness.

https://arxiv.org/abs/2610.38620

Chat with Paper: https://academy.dair.ai/papers/think-before-you-act-decision-gate-for-llm-agents-2610.38620

来源:elvis · x.com