Arena.ai· @arena · X·· 2 小时前AI 评分40
AI 导读
总之,Jev Router 能做出聪明的选择。它最常用的 5 个模型中有 4 个位于帕累托前沿,其可控性也明显很强。 但这还不足以构成更好的权衡。直接调用 DeepSeek V4.1 Flash 能以更低的成本和延迟获得相近的性能。 我们的结果表明了模型路由为何困难:同时平衡任务成功率、可控性、成本和延迟仍是一个未解决的挑战。
正文
In summary, Jev Router makes smart choices. 4 of its 5 most-used models sit on the Pareto frontier, and its steerability is notably strong.
But that doesn't yet add up to a better trade-off. Calling DeepSeek V4.1 Flash directly gets similar performance at lower cost and latency.
Our results show why model routing is hard: balancing task success, steerability, cost and latency all at once remains an open challenge.
来源:Arena.ai · x.com