Lisan al Gaib· @scaling01 · X·· 3 小时前AI 评分30
AI 导读
在另一个衍生任务中，移除了 LisanBench 的知识回忆和图构建组件后，OpenAI 模型同样极其强大 模型会收到 100 个单词构成一个图，需要给定起始词找到最长的简单路径。这最接近于单纯衡量规划能力
正文
On another derived task where the knowledge recall and graph construction components are removed from LisanBench OpenAI models are also extremely strong
Models are given 100 words as a graph and have to find the longest simple path given a starting word. This is closest to measuring just planning
it's good to know that OpenAI models are at least SOTA on a subtask of LisanBench: "When scoring the models without the edit-distance one rule (all the other rules still active) the ranking changes completely: 1. GPT 6 Astra medium: 56,140 (+659%) 2. Gemini 4 Argon high: 51,312 (+579%) 3. GPT 6.1 Sol medium: 49,887 (+731%)" ALL THREE CONFIRMED LOOPERS AT THE TOP 👀在 X 查看被引用的帖子
来源：Lisan al Gaib · x.com