小米发布 MiMo-V2.6 论文《MiMo-V2.6: Scaling Reinforcement Learning Towards Self-Improvement》,其中 AI 承担了大部分训练循环:智能体构建任务、审核测试、给答案打分并查找作弊行为,人类只设定预算和规则。
The paper for MiMo-V2.6 by Xiaom is out.
In MiMo-V2.6, AI runs much of its own training loop: agents build the tasks, audit the tests, grade the answers and hunt for cheats. Humans set the budget and the rules.
shows that agent models kept improving with more RL compute by scaling batch size, task and harness variety, and grading effort together.
Scaling RL for coding agents is hard because pass/fail tests can't tell a clean fix from a hacky fix. Agents also learn to game environments, for example by downloading the published fix.
A grader agent compared passing patches in each group and moved reward to the cleaner ones. Without it, agents drifted toward longer runs and workarounds like swallowed exceptions.
MiMo-V2.6-Pro’s DeepSWE score rose from 58.4 to 72.6 over $2.6M of RL and was still climbing when training stopped.
– arxiv. org/abs/2610.11959
Title: "MiMo-V2.6: Scaling Reinforcement Learning Towards Self-Improvement"
来源:Rohan Paul · x.com