AI at Meta· @AIatMeta · X·· 3 小时前AI 评分37
AI 导读
为了量化模型处理不熟悉任务的能力,我们将后训练阶段训练过的任务上的测试时计算扩展,与其他任务进行了对比。 两个模型在分布内提升相似,但鉴于其分布外得分,Muse Wonder Full 在不熟悉任务上的表现优于 Muse Spark 1.3 趋势所预测的水平。我们将这一上移归因于更强的基座模型,它能更有效地将后训练收益迁移到我们未曾预料的任务上。
正文
To quantify how the models handle unfamiliar tasks, we compared test-time compute scaling on tasks trained on during post-training against other tasks.
Both models improve similarly in-distribution, but given its out-of-distribution score, Muse Wonder Full performs better on unfamiliar tasks than the Muse Spark 1.3 trend predicts. We attribute this upward shift to a stronger base model, which carries post-training gains over more effectively to tasks we didn't anticipate.
来源:AI at Meta · x.com