Salesforce 及合作者训练了一个 8B 推理模型,可在一次生成中基于一组源论文写出多个研究想法。其奖励对整个想法集合打分,按每个想法与先前想法的距离来加权其质量,使模型学会让新想法远离已有想法。
Great application of small language models from Salesforce and colleagues.
AI-scientist pipelines are well known to struggle to propose novel and diverse research ideas.
This team trains an 8B reasoning model to write several research ideas in one generation from a set of source papers.
The reward scores the whole set, weighting each idea's quality by how far it sits from the ideas written before it. The model learns to move each new idea away from the earlier ones.
On their contamination-free benchmark, the 8B model scores higher on creative utility, a measure that combines quality and diversity, than Claude Opus 4.8 and GPT-6 Astra.
https://arxiv.org/abs/2610.22324
Chat with Paper: https://academy.dair.ai/papers/training-reasoning-models-to-generate-diverse-scientific-ideas-2610.22324
来源:elvis · x.com