跳到正文
elvis· @omarsar0 · X·· 4 小时前AI 评分53
AI 导读

GenReasoning 提出强化学习新方法 RLCR,把语言模型训练成共享留言板和工作区的智能体组织,并用它训练了 120B 的 Avalon-M1-Mini。研究发现模型学会了组织层级与分工、通过雇佣验证者和测试者加强集体验证,并出现更多考虑其他智能体的集体思考行为。Elvis Saravia 认为这类研究有助于理解多智能体协调,并关注八人雇佣组织带来的效果提升与安全风险。

正文

Really digging this new arc of specialized RL models. Bullish on this effort to understand and unlock collective intelligence.

Highly recommend checking out the technical report.

RLCR is just one of the latest efforts to train LLMs as agent organizations.

Why is this a big deal, and why is it necessary?

Coordination and organization are important primitives as we move into agentic long-horizon work. Agents should natively support these capabilities, which is mostly done through harnesses today.

So far, multi-agent systems and how they coordinate are not well understood. This Avalon-M1-Mini model attempts to study this more closely. I think this could help us understand and discover efficient, safe ways to build effective multi-agent systems for domain-specific problems.

Check out how they improve results with an eight-hire organization. Promising results. The safety risks are also worth a closer look.

This is small-scale, but as they scale, I am particularly curious about whether optimal and novel organizational designs (hierarchical and coordination strategies) will emerge.

I'll take a closer look at this approach and how it applies to automated research. I think there is so much to unlock there.

Congrats to my former colleague, @rosstaylor90, and his team. Truly cracked 👏

引用General Reasoning@GenReasoning
Introducing Reinforcement Learning from Collective Rewards (RLCR). RLCR is a recipe that trains language models as agent organisations, which share a message board and workspace. We use it to train Avalon-M1-Mini (120B) and study its behaviour. We find a number of interesting results, including: 🛠️ Learnt organisational hierarchies and divisions of labour 🕵️ Increased collective verification, through hires of verifiers and testers 👥 The rise of collective thinking, where agents think more about other agents and how to help them We believe RLCR can provide a laboratory for studying collective intelligence and multi-agent safety. Blog post and technical report 👇
在 X 查看被引用的帖子

来源:elvis · x.com