跳到正文
elvis· @omarsar0 · X·· 2 小时前AI 评分29
AI 导读

不做 evals 就谈不上真正的递归自我改进(RSI),而且智能体自动生成的 evals 质量很差。给智能体提供具体的结果衡量方式,有助于围绕长期目标持续推进,因为指标清晰时更容易做 hill climbing。无论投入多少智能体和智能,缺乏合适的 evals 都走不远。

正文

Learn to build evals, folks!

You're not really doing recursive self-improvement (RSI) if you are not doing evals. And don't tell me your agents are generating the evals for you. They are pretty bad at it.

I have found it really interesting and useful to give agents a concrete way to measure results and stay on track with a long-term goal. It's easier to hill climb when things are clearly measured and well defined. Probably one of the most important skills anyone in the space can have today.

It doesn't matter how many agents and intelligence you throw at a problem; you are not going too far without proper evals.

来源:elvis · x.com