clem 🤗· @ClementDelangue · X·· 2 小时前AI 评分54
AI 导读
Hugging Face 将 OpenAI 的数学题转化为开源 RL 环境,发布在 Hugging Face 数据集 FineEnvs/openai-math 上。作者称该版本尚属早期粗糙,验证器只接受原始形式化,等价证明仍可能得 0 分。其方向是把开放研究变成任何人都能构建的开放可执行环境,用于训练更好的开放模型。
正文
We turned @OpenAI's math problems into open-source RL environments on @huggingface!
Early and rough (the verifier only accepts the exact original formalization, so an equivalent proof can still score 0), but this is what it looks like when a research release becomes executable training infrastructure for everyone.
This is an exciting direction imo: turning open research into open executable environments that anyone can build on to train better open models!
来源:clem 🤗 · x.com