跳到正文
elvis· @omarsar0 · X·· 4 小时前AI 评分58
AI 导读

Data World 提出一套从零生成数据分析环境的引擎,先写出数据集的生成机制,再产出文件、任务和评分标准,并用 RL 训练 Qwen3.6-35B-A3B。

正文

Nice paper on scaling data environments from scratch.

They built an engine that creates data-analysis environments from scratch. They apply RL, which adds 20.9 points on DABstep-Hard.

Data World first writes down the mechanisms that generate a dataset, then produces the files, tasks, and grading rubrics. Because the generating process is known, open-ended findings can be checked, and independent audits confirm each answer can be recovered from the files.

Training Qwen3.6-35B-A3B with RL on 2,135 of these tasks, with no distilled trajectories, also adds 14.28 points on DAComp and 12.13 on JobBench.

The benchmark finding is just as useful. Ten frontier models compute the right numbers more often than they draw the right conclusion from them.

https://arxiv.org/abs/2610.21656

Chat with Paper: https://academy.dair.ai/papers/data-world-scaling-data-environments-from-scratch-2610.21656

来源:elvis · x.com