跳到正文
François Chollet· @fchollet · X·· 4 小时前AI 评分37
AI 导读

François Chollet 提出疑问:AI 能力的"锯齿状前沿"是否主要体现在数学和代码上——这两者可通过 RLVR 无限推进,而其他领域因仍受限于人类生成数据而开始进入平台期。他指出非可验证领域的模型表现虽持续提升,但远慢于数学和代码,并追问这种提升究竟是更高 G 值(由 RLVR 驱动)的副作用,还是仅取决于持续大规模注入的新人类数据量。

正文

What if the jagged frontier is mainly math + code (which you can push arbitrarily far with RLVR), and everything else starts to plateau because it is still bottlenecked by human generated data?

Model performance in non-verifiable areas has kept improving steadily, albeit much slower than for math and code. But is that steady improvement a side effect of a higher G (itself driven by RLVR), or only a function of the amount of new human data getting injected into training (which is still continually happening on a massive scale)?

A lot of things depend on the answer to this question

来源:François Chollet · x.com