跳到正文
Ethan Mollick· @emollick · X·· 2 小时前AI 评分46
AI 导读

很高兴看到 GDPval 有了后继者来评估 AI 工作,但确实需要像 GDPval 那样的人类基线。 有趣的是,GPT-6 Pro 在评分中发现了一些错误。我还认为,0% 的分数掩盖了成功率上具有经济意义的差异。但这仍是一个有价值的基准!

正文

Nice to see a successor to GDPval to evaluate AI work but really needs human baselines like GDPval.

Funnily enough, GPT-6 Pro spotted some errors in the grading. I also think the 0% scores hide economically meaningful differences in success rates. But still a valuable benchmark!

引用SemiAnalysis@SemiAnalysis_
Today we’re releasing GDPx, a benchmark for measuring agentic capabilities across the most valuable domains. GDPx is a true frontier-level benchmark: even the best model scores just 12% (1/7)🧵
在 X 查看被引用的帖子

来源:Ethan Mollick · x.com