跳到正文
Ethan Mollick· @emollick · X·· 2 小时前AI 评分28
AI 导读

再说一次,@SemiAnalysis_ 在这里做了一件有价值的事,你能看出为什么专家级工作的基准测试极难实现。我认为这相当有用,尤其是在许多其他主要基准(ARC-AGI、GDPval、METR Long Tasks)都已完全饱和的时候。

正文

Again, @SemiAnalysis_ is doing something valuable here & you can see why benchmarks of expert-level work are incredibly hard to pull off. I think this is quite useful at a time where so many other major benchmarks (ARC-AGI, GDPval, METR Long Tasks) are completely saturated.

来源:Ethan Mollick · x.com