Artificial Analysis· @ArtificialAnlys · X·· 4 小时前AI 评分46
AI 导读
AA-Omniscience v1.1 在 @huggingface 上新增了一个公开集，其难度已校准至与私有集匹配。发布时，公开集与私有集的 AA-Omniscience Net Score 相关系数为 0.99，中位差异为 0.0 分。准确率与幻觉率的相关系数同样为 0.99，中位差异分别为 -0.07 和 -0.29 个百分点。
正文
AA-Omniscience v1.1 has a new public set on @huggingface calibrated to match the difficulty of the private set. At release, public and private scores have a 0.99 correlation for AA-Omniscience Net Score, with a median difference of 0.0 points. Accuracy and hallucination rate also have 0.99 correlations, with median differences of -0.07 and -0.29 percentage points, respectively
来源：Artificial Analysis · x.com