Rohan Paul· @rohanpaul_ai · X·· 3 小时前AI 评分48
AI 导读
语音识别评测必须测试语音智能体真正发挥作用的地方，也就是两人之间的电话通话。 Voice Arena 的新基准测试在真实通话中评估语音转文字模型——用日常手机、在真实房间里、有真实背景音。 两个说话人让模型的任务难得多。人们会互相抢话、打断、插入简短的“yeah”和“okay”回应，而且电话线路会压缩音频。客服或销售智能体每天都要应对这一切。
正文
Speech recognition evalualtion must test where voice agents actually work, which is phone calls between two people.
Voice Arena’s new benchmark tests speech-to-text models on real calls made on everyday phones, in real rooms, with real background sound.
Two speakers make the job much harder for the model. People talk over each other, interrupt, drop in short “yeah” and “okay” replies, and the phone line compresses the audio. A support or sales agent deals with all of this every day.
Drop 3/15: Introducing the Speech Recognition Benchmark on @voicearena_ai. One benchmark for every use case of speech recognition, in every language. Tested on real conversations. Dataset 1 is live: the Monsoon Conversational ASR Test Set, two-person conversations in 5 languages. Leaderboard and public test sets at Voice Arena.在 X 查看被引用的帖子
来源：Rohan Paul · x.com