aifollow.news
返回 Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · 原发布时间 AI 评分54

Voice Arena 发布 AI 听写应用公开基准,比较十款 Mac 应用

AI 导读

Voice Arena 将87名说话者的761段录音分别输入十款 Mac 听写应用,评估生成的文本能否直接发送,并公布评判说明、应用配置及标注统计差异不显著的结果。目前测试仅覆盖 macOS 上的美式英语;其帖文列出的得分为 Wispr Flow 79%、Apple 35%。

原帖引用 · 原文

该语言的正文暂不可用,当前显示已有版本。

@rohanpaul_ai

If a dictation company says it is the best, I would now ask how it scores on Dictation Bench. One test does not cover every use case, but that kind of claim should hold up in a shared comparison that anyone can inspect.

@voicearena_ai played the same 761 recordings from 87 speakers into ten dictation apps on a Mac (the real apps, not their APIs). They published the reference policies, the app configurations, the judge instructions, and results that flag which gaps are statistical ties.

So companies now have something concrete to respond to. They can show where their product leads, explain the failures, or show that a different task changes the result. Any of those is more useful than asking users to compare percentages measured under different conditions.

The current test covers US English on macOS only, and the results should be read with that scope. Within it, I would like companies to report against this benchmark routinely. A shared standard makes claims easier to check and improvements easier to prove, and this benchmark is a practical place to start.

引用Shobhit Banga@shobhitbanga
Drop 4/15: Announcing the Voice Arena Dictation Bench - the first open benchmark of AI dictation apps. Not their APIs: the real apps. We played 761 recordings from 87 speakers into each of 10 apps on a Mac, then 5 LLM judges asked if each draft could be sent as-is. Wispr Flow: 79%. Apple: 35% 🧵
在 X 查看这条帖子 ↗

来源:Rohan Paul · x.com

行业
发现内容有误?提交纠错