aifollow.news
返回 Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · 原发布时间 AI 评分54

WisprFlow 推出自训语音模型 Canto 1,减少听写后的修改

AI 导读

WisprFlow 从租用语音引擎转向自行训练模型。首款模型 Canto 1 针对嘈杂环境中的真实口述训练,并适应用户常用词和姓名。在约 10 小时、逾 2300 人的 Flow 听写样本上,其词错误率为 3.4%;这一结果低于 Wispr 所测试的其他模型。

原帖引用 · 原文

@rohanpaul_ai

The keyboard was a workaround for machines that couldn’t hear. Machines that hear make it optional.

WisprFlow recently hired Ariya Rastrow (founding Alexa scientist) as chief science officer and moved from rented speech engines to models it trains itself.

Hard to find a better fit for a speech lab than someone who scaled Alexa’s speech team.

Canto 1, his lab’s first model, was built to cut how often people edit dictated text, so Wispr trained it on noisy real-world dictations and tuned it to each user’s vocabulary and names.

And this is a hard test, unlike many, because Speech recognition was long tested on clean, read-aloud audio, but the hard problem is a cheap laptop mic in a room where someone else is talking.

On about 10 hours of real Flow dictations from more than 2,300 speakers, it posted a 3.4% word error rate, lower than all competing models that Wispr tested.

Typing gives you feedback on every keystroke, while speech makes you wait until the end of a sentence to see what the machine heard, so speed counts as much as accuracy.

Since launch, dictations that take more than 1 second to appear are down 54%.

Its training runs through pretraining, supervised fine-tuning and reinforcement learning with GRPO, the same stages used for large language models.

The reinforcement learning stage uses corrections from Flow users who opted in to share data.

When someone fixes a dictated word, Wispr checks how the audio aligns with the text and how the edit is shaped.

A misheard word gets folded back into the training reference, and a plain rewrite of the sentence gets ignored.

来源:Rohan Paul · x.com

模型
发现内容有误?提交纠错