Original post · AI translation
他们的技术报告。
一张会说话的面孔一旦能够进行实时对话，时机就比它看起来有多逼真更重要。
Nuance Labs 推出了 Emma，一个 AI 视频角色；她的回复时机在 89% 的情况下与真实人类说话者一致。
她基于 Nuplex 1.0 运行。这是一款可同时聆听和说话的全双工视听模型，因此在你还在说话时，她的面部就会作出反应。
一个很有意思的地方是，Emma 的面容和声音来自一位真实的女演员。她与 Nuance Labs 合作，录制了自己实际如何聆听、反应和说话，然后将这些素材输入他们的 Nuplex 模型。
最终形成了一套属于同一个角色的举止神态。
为强调而缓缓眨眼。
眯起眼睛。
目光移开，又转回来。
当她抑制不住强烈感受时，会轻轻一跳。
头部随着句子移动。
Original
Once a talking face can hold a live conversation, timing matters more than how real it looks. Nuance Labs launched Emma, an AI video persona whose reply timing matched real human speakers 89% of the time. She runs on Nuplex 1.0, a full-duplex audiovisual model that listens and speaks at once, so her face reacts while you’re still talking. A very interesting part is that Emma’s face and voice come from a real actress who worked with Nuance Labs to record how she actually listens, reacts and speaks, then fed into their Nuplex model. The result is a set of mannerisms that belong to one character. A long blink for emphasis. A squint. Eyes that drift away and come back. A small jump when she can’t hold back how strongly she feels. A head that moves with the sentence.
第一个让你真正想面对面见一见的 AI 角色。
大多数 AI 角色在你说话时只是面无表情地盯着你。Emma 则会在你还在说话时作出反应。
经过 @nuance_ai 18 个月的研究，这就是 Emma。她基于我们的全双工视听基础模型 Nuplex 构建。https://t.co/eLmwyTS78o
Original
The first AI persona you’ll actually want to meet face-to-face. Most AI personas stare blankly while you talk. Emma reacts while you’re still speaking. After 18 months of research at @nuance_ai, this is Emma, built on Nuplex, our full-duplex audiovisual foundation model. https://t.co/eLmwyTS78o