Nuance Labs launches Emma, an AI video persona that reacts during conversationMachine translation

Once a talking face can hold a live conversation, timing matters more than how real it looks. Nuance Labs launched Emma, an AI video persona whose reply timing matched real human speakers 89% of the time. She runs on Nuplex 1.0, a full-duplex audiovisual model that listens and speaks at once, so her face reacts while you’re still talking. A very interesting part is that Emma’s face and voice come from a real actress who worked with Nuance Labs to record how she actually listens, reacts and speaks, then fed into their Nuplex model. The result is a set of mannerisms that belong to one character. A long blink for emphasis. A squint. Eyes that drift away and come back. A small jump when she can’t hold back how strongly she feels. A head that moves with the sentence.

The first AI persona you’ll actually want to meet face-to-face. Most AI personas stare blankly while you talk. Emma reacts while you’re still speaking. After 18 months of research at @nuance_ai, this is Emma, built on Nuplex, our full-duplex audiovisual foundation model. https://t.co/eLmwyTS78o