aifollow.news
返回 Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · 原发布时间 精选AI 评分60

Meta 向美国所有用户开放 Muse AI 智能体实时视频通话

AI 导读

用户可把通话中的动态形象改成真人、动物或其他角色,形象会在聆听时作出反应。材料称,系统以每秒25帧传输竖屏视频,并在用户停止说话后约870毫秒开始回应;其测试结果和服务规模仍需结合测试条件及硬件需求来看。

推荐理由

美国用户已可体验实时视频通话;形象可自定义,而响应速度与同时服务人数涉及明确的技术和硬件条件。

原帖引用 · 原文

@rohanpaul_ai

https://t.co/zzf9cX2usX

回复Rohan Paul@rohanpaul_ai
Meta just opened live video calls with its Muse AI agent to every US user. Callers see an animated avatar they can restyle as a person, animal or other character, and it reacts while listening. Muse Realtime Voice emits speech tokens carrying words and delivery, and Muse Realtime Avatar turns the same stream into lip-synced video. To run that live, Meta trained a student model to reproduce in 2 passes per video chunk what a teacher built in 120. the system streams 448x768 portrait video at 25 frames per second and starts replying about 870ms after a user stops talking. Adding 4-bit quantization, caching and dynamic batching lets a single Nvidia GB200 run 12 video streams at once. In company-run tests of 2- to 3-minute calls, raters preferred the avatar to Runway Characters 78% to 22% and HeyGen LiveAvatar 88% to 12%. At 12 streams per GB200, 1M simultaneous callers would need about 83K of them for video alone, so serving cost could cap the avatar’s reach.
在 X 查看这条帖子 ↗

来源:Rohan Paul · x.com

产品
发现内容有误?提交纠错