aifollow.news
返回 Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · 原发布时间 AI 评分54

MBZUAI 基础模型研究所发布物理智能世界模型 PAN 2

AI 导读

PAN 2 让智能体在行动前模拟可能发生的过程:语言模型先用文字规划事件顺序和镜头移动,再由从零训练的 290 亿参数扩散模型生成画面。研究所称,在其测试中,完整模型的步骤正确率为 75.1%,计划完整完成率为 34.0%;移除语言模型后,步骤正确率降至 8.7%,且没有完成任何计划。

原帖引用 · 原文

该语言的正文暂不可用,当前显示已有版本。

@rohanpaul_ai

MBZUAI's Institute of Foundation Models (IFM) just released PAN 2, an open foundation world model for physical intelligence.

It's built towards simulative reasoning: letting an agent play out what happens before it acts.

It works with two kinds of reasoning, each with its own job:

> Conceptual: an LLM works out what happens, when, and how the camera moves, then writes it down as text. > Perceptual: a 29B diffusion model, trained from scratch, turns that text into what you see.

Take the LLM out, and multi-step tasks fall apart: 8.7% of steps right, no plan finished. Getting the order of actions right is the LLM's job.

With both, PAN 2 gets 75.1% of steps right and finishes 34.0% of plans in full, the highest among the models IFM tested. Every step has to hold for a plan to work.

More details in the technical blog:

https://t.co/l6xKPmKT9k

[1/1]

来源:Rohan Paul · x.com

模型
发现内容有误?提交纠错