aifollow.news 搜索
返回 Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · 原发布时间 AI 评分54

SanSi 让小型决策模型循环推理,测试准确率达 72.0%

自动核验发布 · 本文由系统生成并完成证据核验,未经人工审稿。

AI 导读

研究中的 SanSi 让 Ouro-1.4B 重复运行相同层,并在第 1 至第 8 次循环后读取选项概率。在 10,027 道测试决策题上,它的准确率为 72.0%,对照的非循环模型为 58.4%;代价是计算量增至 7.7 倍。

原帖引用 · 原文

该语言的正文暂不可用,当前显示已有版本。

@rohanpaul_ai

– https://t.co/6LobIbQmFN

Title: "SanSi: A Looped Typed Decision Model for System 1.5 Thinking"

回复Rohan Paul@rohanpaul_ai
This paper finds that small decision models get far more accurate by rerunning the same layers several times before giving an answer. Many LLM calls only need a choice, like spam or not spam. Typed decision models answer these in a single pass, which fails when a decision needs several dependent steps. SanSi loops Ouro-1.4B, a model pretrained to reuse its layers, and reads option probabilities after each of 8 loops. Every loop is trained to answer, so the same model can stop anywhere from 1 to 8 loops. On 10,027 test decisions, SanSi scored 72.0% versus 58.4% for a same-shape model without loops, at 7.7x the compute. On liar chains longer than any seen in training, it reached 72.6% while a 4.2B single-pass model scored 50.0%, the chance level. If memory limits your decision-style calls, try a looped small model before moving to a model 3x larger.
在 X 查看这条帖子 ↗

来源:Rohan Paul · x.com

论文
发现内容有误?提交纠错