aifollow.news 搜索
返回 Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · 原发布时间 AI 评分54

一项数学发现研究用演化记忆替代测试时训练

自动核验发布 · 本文由系统生成并完成证据核验,未经人工审稿。

AI 导读

一则对 UC Santa Barbara 论文的介绍称,研究者提出 TTME:保持模型权重不变,把先前尝试的编程规则和得分改进思路存入记忆,用于指导后续搜索。在所述的5项数学任务、2种框架和3个模型中,TTME 的得分均超过报告中的测试时训练结果;其中 Qwen3-8B 在3项任务上的计算量减少82.8%至84.6%,运行时间减少47.7%至58.4%。

原帖引用 · 原文

@rohanpaul_ai

– arxiv. org/abs/2610.32046

Title: "Can Test-Time Memory Evolution Outperform Test-Time Training for Scientific Discovery?"

回复Rohan Paul@rohanpaul_ai
New UC Santa Barbara paper shows that LLM math discovery can skip test-time training, since an evolving memory scored better and used far less compute. i.e. evolving memory beats test-time training on math discovery, with far less compute. Test-time training lets a model improve during a search by running RL on its own scored attempts. Those weight updates are slow and costly, so the method is hard to scale to bigger models. They built TTME, which keeps the weights fixed and stores lessons in memory. The memory holds practical coding rules from earlier tries and the ideas behind score gains, which guide later attempts. Across 5 math tasks, 2 frameworks, and 3 models, TTME beat the reported test-time training scores every time. With Qwen3-8B on 3 tasks, it used 82.8% to 84.6% fewer FLOPs and 47.7% to 58.4% less runtime than test-time training. If your LLM search loop has an automatic checker, try a memory of lessons before paying for weight updates mid-search.
在 X 查看这条帖子 ↗

来源:Rohan Paul · x.com

论文
发现内容有误?提交纠错