aifollow.news
返回 Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · 原发布时间 AI 评分54

ReHarness 研究用任务结果修订智能体旧笔记

AI 导读

MIT 和 Meta 的 ReHarness 研究针对智能体复用过时笔记的问题:每次任务后,系统会根据笔记的使用结果缩小或修正其内容,且只使用该笔记原始任务中的事实。在 3 项基准测试、3 个模型上的平均归一化增益为 0.240,最佳原始轨迹基线为 0.168。

原帖引用 · 原文

@rohanpaul_ai

– https://t.co/4rwDdFxaAc

Title: "Recurrent Harness for Agentic Continual Learning"

回复Rohan Paul@rohanpaul_ai
New MIT and Meta paper finds that agent memory works better when old notes get corrected using what happened the next time they were used. Agents that learn on the job save notes from past tasks and reuse them. Once written, those notes rarely change, so an overly broad or outdated lesson keeps misleading the agent. After each task, ReHarness sends the retrieved notes and the result to a revision agent. It narrows or corrects each note, using only facts from that note's original task. Across 3 benchmarks and 3 frontier models, it averaged 0.240 in normalized gain, the share of possible improvement over a memoryless agent. The best raw-trajectory baseline scored 0.168, and replaying full raw history used 3.4× as many tokens on CL-Bench with Claude. If your agent learns from experience, let each outcome edit the notes that shaped it, not only add new notes.
在 X 查看这条帖子 ↗

来源:Rohan Paul · x.com

论文
发现内容有误?提交纠错