aifollow.news
返回 Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · 原发布时间 AI 评分54

MIT 与 Meta 论文提出用任务结果修正 AI 智能体的旧笔记

AI 导读

ReHarness 在每次任务后,让修订智能体依据检索到的笔记和任务结果,缩小或纠正旧笔记的适用范围,且只使用笔记原始任务中的事实。在三个基准和三个前沿模型上,其平均归一化增益为 0.240,最佳原始轨迹基线为 0.168。

原帖引用 · 原文

@rohanpaul_ai

New MIT and Meta paper finds that agent memory works better when old notes get corrected using what happened the next time they were used.

Agents that learn on the job save notes from past tasks and reuse them. Once written, those notes rarely change, so an overly broad or outdated lesson keeps misleading the agent.

After each task, ReHarness sends the retrieved notes and the result to a revision agent. It narrows or corrects each note, using only facts from that note's original task.

Across 3 benchmarks and 3 frontier models, it averaged 0.240 in normalized gain, the share of possible improvement over a memoryless agent. The best raw-trajectory baseline scored 0.168, and replaying full raw history used 3.4× as many tokens on CL-Bench with Claude.

If your agent learns from experience, let each outcome edit the notes that shaped it, not only add new notes.

来源:Rohan Paul · x.com

论文
发现内容有误?提交纠错