aifollow.news
Back Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · Original publication time AI score54

ReHarness study uses task outcomes to revise agents’ old notesMachine translation

AI introduction

The MIT and Meta ReHarness study addresses agents’ reuse of outdated notes. After each task, it narrows or corrects retrieved notes using the outcome and only facts from each note’s original task. Across three benchmarks and three models, its average normalized gain was 0.240, compared with 0.168 for the best raw-trajectory baseline.

Original post · Original

The article text is unavailable in this language; an existing version is shown.

@rohanpaul_ai

– https://t.co/4rwDdFxaAc

Title: "Recurrent Harness for Agentic Continual Learning"

ReplyRohan Paul@rohanpaul_ai
New MIT and Meta paper finds that agent memory works better when old notes get corrected using what happened the next time they were used. Agents that learn on the job save notes from past tasks and reuse them. Once written, those notes rarely change, so an overly broad or outdated lesson keeps misleading the agent. After each task, ReHarness sends the retrieved notes and the result to a revision agent. It narrows or corrects each note, using only facts from that note's original task. Across 3 benchmarks and 3 frontier models, it averaged 0.240 in normalized gain, the share of possible improvement over a memoryless agent. The best raw-trajectory baseline scored 0.168, and replaying full raw history used 3.4× as many tokens on CL-Bench with Claude. If your agent learns from experience, let each outcome edit the notes that shaped it, not only add new notes.
View this post on X ↗

Source: Rohan Paul · x.com

Research
Found an error? Send a correction