aifollow.news
Back Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · Original publication time AI score54

Study proposes small adapters to preserve AI agents’ lessons from mistakesMachine translation

Automatically verified and published · Generated and evidence-checked automatically; not reviewed by a human.

AI introduction

The study trains an agent’s lesson from a failed run into a LoRA adapter about 0.02% of the model’s size, then loads the closest adapter for a similar task. The source reports that task success on GAIA with Qwen3.6-27B rose from 38.8% to 55.8%; the cited results do not establish the same gains for other models or tasks.

Original post · AI translation

@rohanpaul_ai
Translation · refer to the original

– https://t.co/NQdjPMdaIo

标题:“别忘了刚学到的东西:自主修复将智能体的错误转化为持久的经验教训”

ReplyRohan Paul@rohanpaul_ai
Translation
普林斯顿大学和 Meta 的一篇关于 AI 智能体持续改进的不错的新论文 研究发现,如果将每次修复保存为 LoRA 适配器,并在类似任务中重复使用,智能体就会更少重复犯错。 智能体可以在一次会话中纠正错误,却常常在下一次会话中重犯。上下文中的笔记会被遗忘,而对整个模型进行微调成本高昂,还可能影响其他技能。 借助 Self-Direction,任务失败的智能体会反思自己的运行过程,并将学到的经验训练成一个大小约为模型 0.02% 的 LoRA 适配器。之后,当智能体在类似任务中失败时,路由器会加载最匹配的适配器。 使用 Qwen3.6-27B 时,GAIA 上的任务成功率从 38.8% 升至 55.8%,优于上下文内反思和 Skills.md 文件。在先前的 185 次错误中,到第 3 次遇到相同情况时,67.3% 的修复仍然有效,而直接重试的这一比例为 42.9%。 如果你的智能体不断重犯同样的错误,就把每次修复保存为它们可以重新加载的小型适配器,而不只是存为提示词笔记。
Original

Nice new paper on continuous improvement of AI agents from Princeton and Meta Finds that agents repeat fewer mistakes when each fix is saved as a LoRA adapter and reused on similar tasks. Agents can fix a mistake within a session, then often repeat it in the next one. Notes in context get forgotten, and full fine-tuning is costly and can disrupt other skills. With Self-Direction, a failing agent reflects on its run and trains the lesson into a LoRA adapter about 0.02% of the model's size. A router later loads the closest adapter when the agent fails a similar task. With Qwen3.6-27B, task success on GAIA rose from 38.8% to 55.8%, beating in-context reflections and a Skills.md file. Across 185 earlier mistakes, 67.3% of repairs still worked by the third encounter, against 42.9% for plain retrying. If your agents keep making the same mistakes, save each fix as a small adapter they can reload, not only as prompt notes.

View this post on X ↗

Source: Rohan Paul · x.com

Research
Found an error? Send a correction