原帖引用 · AI 翻译
标题:“路由式持续学习”
Meta 的一篇新论文发现,当每个新问题都能匹配到类似问题的笔记,而不是使用一份记录所有过往操作的共享记录时,AI 智能体能从过去的尝试中获得更多提升。
让智能体从过去的运行中学习,一个简单的方法是使用一份共享历史记录。但面对混合任务,这种方法成本会变高,还会混入不相关的经验。
Routed CL 增加了一个 LLM 路由器,在每次运行前决定复用一个记忆簇,还是新建一个。每个记忆簇使用 5 种记忆类型中的 1 种,例如原始的过往运行记录或提炼出的经验。
在 398 道混合问题和 4 个模型上的测试中,共享历史记录的表现仅略好于无记忆,平均提升为 0.015(满分 1)。Routed CL 比共享历史记录高出最高可能得分的 15% 至 30%,并将估算的 API 成本降低了 65% 至 72%。
如果你的智能体处理多种类型的任务,就按问题类型将其记忆分成独立的存储池,而不是共用一份历史记录。
原文
New Meta paper finds that AI agents improve more from their past attempts when each new problem is matched to notes from similar problems, instead of one shared record of everything they have done. A simple way to let agents learn from past runs is one shared history. With mixed tasks, it gets costly and mixes unrelated experience. Routed CL adds an LLM router that reuses a memory cluster or starts a new one before each run. Each cluster uses 1 of 5 memory types, such as raw past runs or distilled lessons. Across 398 mixed problems and 4 models, the shared history barely beat no memory, with a mean gain of 0.015 out of 1. Routed CL beat it by 15% to 30% of the maximum possible score and cut estimated API cost by 65% to 72%. If your agents handle mixed task types, split their memory into separate pools by problem type instead of sharing one history.