aifollow.news
Back Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · Original publication time AI score54

Meta paper proposes routing agent memory by problem type to improve reuse of past attemptsMachine translation

AI introduction

The study uses an LLM router to select an existing memory cluster or start a new one before each run. Across 398 mixed problems and four models, a shared history scored only 0.015 points higher on average than no memory on a one-point scale. Compared with shared history, Routed CL gained 15% to 30% of the maximum possible score and reduced estimated API costs by 65% to 72%.

Original post · Original

@rohanpaul_ai

New Meta paper finds that AI agents improve more from their past attempts when each new problem is matched to notes from similar problems, instead of one shared record of everything they have done.

A simple way to let agents learn from past runs is one shared history. With mixed tasks, it gets costly and mixes unrelated experience.

Routed CL adds an LLM router that reuses a memory cluster or starts a new one before each run. Each cluster uses 1 of 5 memory types, such as raw past runs or distilled lessons.

Across 398 mixed problems and 4 models, the shared history barely beat no memory, with a mean gain of 0.015 out of 1. Routed CL beat it by 15% to 30% of the maximum possible score and cut estimated API cost by 65% to 72%.

If your agents handle mixed task types, split their memory into separate pools by problem type instead of sharing one history.

Source: Rohan Paul · x.com

Research
Found an error? Send a correction