aifollow.news
Back Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · Original publication time AI score54

Google and Penn State study uses edit logs to help AI agents adapt to a new modelMachine translation

AI introduction

A Google and Penn State paper proposes Self-Improvement Memory (SIM), which logs the problem, reasoning and measured result behind each AI-made change to the code that runs an agent’s prompts and tools. After a model switch, the optimizer uses the log to decide which edits to keep or revise. In the reported workspace tasks, the switched setup scored 84.75 with SIM, versus 73.42 without the log.

Original post · Original

The article text is unavailable in this language; an existing version is shown.

@rohanpaul_ai

New Google and Penn State paper finds that when one AI rewrites the code that gives another AI its instructions and tools, keeping notes on why each change was made helps the gains carry over to a new model.

LLMs can now rewrite an agent's harness, the code that runs prompts and tools. After a model or benchmark switch, it can score below the original, and its code hides why edits were made.

Self-Improvement Memory, or SIM, logs each edit with the problem it targeted, its reasoning and its measured result. The optimizer reads this log on the new setup to decide which old edits to keep or revise.

When a Claude Opus 5.5 harness moved to Gemini 3.8 Flash workspace tasks, SIM lifted it from 68.41 to 84.75, versus 73.42 without the log. Across 10 repeated coding runs, SIM finished ahead 9 times, by 2.36 points on average.

Store why each harness edit was made and how it scored, and carry that log to new models.

Source: Rohan Paul · x.com

Research
Found an error? Send a correction