aifollow.news
返回 Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · 原发布时间 AI 评分54

Google 与 Penn State 研究用修改记录帮助 AI 代理适配新模型

AI 导读

Google 与 Penn State 的论文提出 Self-Improvement Memory(SIM):记录 AI 修改代理提示词和工具运行代码时针对的问题、理由及结果,供切换模型后判断哪些修改值得保留。在文中报告的工作区任务中,切换后的得分为 84.75;没有记录时为 73.42。

原帖引用 · 原文

@rohanpaul_ai

New Google and Penn State paper finds that when one AI rewrites the code that gives another AI its instructions and tools, keeping notes on why each change was made helps the gains carry over to a new model.

LLMs can now rewrite an agent's harness, the code that runs prompts and tools. After a model or benchmark switch, it can score below the original, and its code hides why edits were made.

Self-Improvement Memory, or SIM, logs each edit with the problem it targeted, its reasoning and its measured result. The optimizer reads this log on the new setup to decide which old edits to keep or revise.

When a Claude Opus 5.5 harness moved to Gemini 3.8 Flash workspace tasks, SIM lifted it from 68.41 to 84.75, versus 73.42 without the log. Across 10 repeated coding runs, SIM finished ahead 9 times, by 2.36 points on average.

Store why each harness edit was made and how it scored, and carry that log to new models.

来源:Rohan Paul · x.com

论文
发现内容有误?提交纠错