aifollow.news
返回 Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · 原发布时间 AI 评分54

Northwestern 与 Google 论文提出可按任务自我改进的智能体配置方法

AI 导读

研究中的 Harness2 会先运行智能体,再让编辑模型修改其提示词、工具、技能和记忆配置,通过重新运行任务筛选有效改动,并把经验存入库中供后续任务参考。材料称,单次改进使 GLM-5 在 WorkBuddy-Bench 上提高 11.5 分;缺少测试运行的配置修改则使编码得分从 73.4 降至 63.2。

原帖引用 · 原文

@rohanpaul_ai

New Northwestern and Google paper shows that agent harnesses can improve themselves on new tasks without answer keys, by test-running edits and keeping what helps.

An agent's harness is the prompts, tools, skills, and memory wrapped around the model. Tuning it by hand is slow, and new real-world tasks come with no answer key to tune against.

Harness2 runs the agent, has an editor model propose harness fixes, then reruns the task to see which fixes improved the agent's behavior. Lessons from each task go into a library that guides edits on the next one.

A single improvement step raised GLM-5's WorkBuddy-Bench score by 11.5 points, past Gemini 3.5 Flash on its stock harness. Editing the harness without those test runs instead dropped coding scores from 73.4 to 63.2.

Treat your agent's harness as something to revise per task, and keep only the edits that change its behavior on real runs.

来源:Rohan Paul · x.com

论文
发现内容有误?提交纠错