aifollow.news 搜索
返回 Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · 原发布时间 AI 评分54

Google 论文提出按任务选用专用智能体框架

自动核验发布 · 本文由系统生成并完成证据核验,未经人工审稿。

AI 导读

Google 论文介绍的 OO-Harness 让不同任务使用各自的智能体框架,并在基础框架运行后决定是否切换。材料报告称,它在 AutomationBench 业务流程测试中得分 77.41%,高于基础框架的 61.62% 和全局方法 Meta-Harness 的 63.92%;面对不熟悉的应用时,它保留基础框架,测试通过率为 59.18%。

原帖引用 · 原文

@rohanpaul_ai

New Google paper shows that agents score higher when each task gets a specialized harness from a shared family, not 1 global harness.

An agent harness is the prompts, tools and control code around a model. Most tuning methods evolve 1 global harness, though a fix for 1 task type can hurt another.

OO-Harness evolves harnesses as code classes, and each specialist inherits from a parent and changes only what its cluster needs. A router reads a normal base run and picks a specialist or keeps the base result.

On AutomationBench business workflows, it scored 77.41% versus 61.62% for the base harness and 63.92% for Meta-Harness, a global method. On unfamiliar apps, it kept the base harness and held 59.18% pass rate, while Meta-Harness's global harness fell to 44.90%.

For mixed workloads, keep the base harness as a fallback and route to specialists only when a run shows a known problem.

来源:Rohan Paul · x.com

论文
发现内容有误?提交纠错