aifollow.news 搜索
返回 Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · 原发布时间 AI 评分54

OO-Harness 研究用任务专属配置提升智能体工作流表现

自动核验发布 · 本文由系统生成并完成证据核验,未经人工审稿。

AI 导读

这项研究让不同任务使用从共同基础继承的专属智能体配置,并根据基础运行结果决定是否切换。在 AutomationBench 商业工作流测试中,该方法得分为 77.41%,基础配置为 61.62%;面对陌生应用时,它保留基础配置,取得 59.18% 的通过率。

原帖引用 · 原文

该语言的正文暂不可用,当前显示已有版本。

@rohanpaul_ai

– https://t.co/a5pElA0vu4

Title: "Object-Oriented Harness: Evolving Agent Harnesses through Object-Oriented Design"

回复Rohan Paul@rohanpaul_ai
New Google paper shows that agents score higher when each task gets a specialized harness from a shared family, not 1 global harness. An agent harness is the prompts, tools and control code around a model. Most tuning methods evolve 1 global harness, though a fix for 1 task type can hurt another. OO-Harness evolves harnesses as code classes, and each specialist inherits from a parent and changes only what its cluster needs. A router reads a normal base run and picks a specialist or keeps the base result. On AutomationBench business workflows, it scored 77.41% versus 61.62% for the base harness and 63.92% for Meta-Harness, a global method. On unfamiliar apps, it kept the base harness and held 59.18% pass rate, while Meta-Harness's global harness fell to 44.90%. For mixed workloads, keep the base harness as a fallback and route to specialists only when a run shows a known problem.
在 X 查看这条帖子 ↗

来源:Rohan Paul · x.com

论文
发现内容有误?提交纠错