aifollow.news Search
Back Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · Original publication time AI score54

OO-Harness research uses task-specific configurations to improve agent workflow resultsMachine translation

Automatically verified and published · Generated and evidence-checked automatically; not reviewed by a human.

AI introduction

The research uses specialized agent configurations inherited from a shared base, selecting one based on a base run when appropriate. On AutomationBench business workflows, the method scored 77.41%, versus 61.62% for the base harness. On unfamiliar apps, it kept the base harness and achieved a 59.18% pass rate.

Original post · Original

The article text is unavailable in this language; an existing version is shown.

@rohanpaul_ai

– https://t.co/a5pElA0vu4

Title: "Object-Oriented Harness: Evolving Agent Harnesses through Object-Oriented Design"

ReplyRohan Paul@rohanpaul_ai
New Google paper shows that agents score higher when each task gets a specialized harness from a shared family, not 1 global harness. An agent harness is the prompts, tools and control code around a model. Most tuning methods evolve 1 global harness, though a fix for 1 task type can hurt another. OO-Harness evolves harnesses as code classes, and each specialist inherits from a parent and changes only what its cluster needs. A router reads a normal base run and picks a specialist or keeps the base result. On AutomationBench business workflows, it scored 77.41% versus 61.62% for the base harness and 63.92% for Meta-Harness, a global method. On unfamiliar apps, it kept the base harness and held 59.18% pass rate, while Meta-Harness's global harness fell to 44.90%. For mixed workloads, keep the base harness as a fallback and route to specialists only when a run shows a known problem.
View this post on X ↗

来源:Rohan Paul · x.com

Research
Found an error? Send a correction