aifollow.news Search
Back Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · Original publication time AI score54

Princeton paper studies agents built by multiple developers, reporting 70% accuracy on GAIAMachine translation

Automatically verified and published · Generated and evidence-checked automatically; not reviewed by a human.

AI introduction

The study simulated developers building agents under a fixed budget, then split tasks among agents built by different developers. With the same total development budget, specialists scoring at most 35% individually reached 70% together on GAIA. On the web-search-only SealQA benchmark, the combined system performed worse at higher cost.

Original post · Original

The article text is unavailable in this language; an existing version is shown.

@rohanpaul_ai

– https://t.co/XVOZZFYVtZ

Title: "The Wealth of Agents: Scaling Agentic AI Across Developers"

ReplyRohan Paul@rohanpaul_ai
New Princeton paper finds that combining specialized agents from many developers can beat any single developer's general agent, with GAIA accuracy reaching 70%. Today most agentic systems are built and controlled by 1 developer, so each team rebuilds the same basic skills. The authors argue this limits scale. They simulated populations of developers with LLM agents that build agents under a fixed budget, then compared lone systems with a multi-developer system. The multi-developer system splits each task and routes the parts to different developers' agents. On GAIA with the same total development budget, specialists that each scored at most 35% alone reached 70% together. That is 12 points above the median general agent, while on web-search-only SealQA the combined system did worse at higher cost. Build agents to fill gaps in shared systems, since an agent scoring 19% alone lifted a combined system from 40% to 53%.
View this post on X ↗

来源:Rohan Paul · x.com

Research
Found an error? Send a correction