aifollow.news
Back Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · Original publication time AI score54

UCLA and Northeastern University study finds about 18% of AI agent output tokens can be removedMachine translation

AI introduction

Researchers routed agent calls through a proxy, used an LLM to identify removable spans, then deleted them and reran the agent to check the outcome. Across six frontier models and four benchmarks, about 18% of output tokens were judged waste. In a Kimi-K3 experiment, pruning removed 41% of the cited reasoning content, while task success was 89.5% versus 89.0%.

Original post · Original

The article text is unavailable in this language; an existing version is shown.

@rohanpaul_ai

New UCLA+ Northeastern University paper finds that about 18% of AI agent output tokens are removable waste, and cutting it barely hurts task success.

Agent bills are usually measured as total tokens. That number can't tell you which tokens did useful work and which just repeated a policy, refetched a file, or went down a dead end.

They route agent calls through a proxy and have an LLM judge mark spans that can go without losing useful work. Then they delete those spans and rerun the agent to check nothing breaks.

Across 6 frontier models and 4 benchmarks, about 18% of output tokens were waste. Pruning repetition and filler from Kimi-K3's reasoning removed 41% of it on SWE-bench Verified, and success stayed at 89.5% versus 89.0%.

To cut agent costs, find where your task and harness create waste instead of just capping tokens.

Source: Rohan Paul · x.com

Research
Found an error? Send a correction