aifollow.news
返回 Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · 原发布时间 AI 评分54

UCLA 与 Northeastern University 研究发现 AI 智能体约 18% 的输出 token 可删减

AI 导读

研究人员通过代理记录智能体调用,让语言模型标出可能删去的片段,再删除并重跑任务检验结果。在 6 个前沿模型和 4 项基准测试中,约 18% 的输出 token 被判为冗余;一项针对 Kimi-K3 的实验删去 41% 的相关推理内容后,任务成功率为 89.5%,对照为 89.0%。

原帖引用 · 原文

@rohanpaul_ai

New UCLA+ Northeastern University paper finds that about 18% of AI agent output tokens are removable waste, and cutting it barely hurts task success.

Agent bills are usually measured as total tokens. That number can't tell you which tokens did useful work and which just repeated a policy, refetched a file, or went down a dead end.

They route agent calls through a proxy and have an LLM judge mark spans that can go without losing useful work. Then they delete those spans and rerun the agent to check nothing breaks.

Across 6 frontier models and 4 benchmarks, about 18% of output tokens were waste. Pruning repetition and filler from Kimi-K3's reasoning removed 41% of it on SWE-bench Verified, and success stayed at 89.5% versus 89.0%.

To cut agent costs, find where your task and harness create waste instead of just capping tokens.

来源:Rohan Paul · x.com

论文
发现内容有误?提交纠错