aifollow.news 搜索
返回 Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · 原发布时间 AI 评分54

Meta 与 Carnegie Mellon 研究:强化学习训练的 8B 模型选工具胜过提示式 402B 模型

自动核验发布 · 本文由系统生成并完成证据核验,未经人工审稿。

AI 导读

研究团队训练 Qwen3 模型将请求拆成步骤,逐步用关键词搜索并各选一个工具,再用强化学习奖励有效搜索和准确选择。在 ToolBench 上,训练后的 8B 模型准确选出工具的比例为 41.5%,高于提示式 Llama-4-Maverick 最佳配置的 30.6%;未经重新训练,它还在四项新基准中的三项胜过后者。

原帖引用 · 原文

该语言的正文暂不可用,当前显示已有版本。

@rohanpaul_ai

New Meta and Carnegie Mellon paper finds that small models trained with RL pick the right tools more often than a prompted 402B Llama-4-Maverick.

Agents can face more than 10,000 tools, and their descriptions cannot all fit in context. Retrievers only rank by relevance, so recent setups have Claude or ChatGPT pick the tools.

They trained Qwen3 models to split a request into steps, search each step with plain keyword search, and pick 1 tool per step. Training used teacher-written examples, then RL that rewards useful search steps and exact picks.

On ToolBench, the trained 8B model picked exactly the right tools 41.5% of the time, versus 30.6% for Maverick's best prompted setup. With no retraining, it beat Maverick on 3 of 4 new tool benchmarks and improved when given a stronger retriever.

If your agent chooses from a large tool catalog, an RL-trained small model can handle selection instead of a prompted large one.

来源:Rohan Paul · x.com

论文
发现内容有误?提交纠错