aifollow.news Search
Back Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · Original publication time AI score54

Meta and Carnegie Mellon study trains small models to select tools from large catalogsMachine translation

Automatically verified and published · Generated and evidence-checked automatically; not reviewed by a human.

AI introduction

A Meta and Carnegie Mellon paper describes training Qwen3 models to search for and select tools step by step. On ToolBench, the trained 8B model selected exactly the right tools 41.5% of the time, versus 30.6% for the best prompted Llama-4-Maverick setup. Without retraining, it outperformed Maverick on three of four new tool benchmarks.

Original post · Original

The article text is unavailable in this language; an existing version is shown.

@rohanpaul_ai

– https://t.co/PyGJA0Zc9L

Title: "Training Small Language Models for Transferable Tool Selection"

ReplyRohan Paul@rohanpaul_ai
New Meta and Carnegie Mellon paper finds that small models trained with RL pick the right tools more often than a prompted 402B Llama-4-Maverick. Agents can face more than 10,000 tools, and their descriptions cannot all fit in context. Retrievers only rank by relevance, so recent setups have Claude or ChatGPT pick the tools. They trained Qwen3 models to split a request into steps, search each step with plain keyword search, and pick 1 tool per step. Training used teacher-written examples, then RL that rewards useful search steps and exact picks. On ToolBench, the trained 8B model picked exactly the right tools 41.5% of the time, versus 30.6% for Maverick's best prompted setup. With no retraining, it beat Maverick on 3 of 4 new tool benchmarks and improved when given a stronger retriever. If your agent chooses from a large tool catalog, an RL-trained small model can handle selection instead of a prompted large one.
View this post on X ↗

来源:Rohan Paul · x.com

Research
Found an error? Send a correction