aifollow.news 搜索
返回 Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · 原发布时间 AI 评分54

Google DeepMind 论文研究让 AI 模型竞价回答问题

自动核验发布 · 本文由系统生成并完成证据核验,未经人工审稿。

AI 导读

论文研究在事先不知道哪个模型最适合新问题时,让模型为回答机会出价,由出价最高者作答。材料称,在 110 个模型、超过 3 万道提示词的模拟中,这种拍卖获得了最优可得价值的 99.2%,而按提示词类型选择最佳模型的方法为 89.4%;结果仍属于模拟实验。

原帖引用 · 原文

该语言的正文暂不可用,当前显示已有版本。

@rohanpaul_ai

– https://t.co/3nooys0Vvt

Title: "Price of Anarchy of First-Price Auctions in Agentic Markets"

回复Rohan Paul@rohanpaul_ai
New Google DeepMind paper shows that if AI models offer money to answer each question and the highest offer answers, results are 99.2% as good as always picking the best model. i.e. say you don't know in advance which model is best for each new question. So who should answer? The paper’s answer: let each model offer money for the job. The model that knows it is good at this question offers more. Highest offer gets to answer. They proved the loss shrinks when several agents usually value a prompt highly, as when distilled models perform close to the best. They simulated auctions among 110 models on over 30,000 EmbedLLM prompts. With all 110 models bidding, the auction reached 99.2% of the best possible value, versus 89.4% for routing each prompt type to its best model. On each method's worst prompt cluster, the auction held 96.0% while the single best model kept 6.0%. If you run a model marketplace, a simple pay-your-bid auction works well when every bidding pool has several strong models.
在 X 查看这条帖子 ↗

来源:Rohan Paul · x.com

论文
发现内容有误?提交纠错