aifollow.news 搜索
返回 Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · 原发布时间 AI 评分54

Google DeepMind 论文提出用竞价决定哪个 AI 模型回答问题

自动核验发布 · 本文由系统生成并完成证据核验,未经人工审稿。

AI 导读

当无法预先判断哪个模型最适合新问题时,论文提出让模型为回答机会出价,由最高出价者作答。在 110 个模型、超过 3 万条 EmbedLLM 提示词的模拟中,这种方式达到理论最佳价值的 99.2%,但结论面向有多个强模型参与的竞价池。

原帖引用 · 原文

该语言的正文暂不可用,当前显示已有版本。

@rohanpaul_ai

New Google DeepMind paper shows that if AI models offer money to answer each question and the highest offer answers, results are 99.2% as good as always picking the best model.

i.e. say you don't know in advance which model is best for each new question. So who should answer?

The paper’s answer: let each model offer money for the job. The model that knows it is good at this question offers more. Highest offer gets to answer.

They proved the loss shrinks when several agents usually value a prompt highly, as when distilled models perform close to the best. They simulated auctions among 110 models on over 30,000 EmbedLLM prompts.

With all 110 models bidding, the auction reached 99.2% of the best possible value, versus 89.4% for routing each prompt type to its best model. On each method's worst prompt cluster, the auction held 96.0% while the single best model kept 6.0%.

If you run a model marketplace, a simple pay-your-bid auction works well when every bidding pool has several strong models.

来源:Rohan Paul · x.com

论文
发现内容有误?提交纠错