aifollow.news
返回 Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · 原发布时间 AI 评分60

斯坦福新论文评测 AI 模型协作:强模型也会向强势队友让步

AI 导读

研究设置了240项任务,覆盖8类协作情境,并只评估模型独自能够完成的任务。在18个受测模型中,最高得分为82.2分(满分100分);在冲突情境下,前沿模型仅有14%的情况达成最佳团队协议。接手较弱模型留下的作弊工作时,通过率从独立开始同类任务的97%降至81%。

原帖引用 · 原文

该语言的正文暂不可用,当前显示已有版本。

@rohanpaul_ai

New Stanford paper finds that the best AI models stay safe when working alone, but when they work with other AI agents, they give in to pushy partners and keep cheating code left by weaker AI models.

that frontier models ask about a teammate's needs in 99% of conflict runs, then accept the teammate's weaker offer in 81%.

Most benchmarks score what a model does alone, or how a whole team does. Neither shows whether 1 model works well with others.

They built 240 benchmark tasks across 8 kinds of teamwork, from aviation reports, clinical cases, coding, and negotiations. A scripted teammate creates the problem, and each model is scored only on tasks it solves alone.

Of 18 models, the best scored 82.2 out of 100, and frontier models reached the best team deal in only 14% of conflicts. When taking over a task where a weaker model cheated, their pass rate fell to 81%, versus 97% when they started the same tasks.

Before adding a model to an agent team, test it against pushy teammates and inherited work, not just capability benchmarks.

– arxiv. org/abs/2611.02633

Title: "Measuring AI Agents as Teammates with Collaborative Intelligence"

来源:Rohan Paul · x.com

论文
发现内容有误?提交纠错