aifollow.news 搜索
返回 Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · 原发布时间 AI 评分54

Google DeepMind 论文发现:AI 模型自行随机选择时会偏向特定答案

自动核验发布 · 本文由系统生成并完成证据核验,未经人工审稿。

AI 导读

研究让 Gemini、Qwen3 和 OLMo 模型各采样 1024 次;报告中的统计检验均未显示结果符合目标概率,调整温度或 top-p 也未解决问题。在一项安全博弈中,模型的选择使攻击者胜率达到 96.6% 至 99.9%,而真正随机检查时为 75%。给模型提供程序生成的随机数后,较大的模型能正确据此选择。

原帖引用 · 原文

@rohanpaul_ai

New Google DeepMind paper finds that AI models cannot make truly random choices on their own, but larger models pick correctly when a computer program gives them a random number first.

Agents often need to pick actions at random with set odds, like checking servers in an unpredictable order. LLMs say they will pick uniformly, then keep landing on favorites like 7, 42, or answer C.

They asked Gemini, Qwen3, and OLMo models to sample from simple distributions 1024 times each. They also tried other temperature and sampling settings, and gave models a random number to convert.

Every reported statistical test for matching the target odds failed, and changing temperature or top-p did not fix it. In a security game where truly random checks let attackers win 75% of the time, Gemini's picks let them win 96.6% to 99.9%.

If your agent needs randomness, generate it in code and pass it in, instead of asking the model to be random.

来源:Rohan Paul · x.com

论文
发现内容有误?提交纠错