aifollow.news Search
Back Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · Original publication time AI score54

Google DeepMind paper finds AI models favor certain answers when asked to choose randomlyMachine translation

Automatically verified and published · Generated and evidence-checked automatically; not reviewed by a human.

AI introduction

Researchers tested Gemini, Qwen3, and OLMo models with 1,024 samples each. Every reported statistical test failed to show that their choices matched the target odds, and changing temperature or top-p did not fix the problem. In a security game, the models' choices let attackers win 96.6% to 99.9% of the time, compared with 75% for truly random checks. Larger models picked correctly when first given a random number generated by a computer program.

Original post · Original

The article text is unavailable in this language; an existing version is shown.

@rohanpaul_ai

New Google DeepMind paper finds that AI models cannot make truly random choices on their own, but larger models pick correctly when a computer program gives them a random number first.

Agents often need to pick actions at random with set odds, like checking servers in an unpredictable order. LLMs say they will pick uniformly, then keep landing on favorites like 7, 42, or answer C.

They asked Gemini, Qwen3, and OLMo models to sample from simple distributions 1024 times each. They also tried other temperature and sampling settings, and gave models a random number to convert.

Every reported statistical test for matching the target odds failed, and changing temperature or top-p did not fix it. In a security game where truly random checks let attackers win 75% of the time, Gemini's picks let them win 96.6% to 99.9%.

If your agent needs randomness, generate it in code and pass it in, instead of asking the model to be random.

Source: Rohan Paul · x.com

Research
Found an error? Send a correction