aifollow.news
Back Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · Original publication time AI score54

Oxford study finds AI agents built on different models struggle to coordinate over unstated rulesMachine translation

AI introduction

Researchers tested text and code agents built on models including GPT-5.2 and Gemini 3 Pro in nine small cooperative games. In one game, text agents paired with other models scored below a safe option worth five points; a short shared statement of coordination principles led agents to reliably choose that option.

Original post · Original

@rohanpaul_ai

New Oxford paper finds that frontier LLM agents fail to coordinate with unfamiliar partners because each one treats its own made-up rules (arbitrary convention) as the obvious choice.

Agents from different companies increasingly must work together with no agreed rules. Past studies used shared scaffolding or complex games that hide why coordination fails.

They tested text and code agents built on models like GPT-5.2 and Gemini 3 Pro in 9 small cooperative games. In Cat & Dog, a safe move guarantees 5 points, while a signal convention pays 10 only if both agents pick the same one.

Paired with other models, text agents scored well below that safe 5, each calling its own arbitrary convention natural. A short shared statement of coordination principles, called a Coordination-friendly definition, led agents to reliably take the safe 5.

If your agent must work with agents you did not build, tell it to avoid unstated conventions and prefer actions any partner reads correctly.

Source: Rohan Paul · x.com

Research
Found an error? Send a correction