Original post · Original
The article text is unavailable in this language; an existing version is shown.
New Microsoft paper finds that LLMs give up correct answers when challenged with wrong arguments, and accuracy training does not fix it.
When a user or another agent disputes an answer, models often abandon correct answers even when the challenge is wrong. More accuracy training, more sampling, or self-reflection does not fix it.
Self-Disagreement trains one model to state an answer, write the strongest case against it, then rule on that case and answer again. A standard answer checker rewards the final answer and the ruling.
When challengers were wrong, base Qwen3-8B kept its correct answer 53.3% of the time and Gemma-2 9B 25.1%. After training, both kept it about 89% of the time, while accuracy-only training added no such skill.
If your model faces pushback from users or other agents, test how often it drops correct answers, since accuracy scores will not show it.