aifollow.news
← News
Event · Release Microsoft

New Microsoft paper finds that LLMs give up correct answers when challenged with wrong arguments, and accuracy training

微软发布了一篇论文,指出大型语言模型在面对错误论点的质疑时可能放弃正确答案,而仅靠准确率训练无法解决这一问题。

1 reports1 sources

Reports 1

Rohan Paul (@rohanpaul_ai) Machine translation

Microsoft paper proposes Self-Disagreement training to help models hold on to correct answers under false challenges

A new Microsoft paper finds that models often abandon correct answers when challenged by a wrong argument, and accuracy training alone does not fix the problem. Its Self-Disagreement method has a model answer, argue against itself, then judge the argument. When challengers were wrong, Qwen3-8B and Gemma-2 9B kept their correct answers about 89% of the time after training, up from 53.3% and 25.1%, respectively.

SourceRohan Paul (@rohanpaul_ai) ↗