Event · Release
Microsoft
New Microsoft paper finds that LLMs give up correct answers when challenged with wrong arguments, and accuracy training
微软发布了一篇论文,指出大型语言模型在面对错误论点的质疑时可能放弃正确答案,而仅靠准确率训练无法解决这一问题。
1 reports1 sources
Reports 1
Rohan Paul (@rohanpaul_ai)
Machine translation
Microsoft paper proposes Self-Disagreement training to help models hold on to correct answers under false challenges
A new Microsoft paper finds that models often abandon correct answers when challenged by a wrong argument, and accuracy training alone does not fix the problem. Its Self-Disagreement method has a model answer, argue against itself, then judge the argument. When challengers were wrong, Qwen3-8B and Gemma-2 9B kept their correct answers about 89% of the time after training, up from 53.3% and 25.1%, respectively.