Original post · Original
Rohan Paul@rohanpaul_ai
Title: "Can We Make an LLM Dumber, or Is It Just Playing Dumb? An Empirical Study of Believable Performance Throttling"
This paper finds that a low benchmark score can be manufactured precisely, so a low score alone says little about what a model can do.
Safety tests often read a low score on a dangerous-capability probe as reassurance. But a low score can come from a model being held back, so the number alone proves little.
They trained a LoRA "dial" that pulls a Qwen model toward a smaller Qwen model, then compared its errors with the real small model's. They also tried prompting models to underperform, raising temperature, and adding weight noise.
The dial hit unseen target scores within 1.9 points, while prompting missed by 42 to 47 points. But on multiple choice, up to 97% of its new errors landed on 1 letter, a share no natural model in their pool approached.
Before reading a low score as low capability, check which items the model fails and how its wrong answers are spread.
View this post on X ↗
· UTC+8