aifollow.news
Back Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · Original publication time AI score54

Study Uses LoRA to Lower Qwen Benchmark Scores, but Error Patterns Reveal AnomaliesMachine translation

AI introduction

Researchers trained a LoRA “dial” to make a Qwen model perform like a smaller Qwen model and compared their errors. It came within 1.9 points of unseen target scores, but up to 97% of its new multiple-choice errors fell on one answer letter. The study cautions that a low score alone says little about a model’s capabilities.

Original post · Original

@rohanpaul_ai

– https://t.co/nJ0aryp1NH

Title: "Can We Make an LLM Dumber, or Is It Just Playing Dumb? An Empirical Study of Believable Performance Throttling"

ReplyRohan Paul@rohanpaul_ai
This paper finds that a low benchmark score can be manufactured precisely, so a low score alone says little about what a model can do. Safety tests often read a low score on a dangerous-capability probe as reassurance. But a low score can come from a model being held back, so the number alone proves little. They trained a LoRA "dial" that pulls a Qwen model toward a smaller Qwen model, then compared its errors with the real small model's. They also tried prompting models to underperform, raising temperature, and adding weight noise. The dial hit unseen target scores within 1.9 points, while prompting missed by 42 to 47 points. But on multiple choice, up to 97% of its new errors landed on 1 letter, a share no natural model in their pool approached. Before reading a low score as low capability, check which items the model fails and how its wrong answers are spread.
View this post on X ↗

Source: Rohan Paul · x.com

Research
Found an error? Send a correction