aifollow.news
Back Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · Original publication time AI score54

Harvard study finds no clear drop in code merge rates during Claude Fable 5 suspensionMachine translation

AI introduction

A Harvard study examined a 19-day suspension of Claude Fable 5 under a U.S. export control directive, comparing 297 former users with 8,908 developers who remained on Opus 4.8. Access to Fable 5 raised the seven-day pull-request merge rate by just 1.4 percentage points, a change the study describes as within noise; 94.5% of pull requests had already been merged beforehand.

Original post · Original

@rohanpaul_ai

New Harvard paper finds that when Claude Fable 5 was suspended for 19 days, its users' pull requests got merged about as often on the weaker Opus 4.8.

A U.S. export control directive cut off Claude Fable 5 for 19 days in June 2026, and most users switched to Opus 4.8. The study tracked GitHub pull requests from 297 Fable 5 users against 8,908 developers who stayed on Opus 4.8.

Access to Fable 5 raised the 7-day merge rate by only 1.4 points, a change within noise. Across 5 other model upgrades, merge rates did not rise either, though 94.5% of pull requests were already merged beforehand.

Source: Rohan Paul · x.com

Research
Found an error? Send a correction