aifollow.news
返回 Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · 原发布时间 AI 评分54

哈佛研究:Claude Fable 5 停用期间,用户代码合并率未见明显下降

AI 导读

一项哈佛研究利用 Claude Fable 5 因美国出口管制指令停用 19 天的情况,比较了 297 名原用户与 8,908 名继续使用 Opus 4.8 的开发者。恢复使用 Fable 5 对提交后 7 天内的代码合并率仅带来 1.4 个百分点的变化,研究认为这一差异处于统计噪声范围内;此前已有 94.5% 的拉取请求获合并。

原帖引用 · 原文

@rohanpaul_ai

New Harvard paper finds that when Claude Fable 5 was suspended for 19 days, its users' pull requests got merged about as often on the weaker Opus 4.8.

A U.S. export control directive cut off Claude Fable 5 for 19 days in June 2026, and most users switched to Opus 4.8. The study tracked GitHub pull requests from 297 Fable 5 users against 8,908 developers who stayed on Opus 4.8.

Access to Fable 5 raised the 7-day merge rate by only 1.4 points, a change within noise. Across 5 other model upgrades, merge rates did not rise either, though 94.5% of pull requests were already merged beforehand.

来源:Rohan Paul · x.com

论文
发现内容有误?提交纠错