aifollow.news
Back Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · Original publication time AI score60

METR publishes an assessment using Anthropic's internal information on whether AI is accelerating model developmentMachine translation

AI introduction

METR says its team has used internal Anthropic information since August to assess whether AI is accelerating AI development, and has published a report on the risk assessment. A post citing the report says Anthropic is improving its models at about twice its 2024–2025 pace and that METR attributes about 80% of the current acceleration to Anthropic's own AI use. The post also says Anthropic redacted most of the evidence METR found most telling.

Original post · Original

The article text is unavailable in this language; an existing version is shown.

@rohanpaul_ai

https://t.co/SXYz4UztEW

ReplyRohan Paul@rohanpaul_ai
So much revelation from METR's latest report. Recursive self-improvement (RSI) at Anthropic has moved from theory to solid measurement, and the early loop already runs at about 2x. After they spent 11 weeks going through Anthropic’s internal R&D data and interviewing its key researchers. > Anthropic is now improving its models at about twice its 2024 to 2025 pace. > Claude itself is the main engine. METR’s best guess puts about 80% of current acceleration on Anthropic’s own AI use, and it rules out faster growth in training compute as the cause. > Anthropic’s own public August risk report understated how fast things were moving. METR reached that conclusion in a separate review that compared the public report with the private version and other nonpublic data. > METR saw nothing likely to slow this loop within 12 months, with no bottleneck in algorithms, compute or data. Redacted evidence also hints that acceleration may already exceed 2x and keep climbing. > Staff self-report roughly 12x productivity gains from Model 4, and researchers see “signs of life” for AI doing key training work alone. One called Mythos Preview the first model useful for autonomous experiments. > Anthropic redacted most of the evidence METR found most telling, saying it could help rivals go faster. It also canceled midway a planned check of how its compute splits between capabilities and safety.
View this post on X ↗
Related contextMETR@METR_Evals
Since August, a team within METR has worked with internal Anthropic information to assess whether AI itself is accelerating AI development. We are now publishing a report summarizing the results of this risk assessment.
View this post on X ↗

Source: Rohan Paul · x.com

Research
Found an error? Send a correction