aifollow.news
Back Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · Original publication time SelectedAI score61

Study reports Qwen3.5-27B can edit its own weights through reasoningMachine translation

AI introduction

Researchers gave Qwen3.5-27B access to its weights and graded practice answers in a Python session with gradients blocked. The account says its edit raised accuracy from 57.2% to 63.8% on 490 unseen problems in a test fixed in advance; the 2B model made no edit, while the 4B and 9B models broke themselves.

Original post · Original

@rohanpaul_ai

New Stanford+other top labs paper finds that a 27B open model can improve itself by editing its own weights through reasoning, with no training or gradients.

Improving a deployed model today means another training run on large clusters. Prompts and extra inference compute help, but the gain disappears once the task ends.

They gave Qwen3.5-27B its own weights, its graded practice answers, and a Python session, with gradients blocked. It compared its hidden states on answers that finished against answers that ran out of tokens, then weakened the direction separating them.

Its own edit raised accuracy from 57.2% to 63.8% on 490 unseen problems, in a test fixed in advance. The 2B model made no edit, and the 4B and 9B models broke themselves.

If you run a large open model, let it propose weight edits for its own failures, but keep only edits that pass held-out tests.

Source: Rohan Paul · x.com

Research
Found an error? Send a correction