aifollow.news
返回 Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · 原发布时间 AI 评分54

帖子称 GPT-6 Astra 直接修改 Qwen3.5-0.8B 权重,数学题得分上升

AI 导读

一则转述研究的帖子称,GPT-6 Astra 在不训练模型的情况下,修改了 Qwen3.5-0.8B 约 0.016% 的权重,使其 MATH-500 得分从 7.9% 升至 48.1%。帖子称,修改针对的是导致模型反复输出、直到触及长度限制的内部信号;这些结果仍是帖文中的说法。

原帖引用 · 原文

@rohanpaul_ai

@jcamdr70 yes, great point

回复jcamdr@jcamdr70
Editing mind instead of make it learns. AI are not black box for AI anymore.
在 X 查看这条帖子 ↗
相关上下文Rohan Paul@rohanpaul_ai
MASSIVE. MIT researchers showed that GPT-6 Astra can improve another AI model by changing its weights directly, without training. Here, GPT-6 Astra raised Qwen3.5-0.8B from 7.9% to 48.1% on MATH-500 by editing 0.016% of its weights, without training. Astra got Qwen’s weights in a Python notebook, plus a budget of 50 test runs on practice math problems. It saw the model kept repeating itself until it hit its length limit, traced that habit to a single internal signal written by 2 of its layers, and subtracted that signal out of the weights. With the loop gone, the model could finish answers it was already capable of solving. That single targeted edit changed 0.016% of the weights and lifted math accuracy from 7.9% to 48.1%.
在 X 查看这条帖子 ↗

来源:Rohan Paul · x.com

论文
发现内容有误?提交纠错