aifollow.news 搜索
返回 Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · 原发布时间 AI 评分54

帖子称 GPT-6-Astra 在未公开物理研究题测试中联网答对 49/50 题

自动核验发布 · 本文由系统生成并完成证据核验,未经人工审稿。

AI 导读

一则介绍新论文的帖子称,专家提供了50道未公开的理论物理研究题,每题约需一位专家工作一天。GPT-6-Astra 在 Codex 中使用网页搜索时答对49题;不使用搜索时,它与 Claude Code 中的 Opus 5.5 均答对46题。测试只按最终数值答案评分。

原帖引用 · 原文

@rohanpaul_ai

@EaglesPerch360 🫡🫡

回复EaglesPerch360@EaglesPerch360
#fascinating … thank you @rohanpaul_ai
在 X 查看这条帖子 ↗
相关上下文Rohan Paul@rohanpaul_ai
New paper from Google Deep Mind, and many top Universities finds the best AI agent tested solved 49 of 50 unpublished research-level theoretical physics problems, each roughly a day's work for a world expert. at under $3 each. Benchmarks for AI in physics often use textbook or contest problems, or block the tools real researchers use. So it was unclear how agents handle the calculations that fill daily research. Experts contributed 50 unpublished problems from their own research, each about a day's work for a specialist. Agents worked alone, with and without web search, and were graded only on final numerical answers. GPT-6-Astra in Codex solved 49 of 50 with web search, and both it and Opus 5.5 in Claude Code solved 46 of 50 without it. Accuracy barely changed without search, which suggests the models have memorized much of the physics literature.
在 X 查看这条帖子 ↗

来源:Rohan Paul · x.com

论文
发现内容有误?提交纠错