aifollow.news
返回 Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · 原发布时间 AI 评分54

清华大学与 Moonshot AI 论文:GPT-6 Astra 证明七成 Lean 定理,未解出开放猜想

AI 导读

清华大学与 Moonshot AI 的论文提出 TCSExam,包含四类共 100 道专家审阅的理论计算机科学任务,提交结果由 Lean 内核或任务检查器验证。未提供辅助引理时,GPT-6 Astra 在定理证明尝试中完成 70.0%,Kimi K3.1 Pro 为 38.3%;同一模型未解出 30 道开放猜想中的任何一道。

原帖引用 · 原文

该语言的正文暂不可用,当前显示已有版本。

@rohanpaul_ai

New Tsinghua and Moonshot AI paper finds that GPT-6 Astra proves 70.0% of research-level computer science theorems in Lean, yet the same model resolves 0 of 30 open conjectures in theoretical computer science (TCS).

Theoretical computer science is a natural test for AI research, because proofs can be machine-checked and records can be beaten. Existing benchmarks cover only slices, like proofs or code.

TCSExam has 100 expert-reviewed tasks in 4 tracks: Lean theorem proving, solver engineering, record-setting constructions, and 30 open conjectures. The Lean kernel or a task checker verifies every submission.

Without supplied lemmas, GPT-6 Astra fully proved theorems in 70.0% of attempts, Kimi K3.1 Pro in 38.3%, and the other 6 agents in at most 11.7%. The few accepted conjecture submissions adapted counterexamples and proofs OpenAI had already published.

来源:Rohan Paul · x.com

论文
发现内容有误?提交纠错