原帖引用 · 原文
Rohan Paul@rohanpaul_ai
@aitonomyfound It's almost the "Lean" proof for any science.
this is really how research agents should be graded.
I’m incredibly proud to share what we’ve been building at the AItonomy Foundation: Science’s Last Exam (SLE). 🧪✨
Can AI do science? Instead of Q&A, we give agents actual research goals and real-world tools (lab data, software), then grade them against hidden expert checks.
Deeply grateful to the brilliant minds at 34 institutions (Harvard, MIT, Stanford, etc.) who helped craft 113 tasks across 9 disciplines. ❤️
The results? Science is hard. Of 8 frontier models, the best scored 37.5/100. On true end-to-end research? All scored 0. We have an exciting journey ahead! 🚀
(Claude Opus 5.5 & GPT-6 Astra coming soon—just clearing bio safeguards).
Everything opens Nov 6. 🗓️
🌐 https://t.co/yXGbbwXCBq
💻 https://t.co/p16ai2WqSy
🤗 https://t.co/3cSiDuAgf6
Thread below on how the exam works and where models break. 👇 (1/14)
#AGI #AIforScience #AIAgents #SciencesLastExam #OpenAI #Anthropic
在 X 查看这条帖子 ↗
· UTC+8