aifollow.news
Back Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · Original publication time AI score54

AItonomy Foundation unveils Science’s Last Exam for research agentsMachine translation

AI introduction

Science’s Last Exam (SLE) asks AI agents to pursue research goals using lab data and software, then grades them against hidden expert checks. The foundation says its 113 tasks span nine disciplines; among eight frontier models tested, the highest score was 37.5/100, and all scored zero on end-to-end research.

Original post · Original

@rohanpaul_ai

@aitonomyfound It's almost the "Lean" proof for any science.

this is really how research agents should be graded.

ReplyAItonomy Foundation@aitonomyfound
I’m incredibly proud to share what we’ve been building at the AItonomy Foundation: Science’s Last Exam (SLE). 🧪✨ Can AI do science? Instead of Q&A, we give agents actual research goals and real-world tools (lab data, software), then grade them against hidden expert checks. Deeply grateful to the brilliant minds at 34 institutions (Harvard, MIT, Stanford, etc.) who helped craft 113 tasks across 9 disciplines. ❤️ The results? Science is hard. Of 8 frontier models, the best scored 37.5/100. On true end-to-end research? All scored 0. We have an exciting journey ahead! 🚀 (Claude Opus 5.5 & GPT-6 Astra coming soon—just clearing bio safeguards). Everything opens Nov 6. 🗓️ 🌐 https://t.co/yXGbbwXCBq 💻 https://t.co/p16ai2WqSy 🤗 https://t.co/3cSiDuAgf6 Thread below on how the exam works and where models break. 👇 (1/14) #AGI #AIforScience #AIAgents #SciencesLastExam #OpenAI #Anthropic
View this post on X ↗

Source: Rohan Paul · x.com

Research
Found an error? Send a correction