aifollow.news
返回 Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · 原发布时间 AI 评分54

OpenAI 发布药物化学基准 MedChemBench

AI 导读

MedChemBench 从117篇论文和专利取题,涵盖761个评分分子结构;每道题停在真实的研究决策点,提供生物靶点、已制备化合物及部分实验结果,并隐去研究人员后来报告的结果。材料称,GPT-6.2 Astra 总体得分约84%,但在关键决策上约有一半答对。

原帖引用 · 原文

@rohanpaul_ai

OpenAI has now published MedChemBench, its medicinal chemistry benchmark.

Its problems come from 117 papers and patents, span 761 graded molecular structures, and withhold the results researchers reported later.

Each prompt stops at a real decision point, supplying the biological target, the compounds made so far and selected assay results.

the best model GPT-6.2 Astra gets about 84% overall, is near perfect at reading the chemistry, and is right about half the time on the decision that actually matters.

来源:Rohan Paul · x.com

论文
发现内容有误?提交纠错