aifollow.news
Back Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · Original publication time AI score54

OpenAI publishes MedChemBench to test medicinal chemistry decisionsMachine translation

AI introduction

MedChemBench draws problems from 117 papers and patents and covers 761 graded molecular structures. Each prompt stops at a real decision point, provides the biological target, compounds made so far and selected assay results, and withholds results researchers reported later. The source says the best-performing model, GPT-6.2 Astra, scores about 84% overall but is right about half the time on the key decision.

Original post · Original

@rohanpaul_ai

https://t.co/kQF1qrMbEU

ReplyRohan Paul@rohanpaul_ai
OpenAI has now published MedChemBench, its medicinal chemistry benchmark. Its problems come from 117 papers and patents, span 761 graded molecular structures, and withhold the results researchers reported later. Each prompt stops at a real decision point, supplying the biological target, the compounds made so far and selected assay results. the best model GPT-6.2 Astra gets about 84% overall, is near perfect at reading the chemistry, and is right about half the time on the decision that actually matters.
View this post on X ↗

Source: Rohan Paul · x.com

Research
Found an error? Send a correction