OpenAI releases MedChemBench to assess AI reasoning in medicinal chemistry
MedChemBench contains 99 questions drawn from papers and patents, testing models on molecular structures, experimental evidence, compound selection and property prediction. OpenAI's results show stronger performance on molecular structures but clear weaknesses in compound selection and numerical property prediction. The company says scores on historical questions cannot establish whether models can discover new drugs.