Science & Tech · AI · 9 hrs ago

OpenAI benchmark finds models struggle to predict drug compounds’ behavior

OpenAI benchmark finds models struggle to predict drug compounds’ behavior

OpenAI introduced MedChemBench, a test of how well AI models handle complex medicinal chemistry tasks.

It uses research from 117 papers and patents to assess models on 99 problems involving 761 molecular structures.

The test found that GPT-6 Astra reconstructed structures with 95.4% of the available credit at its highest reasoning setting, but earned only about half the credit for choosing compounds and predicting numerical properties.

Knowing a molecule’s structure is not enough: drug researchers also need to understand how changes affect a compound’s activity, absorption and stability.

One test based on cancer research showed that related compounds could have different advantages, such as stronger activity against a protein or better passage across a cell barrier.

The results point to a gap in AI’s drug-research skills, but do not show whether models can discover drugs or improve laboratory decisions.

MedChemBench can help track progress, though its tasks use historical research and models worked without tools, feedback or new experiments.

1 source

Related