PharMistral: Drug generation for novel protein targets by Mistral Large Language Model

Designing molecules for targets lacking abundant data or 3D structures remains a bottleneck, as most models rely on known binders or pocket geometries. To address this, we present PharMistral , a sequence–conditioned ligand generator based on Mistral-7B. Unlike DeepTarget (task–specific) or ChemGPT (SMILES–only), PharMistral adapts a single 7B–parameter model via a two–stage process: (1) joint pre–training on more than 300,000 unpaired human proteins and more than 1 million drug–like SMILES to learn a shared biochemical language; and (2) end–to–end fine–tuning on ∼ 300,000 high–affinity human protein–ligand pairs curated from ChEMBL-26. At inference, PharMistral autoregressively generates ligands from raw protein sequences without target–specific retraining or structural input. On unseen proteins, the model achieved 99.5% chemical validity. Of valid molecules, 57% were unique, and 36% of those were novel compared to the training set. After drug–likeness and toxicity filtering, 3383 unique molecules were retained (55% of the unique valid set and 31% of all valid molecules).