Navigating heterogeneous protein landscapes through geometry-aware smoothing

Read full text
Authors: Srinivas Anumasa, Barath Chandran, Tingting Chen, Nuwaisir Mohammad Rahman, Yingtao Zhu, Rushi Shah, Hongyu He, Peisong Zhang, Yizhen Liao, Yiming Tang, Yong Shen, Tianfan Fu
+6 more Rui Qing, Xiao Li, Sebastian Maurer‐Stroh, Xinyi Su, Zhizhuo Zhang, Dianbo Liu
Cited by: 0

Abstract

The evolutionary fitness landscape of biological molecules is extremely sparse and heterogeneous, with functional sequences forming isolated dense ``islands'' within a vast combinatorial space of largely non-functional variants. Protein sequences, in particular, exemplify this structure, yet most generative artificial intelligence models implicitly assume a homogeneous data distribution. We show that this assumption fundamentally breaks down in heterogeneous biological sequence spaces: fixed global noise levels impose a destructive trade-off, either oversmoothing dense functional clusters or fragmenting sparse regions and producing non-functional hallucinations. To address this limitation, we introduce \emph{Density-Dependent Smoothing} (DDS), a geometry-aware generative framework that adapts stochastic smoothing to the local density of the underlying sequence landscape. By inversely coupling diffusion noise to estimated sequence density, DDS enables gentle refinement in high-density functional regions while promoting controlled exploration across sparse regions. Implemented as a plug-in mechanism for discrete molecular sampling, DDS consistently outperforms state-of-the-art diffusion and autoregressive models across antibody repertoires, therapeutic antibody design, antimicrobial peptide generation and coronavirus antibody design. Together, these results show that fixed global smoothing assumptions fundamentally limit generative modeling in sparse biological sequence spaces, and that geometry-aware smoothing removes this constraint, enabling reliable exploration and design previously unattainable with fixed-noise generative models.

Fields of Study & Subjects

Protein Structure and Dynamics vaccines and immunoinformatics approaches Machine Learning in Bioinformatics

Publication details

Journal / source
arXiv (Cornell University)
Publication date
11 February 2026
Language
EN
Document type
Preprint