A Foundation Model for Brain MRI with Dynamic Modality Integration (Student Abstract)

Read full text
Authors: Association for Artificial Intelligence 2026, Minh Sao Khue Luu, Тучинов Баир Николаевич
Cited by: 0

Abstract

We introduce a single–backbone foundation model for brain MRI that supports dynamic modality integration: it operates with arbitrary, possibly unseen, combinations of MRI sequences at pretrain and transfer. The encoder is conditioned by text-derived modality embeddings via conditional layer normalization, while a variance–covariance penalty discourages feature collapse. Unlike expert-based designs that grow with each new sequence, our approach scales without adding modality-specific branches. Pretrained self-supervised on ∼60,000 heterogeneous MRIs, the model learns modality-aware yet modality-agnostic features. We outline evaluation on segmentation and classification under missing/unseen modalities and cross-center shifts, and present early feasibility on multiple sclerosis lesion segmentation under limited data. This work moves toward robust, protocol-agnostic MRI foundation models suited to real clinical variability.

Fields of Study & Subjects

Medical Image Segmentation Techniques Domain Adaptation and Few-Shot Learning Brain Tumor Detection and Classification

Publication details

Journal / source
Underline Science Inc.
Publication date
7 January 2026
Language
EN