Robust registration under large image misalignment using an iterative step-aware transformer with application to corneal confocal microscopy

Read full text
Authors: Zihao Chen, Zane Z. Zemborain, Raul Ruiz-Lozano, Manuel E. Quiroga-Garza, Symon Ma, Matias Soifer, Nadim Azar, Hazem M. Mousa, Victor Perez, Sina Farsiu
Cited by: 3
References: 29

Abstract

Corneal confocal microscopy (CCM) captures high-resolution images of the subbasal nerve plexus (SNP), but its small field of view limits visualization of larger anatomical landmarks such as the corneal whorl, which may aid in disease differentiation. Intra-modality image frame registration is, therefore, a critical step toward high-quality mosaic construction. However, raster scanning required for mosaicking in CCM is still performed manually, often leading to irregular coverage and substantial frame misalignment. This creates a challenge as existing deep learning methods largely focus on local elastic deformation, which is less relevant in CCM due to contemporaneous acquisition and local linearity, while paying limited attention to robust affine registration under large misalignment. To address this, we propose a hybrid cross- and self-attention transformer-based registration network that explicitly models long-range spatial correspondences, enabling robust affine alignment even under challenging conditions. To further enhance robustness, we introduce the Iterative Step-Aware Transformer Registration Network (ISATR-Net), which progressively reduces residual misalignment through step-aware conditioning. To rigorously evaluate this problem under the clinical diversity encountered in real-world CCM imaging, we curated a new CCM dataset. The dataset includes 156 eyes from 91 patients, spanning dry eye disease, neuropathic corneal pain, penetrating keratoplasty, uveitis, Fuchs corneal dystrophy, and control cases, totaling 1,349 image frame registration pairs. On this dataset, ISATR-Net outperforms multiple state-of-the-art affine registration methods. Our open-source codes are available online.

Fields of Study & Subjects

Corneal surgery and disorders Retinal Imaging and Analysis Ophthalmology and Visual Impairment Studies

Publication details

Journal / source
Biomedical Optics Express
Publisher
Optica Publishing Group
Volume
17
Issue
4
Pages
1632–1632
Publication date
26 February 2026
Language
EN