EO-VAE: Towards A Multi-sensor Tokenizer for Earth Observation Data

Read full text
Authors: Nils Lehmann, Yi Wang, Zhitong Xiong, Xiao Xiang Zhu
Cited by: 0

Abstract

State-of-the-art generative image and video models rely heavily on tokenizers that compress high-dimensional inputs into more efficient latent representations. While this paradigm has revolutionized RGB generation, Earth observation (EO) data presents unique challenges due to diverse sensor specifications and variable spectral channels. We propose EO-VAE, a multi-sensor variational autoencoder designed to serve as a foundational tokenizer for the EO domain. Unlike prior approaches that train separate tokenizers for each modality, EO-VAE utilizes a single model to encode and reconstruct flexible channel combinations via dynamic hypernetworks. Our experiments on the TerraMesh dataset demonstrate that EO-VAE achieves superior reconstruction fidelity compared to the TerraMind tokenizers, establishing a robust baseline for latent generative modeling in remote sensing.

Fields of Study & Subjects

Generative Adversarial Networks and Image Synthesis Remote-Sensing Image Classification Advanced Neural Network Applications

Publication details

Journal / source
arXiv (Cornell University)
Publication date
12 February 2026
Language
EN
Document type
Preprint