Channel-masked Asymmetric Distribution Matching for Cross-Domain Generalized Dataset Distillation

Read full text
Authors: Association for Artificial Intelligence 2026, Guihai Chen, Qi Liu, Guangtao Lyu, Chenghao Xu, Jiexi Yan, Yanhua Yang, Erkun Yang
Cited by: 0

Abstract

Dataset distillation has achieved remarkable progress as an effective approach for data compression. However, real-world data often comes from diverse domains, leading to potential mismatches between the domains of synthesized images and those of the evaluation set. Existing methods primarily assume domain alignment between them, which limits their generalization ability in the above cross-domain scenarios. In this paper, we aim to ensure that images synthesized from known domains maintain robust performance on unseen domains and propose a novel framework called Channel-masked Asymmetric Distribution Matching (CADM). During asymmetric distribution matching, domain-sensitive channels of real data are selectively masked at different layers to extract domain-invariant features that guide synthetic data optimization. To further improve synthetic data representation, we introduce a class-focused domain-agnostic regularization to capture class-relevant knowledge while ignoring domain-specific information. Experiments show that our method produces domain-robust synthetic data and substantially improves generalization performance on unseen domains.

Fields of Study & Subjects

Domain Adaptation and Few-Shot Learning Generative Adversarial Networks and Image Synthesis Advanced Neural Network Applications

Publication details

Journal / source
Underline Science Inc.
Publication date
7 January 2026
Language
EN