Self-Distillation-Based Domain Weighted Generalization Method for Fault Diagnosis Under Actual Unseen Working Conditions

View at publisher
Authors: Yixiang Huang, Yirui Ma, Ying Pu, Chunqi Wang, Yue Wang, Pengcheng Xia, Chengjin Qin, Chengliang Liu
Cited by: 1
References: 45

Abstract

In modern industry, fault diagnosis is critical for ensuring production safety and efficiency. Intelligent fault diagnosis methods often suffer performance degradation under varying real-world operating conditions, primarily due to distribution shifts. Domain generalization (DG) techniques have been introduced to address this issue, aiming to enhance model performance under unseen working conditions. However, existing methods often overlook the significance of multi-level feature representations in learning generalizable information. Furthermore, most methods disregard the fact that not all source domains contribute equally to generalization, where certain domains provide more transferable features than others. To address these challenges, this paper proposes a self-distillation-based domain weighted generalization method for fault diagnosis. With the Vision Transformer (ViT) as the backbone, the method first incorporates a self-distillation mechanism that distills class-specific knowledge within class tokens from the final transformer block to intermediate blocks, enabling the learning of more generalized features. Second, a dynamic domain weighting strategy based on self-distillation loss is proposed, which assigns higher weights to domains with more generalized features. Finally, these weights are integrated into domain adversarial learning and fault classification process. Extensive experiments on motor fault diagnosis are conducted, covering multiple conditions including constant conditions, start-up and shut-down conditions, and the New European Driving Cycle (NEDC) conditions. Experimental results on 33 cross-condition tasks, including constant-to-constant, constant-to-variable, and variable-to-variable tasks, demonstrate that the proposed method achieves superior accuracy and robustness compared with several representative methods. Ablation studies further validate the effectiveness of each component in the proposed method.

Fields of Study & Subjects

Machine Fault Diagnosis Techniques Domain Adaptation and Few-Shot Learning Imbalanced Data Classification Techniques

Publication details

Journal / source
IEEE Transactions on Instrumentation and Measurement
Publisher
Institute of Electrical and Electronics Engineers (IEEE)
Volume
75
Pages
1–13
Publication date
1 January 2026