S3AD: Efficient industrial anomaly detection via selection, space, and scale

Read full text
Authors: Zhonghua Peng, Chengyang Dong, Bo Liu, Zuoyong Li, Zuoyong Li, Kun Zeng, Jialong Li
Cited by: 1
References: 19

Abstract

Real-world industrial visual anomaly detection (VAD) demands the simultaneous handling of diverse product categories under strict real-time constraints. However, the self-attention mechanism inherent in standard Vision Transformers (ViTs) incurs quadratic computational complexity during global context modeling, thereby limiting their real-time applicability in VAD. Crucially, this bottleneck is largely driven by the uniform processing of massive background redundancy common in industrial scenarios. To bypass this inefficiency while retaining high precision, we propose S 3 AD , a unified framework anchored in Selection, Space, and Scale. Instead of dense global interactions, S 3 AD employs a Salience-Guided Sparse Attention to focus resources solely on salient areas. Specifically, regarding Selection, we devise a discriminating Top-K pruning strategy guided by a hybrid metric of attention scores and feature magnitudes, which filters out non-informative tokens to minimize cost. Simultaneously, for Space, we incorporate Geometry-Preserving Positional Embeddings to explicitly anchor the selected tokens, ensuring structural integrity is maintained despite sparse interaction. Finally, concerning Scale, we integrate an Exchangeable Feature Pyramid Network (E-FPN) to ensure rigorous feature fusion across resolutions. Extensive experiments demonstrate that S 3 AD achieves state-of-the-art performance and establishes a superior accuracy–efficiency Pareto frontier, consistently surpassing strong baselines on multiple benchmarks. The code is available at: https://github.com/CreatedTRYNA/S3AD .

Fields of Study & Subjects

Anomaly Detection Techniques and Applications Fault Detection and Control Systems Time Series Analysis and Forecasting

Publication details

Journal / source
Pattern Recognition
Publisher
Elsevier BV
Volume
179
Pages
113868–113868
Publication date
29 April 2026
Language
EN