Quality assessment and control of urban environmental sensors using physical thresholding and machine learning-based probabilities

Read full text
Authors: Jangho Lee, Max Berkelhammer, Anna E. S. Vincent, Maxwell A. Grover, Amy Cho, Aaron I. Packman, Bilal Kaludi, Miquel A. Gonzàlez‐Meler, Gavin McNicol
Cited by: 0
References: 46

Abstract

Reliable environmental sensor data are fundamental for accurate urban climate modeling and evidence-based planning. Conventional physics-based quality control (QC) methods apply fixed thresholds to flag physically implausible values, but they often fail to detect subtle, context-dependent anomalies. This study introduces a hybrid QC framework that integrates conservative physical constraints with a probabilistic machine-learning approach based on Positive-Unlabeled XGBoost (PU-XGBoost). Using data from the CROCUS Urban Integrated Field Laboratory in Chicago, the framework generates anomaly likelihood probabilities rather than binary flags, allowing confidence-weighted data evaluation. The results demonstrate that the hybrid method effectively captures both gross and latent sensor errors overlooked by rule-based QC, while maintaining interpretability through physically informed features. Feature importance analysis highlights the dominant roles of temporal statistics, sensor type, and environmental context in anomaly detection. Overall, the proposed hybrid framework provides a scalable and interpretable foundation for self-adaptive quality assurance in next-generation urban environmental sensing networks.

Fields of Study & Subjects

Urban Heat Island Mitigation Anomaly Detection Techniques and Applications Environmental Monitoring and Data Management

Publication details

Journal / source
Big Earth Data
Volume
10
Issue
3
Pages
1872–1898
Publication date
12 March 2026
Language
EN