Enhanced Air Pollution Prediction via Adam-Optimized Multi-Head Attention and Hybrid Deep Learning

Read full text
Authors: Chenbin Gu, Yimi Tan, Xiaoqi Yin, X. Q. Li, Yang Yudong, Yan Lv
Cited by: 8

Abstract

To address the challenge of traditional models in simultaneously capturing local fluctuations and global trends for air pollutant concentration prediction, this paper proposes a multimodal deep learning model named MLP-BiLSTM- MHAT. The model integrates static features via MLP, extracts temporal dependencies through bidirectional LSTM (BiLSTM), and employs a Multi-head Attention mechanism (MHAT) to fuse local and global features while enhancing interactions between static and temporal characteristics. An improved Adam algorithm dynamically optimizes learning rates to balance the influence of heterogenous features. Validated on multi-site air quality data from Beijing, experimental results demonstrate that MLP-BiLSTM-MHAT outperforms baseline models with an average reduction of 1.9% in RMSE, 4.2% in MAE, and a 1.8% improvement in R², showcasing superior accuracy and robustness across diverse pollutants and scenarios.

Fields of Study & Subjects

Air Quality Monitoring and Forecasting Air Quality and Health Impacts Atmospheric chemistry and aerosols

Publication details

Journal / source
ICCK Transactions on Intelligent Systematics
Publisher
Institute of Central Computation and Knowledge Inc.
Volume
3
Issue
1
Pages
11–20
Publication date
29 January 2026