Real time image-based air quality forecasts using a 3D-CNN approach with an attention mechanism

This study presented an image-based deep learning method to improve the recognition of air quality from images and produce accurate multiple horizon forecasts. The proposed model was designed to incorporate a three-dimensional convolutional neural network (3D-CNN) and the gated recurrent unit (GRU) with an attention mechanism. This study included two novelties; (i) the 3D-CNN model structure was built to extract the hidden features of multiple dimensional datasets and recognize the relevant environmental variables. The GRU was fused to extract the temporal features and improve the structure of fully connected layers. (ii) An attention mechanism was incorporated into this hybrid model to adjust the influence of features and avoid random fluctuations in particulate matter values. The feasibility and reliability of the proposed method were verified through the site images of the Shanghai scenery dataset with relevant air quality monitoring data. Results showed that the proposed method has the highest forecasting accuracy over other states of art methods. The proposed model can provide multi-horizon predictions based on efficient feature extraction and good denoising ability, which is helpful in giving reliable early warning guidelines against air pollutants. [Display omitted] •Image based deep learning model produced accurate multiple horizon forecasts.•GRU extracted the temporal features and improved the structure of fully connected layer.•Attention mechanism adjusted the influence of feature vectors and improved the model outputs.•D CNN-GRU showed better predictive performance than current basic models.