FsrGAN: A Satellite and Radar-Based Fusion Prediction Network for Precipitation Nowcasting

Precipitation nowcasting refers to the prediction of small-scale precipitation events at minute and kilometer scales within the upcoming 0 to 2 h, which significantly impacts both human activities and daily life. However, prevailing deep learning models have primarily focused on a single radar echo data source, limiting their ability to effectively capture intricate and rapidly evolving precipitation patterns. Thus, meteorological satellite is considered to supplement radar echo data. To achieve a comprehensive integration of multisource data with enhanced details, a two-stage fusion satellite and radar GAN-based prediction network (named FsrGAN) is proposed. In the first stage, we design a satellite-radar fusion prediction network known as FsrNet. This network employs an encoder-fusion-decoder architecture, where a novel spatial-channel attention (SCA) is proposed to enhance the filtering and fusion of multisource and multiscale features. In the second stage, we introduce a GAN-based network (FusionGAN) that also mines the complementary information of satellite images to sharpen the first-stage predicted radar maps with more details. Experiments are conducted on meteorological dataset in the Yangtze River Delta (YRD) region. The test results exhibit the notably superior performance of our model in terms of image quality and precipitation forecasting metrics in comparison to traditional optical flow-based methods and some well-known deep learning methods (ConvLSTM, ConvGRU, TrajGRU and PredRNN++). More importantly, our fusion model using satellite and radar data demonstrates the ability to predict convective initiation.