SwinSeg: Swin transformer and MLP hybrid network for ship segmentation in maritime surveillance system

Accurate identification and segmentation of moving ships to ensure maritime traffic safety has become an important task in maritime intelligent transportation system. With the development of artificial intelligence, maritime surveillance system based on computer vision has been widely studied. However, there are still some problems when applied to the actual maritime scene. For example, the degradation of visible image quality caused by rain, haze, and low illumination leads to a significant reduction in segmentation performance. To improve the performance of ship identification and segmentation under adverse weather conditions, we propose SwinSeg, a hybrid network combining Swin Transformer and lightweight multi-layer perceptron (MLP). To address the lack of suitable open-source datasets in the community, we have collected and labeled a semantic segmentation dataset of marine ships, named SeaShipsSeg. It consists of 1200 visible marine ship images and covers six common ship types (bulk cargo carrier, container ship, fishing boat, general cargo ship, ore carrier, and passenger ship). In addition, synthetic degraded images are added to the dataset to increase its diversity and improve the generalization ability of the network. The experimental results show that the performance of our method is significantly better than the state-of-the-art (SOTA) methods in terms of segmentation accuracy, robustness, and efficiency under different weather conditions. The dataset is available at https://github.com/GrimreaperZ-creator/SeaShipsSeg. [Display omitted] •A semantic segmentation dataset for marine ship is constructed.•A hybrid network combining Swin Transformer and lightweight MLP is designed.•In adverse weather conditions, the ship can be robustly identified and segmented.