Dual‐Stream Fusion and Multi‐scale Analysis: Introducing the Synergistic Dual‐Stream Network (SDS‐Net) for Image Manipulation Segmentation

This article introduces the synergistic dual‐stream network (SDS‐Net), a novel neural network architecture that significantly enhances the detection of image manipulations. SDS‐Net employs a unique dual‐stream fusion strategy that processes both RGB image and the corresponding noise map. It innovati...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Advanced Intelligent Systems 2024-04, Vol.6 (4), p.n/a
Hauptverfasser: Song, HuaQing, Lin, BaiChuan, Xie, LanChi
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:This article introduces the synergistic dual‐stream network (SDS‐Net), a novel neural network architecture that significantly enhances the detection of image manipulations. SDS‐Net employs a unique dual‐stream fusion strategy that processes both RGB image and the corresponding noise map. It innovatively combines features computation from the different blocks of dual backbones, and leverages a multi‐scale spatial pyramid pooling (MSPP) module to expand the receptive fields of shallow features. This approach not only enriches the feature representation, but also ensures the precise localization of manipulated regions. Extensive experiments conducted on various public datasets demonstrate the superiority of SDS‐Net over several state‐of‐the‐art methods. Introducing synergistic dual‐stream network (SDS‐Net), a groundbreaking deep learning framework for image manipulation detection. This innovative system employs a dual‐stream fusion strategy, enhancing feature extraction capabilities and ensures precise localization of tampered regions. SDS‐Net's unique approach significantly outperforms existing methods, offering robust and accurate detection across different datasets.
ISSN:2640-4567
2640-4567
DOI:10.1002/aisy.202300749