Dynamic scene deblurring with continuous cross-layer attention transmission
•We introduce a new continuous cross-layer attention transmission (CCLAT) mechanism in CNN, which makes full use of all hierarchical attentions through locally dense connections of attention maps.•Based on CCLAT mechanism, we just use a simple attention module to construct a novel residual dense att...
Gespeichert in:
Veröffentlicht in: | Pattern recognition 2023-11, Vol.143, p.109719, Article 109719 |
---|---|
Hauptverfasser: | , , , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | •We introduce a new continuous cross-layer attention transmission (CCLAT) mechanism in CNN, which makes full use of all hierarchical attentions through locally dense connections of attention maps.•Based on CCLAT mechanism, we just use a simple attention module to construct a novel residual dense attention fusion block (RDAFB), and employ it as a building block to design an effective architecture named RDAFNet for dynamic scene deblurring.•Our experiments on benchmark datasets show that the proposed model outperforms the state-of-the-art methods and demonstrate the effectiveness of CCLAT mechanism.
The deep convolutional neural networks (CNNs) using attention mechanism have achieved great success for dynamic scene deblurring. In most of these networks, only the features refined by the attention maps can be passed to the next layer and the attention maps of different layers are separated from each other, which does not make full use of the attention information from different layers in the CNN. To address this problem, we introduce a new continuous cross-layer attention transmission (CCLAT) mechanism that can exploit hierarchical attention information from all the convolutional layers. Based on the CCLAT mechanism, we use a very simple attention module to construct a novel residual dense attention fusion block (RDAFB). In RDAFB, the attention maps inferred from the outputs of the preceding RDAFB and each layer are directly connected to the subsequent ones, leading to a CCLAT mechanism. Taking RDAFB as the building block, we design an effective architecture for dynamic scene deblurring named RDAFNet. The experiments on benchmark datasets show that the proposed model outperforms the state-of-the-art deblurring approaches, and demonstrate the effectiveness of CCLAT mechanism. The source code is available on: https://github.com/xjmz6/RDAFNet. |
---|---|
ISSN: | 0031-3203 |
DOI: | 10.1016/j.patcog.2023.109719 |