RBDN: Residual Bottleneck Dense Network for Image Super-Resolution

Recent studies have shown that a super-resolution generative adversarial network (SRGAN) can significantly improve the quality of single-image super-resolution. However, existing SRGAN methods also have certain drawbacks, such as an insufficient feature utilization, a large number of parameters. To...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE access 2021, Vol.9, p.103440-103451
Hauptverfasser: An, Zeyu, Zhang, Junyuan, Sheng, Ziyu, Er, Xuanhe, Lv, Junjie
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 103451
container_issue
container_start_page 103440
container_title IEEE access
container_volume 9
creator An, Zeyu
Zhang, Junyuan
Sheng, Ziyu
Er, Xuanhe
Lv, Junjie
description Recent studies have shown that a super-resolution generative adversarial network (SRGAN) can significantly improve the quality of single-image super-resolution. However, existing SRGAN methods also have certain drawbacks, such as an insufficient feature utilization, a large number of parameters. To further enhance the visual quality, we thoroughly studied three key components of SRGAN, i.e., the network architecture, adversarial loss, and perceptual loss, and propose a DenseNet with Residual-in-Residual Bottleneck Block (RRBB), called a residual bottleneck dense network (RBDN), for single-image super-resolution. First, to improve the utilization of features between the various layers of the network, we adopted a dense cascading connection between layers. At the same time, to reduce the computational cost, we added a bottleneck structure to each layer, greatly reducing the number of network parameters and accelerating the convergence speed of the training process. Second, the proposed RRBB, as the basic network building unit, removes the batch normalization (BN) layer and employs the ELU function to reduce the opposite effects in the absence of BN. In addition, we applied an improved overall loss function during the model training process to stably train the model and further improve the realism of the reconstructed high-resolution image. To prove the superiority of our proposed model, we conducted a comprehensive and objective evaluation of the Peak Signal-to-Noise Ratio, structural similarity, learned perceptual image patch similarity, and other evaluation indicators obtained from the three test sets, i.e., Set5, Set14, and BSD100, from the recent state-of-the-art model. Finally, we conducted qualitative and quantitative analyses of the results obtained in terms of the evaluation indicators, the authenticity of the restored HR images, and textural details, which show the superiority of the RBDN model.
doi_str_mv 10.1109/ACCESS.2021.3096548
format Article
fullrecord <record><control><sourceid>proquest_ieee_</sourceid><recordid>TN_cdi_proquest_journals_2555727299</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>9481260</ieee_id><doaj_id>oai_doaj_org_article_5371f09913854d9387f8c013a03e9c9a</doaj_id><sourcerecordid>2555727299</sourcerecordid><originalsourceid>FETCH-LOGICAL-c408t-89467747c3b23fc290eaa59f9230b218cc914e7b37951ff6b9e45872da8bb4b33</originalsourceid><addsrcrecordid>eNpNkE9Lw0AQxYMoKLWfwEvAc-r-ze54s7FqQRRaPS-b7aykTbt1kyB-e1NTxLnM8Jj3ZvglyRUlE0oJ3NwVxWy5nDDC6IQTyKXQJ8kFozlkXPL89N98noybZk360r0k1UUyXUzvX27TBTbVqrN1Og1tW-MO3Sa9x12D6Qu2XyFuUh9iOt_aD0yX3R5j1jtC3bVV2F0mZ97WDY6PfZS8P8zeiqfs-fVxXtw9Z04Q3WYaRK6UUI6XjHvHgKC1EjwwTkpGtXNABaqSK5DU-7wEFFIrtrK6LEXJ-SiZD7mrYNdmH6utjd8m2Mr8CiF-GBvbytVoJFfUEwDKtRQr4Fp57QjllnAEB7bPuh6y9jF8dti0Zh26uOvfN0xKqZhiAP0WH7ZcDE0T0f9dpcQc2JuBvTmwN0f2vetqcFWI-OcAoSnLCf8BOwl8-Q</addsrcrecordid><sourcetype>Open Website</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2555727299</pqid></control><display><type>article</type><title>RBDN: Residual Bottleneck Dense Network for Image Super-Resolution</title><source>IEEE Open Access Journals</source><source>DOAJ Directory of Open Access Journals</source><source>EZB-FREE-00999 freely available EZB journals</source><creator>An, Zeyu ; Zhang, Junyuan ; Sheng, Ziyu ; Er, Xuanhe ; Lv, Junjie</creator><creatorcontrib>An, Zeyu ; Zhang, Junyuan ; Sheng, Ziyu ; Er, Xuanhe ; Lv, Junjie</creatorcontrib><description>Recent studies have shown that a super-resolution generative adversarial network (SRGAN) can significantly improve the quality of single-image super-resolution. However, existing SRGAN methods also have certain drawbacks, such as an insufficient feature utilization, a large number of parameters. To further enhance the visual quality, we thoroughly studied three key components of SRGAN, i.e., the network architecture, adversarial loss, and perceptual loss, and propose a DenseNet with Residual-in-Residual Bottleneck Block (RRBB), called a residual bottleneck dense network (RBDN), for single-image super-resolution. First, to improve the utilization of features between the various layers of the network, we adopted a dense cascading connection between layers. At the same time, to reduce the computational cost, we added a bottleneck structure to each layer, greatly reducing the number of network parameters and accelerating the convergence speed of the training process. Second, the proposed RRBB, as the basic network building unit, removes the batch normalization (BN) layer and employs the ELU function to reduce the opposite effects in the absence of BN. In addition, we applied an improved overall loss function during the model training process to stably train the model and further improve the realism of the reconstructed high-resolution image. To prove the superiority of our proposed model, we conducted a comprehensive and objective evaluation of the Peak Signal-to-Noise Ratio, structural similarity, learned perceptual image patch similarity, and other evaluation indicators obtained from the three test sets, i.e., Set5, Set14, and BSD100, from the recent state-of-the-art model. Finally, we conducted qualitative and quantitative analyses of the results obtained in terms of the evaluation indicators, the authenticity of the restored HR images, and textural details, which show the superiority of the RBDN model.</description><identifier>ISSN: 2169-3536</identifier><identifier>EISSN: 2169-3536</identifier><identifier>DOI: 10.1109/ACCESS.2021.3096548</identifier><identifier>CODEN: IAECCG</identifier><language>eng</language><publisher>Piscataway: IEEE</publisher><subject>bottleneck ; Computer architecture ; Convergence ; Deep learning ; Generative adversarial networks ; Image quality ; Image reconstruction ; Image resolution ; Image restoration ; Indicators ; Mathematical models ; Network architecture ; Parameters ; Qualitative analysis ; residual bottleneck dense network ; Residual-in-residual bottleneck block ; ResNet ; Signal to noise ratio ; Similarity ; Superresolution ; Training</subject><ispartof>IEEE access, 2021, Vol.9, p.103440-103451</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2021</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c408t-89467747c3b23fc290eaa59f9230b218cc914e7b37951ff6b9e45872da8bb4b33</citedby><cites>FETCH-LOGICAL-c408t-89467747c3b23fc290eaa59f9230b218cc914e7b37951ff6b9e45872da8bb4b33</cites><orcidid>0000-0002-7920-5775</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/9481260$$EHTML$$P50$$Gieee$$Hfree_for_read</linktohtml><link.rule.ids>314,778,782,862,2098,4012,27616,27906,27907,27908,54916</link.rule.ids></links><search><creatorcontrib>An, Zeyu</creatorcontrib><creatorcontrib>Zhang, Junyuan</creatorcontrib><creatorcontrib>Sheng, Ziyu</creatorcontrib><creatorcontrib>Er, Xuanhe</creatorcontrib><creatorcontrib>Lv, Junjie</creatorcontrib><title>RBDN: Residual Bottleneck Dense Network for Image Super-Resolution</title><title>IEEE access</title><addtitle>Access</addtitle><description>Recent studies have shown that a super-resolution generative adversarial network (SRGAN) can significantly improve the quality of single-image super-resolution. However, existing SRGAN methods also have certain drawbacks, such as an insufficient feature utilization, a large number of parameters. To further enhance the visual quality, we thoroughly studied three key components of SRGAN, i.e., the network architecture, adversarial loss, and perceptual loss, and propose a DenseNet with Residual-in-Residual Bottleneck Block (RRBB), called a residual bottleneck dense network (RBDN), for single-image super-resolution. First, to improve the utilization of features between the various layers of the network, we adopted a dense cascading connection between layers. At the same time, to reduce the computational cost, we added a bottleneck structure to each layer, greatly reducing the number of network parameters and accelerating the convergence speed of the training process. Second, the proposed RRBB, as the basic network building unit, removes the batch normalization (BN) layer and employs the ELU function to reduce the opposite effects in the absence of BN. In addition, we applied an improved overall loss function during the model training process to stably train the model and further improve the realism of the reconstructed high-resolution image. To prove the superiority of our proposed model, we conducted a comprehensive and objective evaluation of the Peak Signal-to-Noise Ratio, structural similarity, learned perceptual image patch similarity, and other evaluation indicators obtained from the three test sets, i.e., Set5, Set14, and BSD100, from the recent state-of-the-art model. Finally, we conducted qualitative and quantitative analyses of the results obtained in terms of the evaluation indicators, the authenticity of the restored HR images, and textural details, which show the superiority of the RBDN model.</description><subject>bottleneck</subject><subject>Computer architecture</subject><subject>Convergence</subject><subject>Deep learning</subject><subject>Generative adversarial networks</subject><subject>Image quality</subject><subject>Image reconstruction</subject><subject>Image resolution</subject><subject>Image restoration</subject><subject>Indicators</subject><subject>Mathematical models</subject><subject>Network architecture</subject><subject>Parameters</subject><subject>Qualitative analysis</subject><subject>residual bottleneck dense network</subject><subject>Residual-in-residual bottleneck block</subject><subject>ResNet</subject><subject>Signal to noise ratio</subject><subject>Similarity</subject><subject>Superresolution</subject><subject>Training</subject><issn>2169-3536</issn><issn>2169-3536</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2021</creationdate><recordtype>article</recordtype><sourceid>ESBDL</sourceid><sourceid>RIE</sourceid><sourceid>DOA</sourceid><recordid>eNpNkE9Lw0AQxYMoKLWfwEvAc-r-ze54s7FqQRRaPS-b7aykTbt1kyB-e1NTxLnM8Jj3ZvglyRUlE0oJ3NwVxWy5nDDC6IQTyKXQJ8kFozlkXPL89N98noybZk360r0k1UUyXUzvX27TBTbVqrN1Og1tW-MO3Sa9x12D6Qu2XyFuUh9iOt_aD0yX3R5j1jtC3bVV2F0mZ97WDY6PfZS8P8zeiqfs-fVxXtw9Z04Q3WYaRK6UUI6XjHvHgKC1EjwwTkpGtXNABaqSK5DU-7wEFFIrtrK6LEXJ-SiZD7mrYNdmH6utjd8m2Mr8CiF-GBvbytVoJFfUEwDKtRQr4Fp57QjllnAEB7bPuh6y9jF8dti0Zh26uOvfN0xKqZhiAP0WH7ZcDE0T0f9dpcQc2JuBvTmwN0f2vetqcFWI-OcAoSnLCf8BOwl8-Q</recordid><startdate>2021</startdate><enddate>2021</enddate><creator>An, Zeyu</creator><creator>Zhang, Junyuan</creator><creator>Sheng, Ziyu</creator><creator>Er, Xuanhe</creator><creator>Lv, Junjie</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>ESBDL</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7SP</scope><scope>7SR</scope><scope>8BQ</scope><scope>8FD</scope><scope>JG9</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>DOA</scope><orcidid>https://orcid.org/0000-0002-7920-5775</orcidid></search><sort><creationdate>2021</creationdate><title>RBDN: Residual Bottleneck Dense Network for Image Super-Resolution</title><author>An, Zeyu ; Zhang, Junyuan ; Sheng, Ziyu ; Er, Xuanhe ; Lv, Junjie</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c408t-89467747c3b23fc290eaa59f9230b218cc914e7b37951ff6b9e45872da8bb4b33</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2021</creationdate><topic>bottleneck</topic><topic>Computer architecture</topic><topic>Convergence</topic><topic>Deep learning</topic><topic>Generative adversarial networks</topic><topic>Image quality</topic><topic>Image reconstruction</topic><topic>Image resolution</topic><topic>Image restoration</topic><topic>Indicators</topic><topic>Mathematical models</topic><topic>Network architecture</topic><topic>Parameters</topic><topic>Qualitative analysis</topic><topic>residual bottleneck dense network</topic><topic>Residual-in-residual bottleneck block</topic><topic>ResNet</topic><topic>Signal to noise ratio</topic><topic>Similarity</topic><topic>Superresolution</topic><topic>Training</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>An, Zeyu</creatorcontrib><creatorcontrib>Zhang, Junyuan</creatorcontrib><creatorcontrib>Sheng, Ziyu</creatorcontrib><creatorcontrib>Er, Xuanhe</creatorcontrib><creatorcontrib>Lv, Junjie</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE Open Access Journals</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics &amp; Communications Abstracts</collection><collection>Engineered Materials Abstracts</collection><collection>METADEX</collection><collection>Technology Research Database</collection><collection>Materials Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>DOAJ Directory of Open Access Journals</collection><jtitle>IEEE access</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>An, Zeyu</au><au>Zhang, Junyuan</au><au>Sheng, Ziyu</au><au>Er, Xuanhe</au><au>Lv, Junjie</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>RBDN: Residual Bottleneck Dense Network for Image Super-Resolution</atitle><jtitle>IEEE access</jtitle><stitle>Access</stitle><date>2021</date><risdate>2021</risdate><volume>9</volume><spage>103440</spage><epage>103451</epage><pages>103440-103451</pages><issn>2169-3536</issn><eissn>2169-3536</eissn><coden>IAECCG</coden><abstract>Recent studies have shown that a super-resolution generative adversarial network (SRGAN) can significantly improve the quality of single-image super-resolution. However, existing SRGAN methods also have certain drawbacks, such as an insufficient feature utilization, a large number of parameters. To further enhance the visual quality, we thoroughly studied three key components of SRGAN, i.e., the network architecture, adversarial loss, and perceptual loss, and propose a DenseNet with Residual-in-Residual Bottleneck Block (RRBB), called a residual bottleneck dense network (RBDN), for single-image super-resolution. First, to improve the utilization of features between the various layers of the network, we adopted a dense cascading connection between layers. At the same time, to reduce the computational cost, we added a bottleneck structure to each layer, greatly reducing the number of network parameters and accelerating the convergence speed of the training process. Second, the proposed RRBB, as the basic network building unit, removes the batch normalization (BN) layer and employs the ELU function to reduce the opposite effects in the absence of BN. In addition, we applied an improved overall loss function during the model training process to stably train the model and further improve the realism of the reconstructed high-resolution image. To prove the superiority of our proposed model, we conducted a comprehensive and objective evaluation of the Peak Signal-to-Noise Ratio, structural similarity, learned perceptual image patch similarity, and other evaluation indicators obtained from the three test sets, i.e., Set5, Set14, and BSD100, from the recent state-of-the-art model. Finally, we conducted qualitative and quantitative analyses of the results obtained in terms of the evaluation indicators, the authenticity of the restored HR images, and textural details, which show the superiority of the RBDN model.</abstract><cop>Piscataway</cop><pub>IEEE</pub><doi>10.1109/ACCESS.2021.3096548</doi><tpages>12</tpages><orcidid>https://orcid.org/0000-0002-7920-5775</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 2169-3536
ispartof IEEE access, 2021, Vol.9, p.103440-103451
issn 2169-3536
2169-3536
language eng
recordid cdi_proquest_journals_2555727299
source IEEE Open Access Journals; DOAJ Directory of Open Access Journals; EZB-FREE-00999 freely available EZB journals
subjects bottleneck
Computer architecture
Convergence
Deep learning
Generative adversarial networks
Image quality
Image reconstruction
Image resolution
Image restoration
Indicators
Mathematical models
Network architecture
Parameters
Qualitative analysis
residual bottleneck dense network
Residual-in-residual bottleneck block
ResNet
Signal to noise ratio
Similarity
Superresolution
Training
title RBDN: Residual Bottleneck Dense Network for Image Super-Resolution
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-17T03%3A53%3A18IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_ieee_&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=RBDN:%20Residual%20Bottleneck%20Dense%20Network%20for%20Image%20Super-Resolution&rft.jtitle=IEEE%20access&rft.au=An,%20Zeyu&rft.date=2021&rft.volume=9&rft.spage=103440&rft.epage=103451&rft.pages=103440-103451&rft.issn=2169-3536&rft.eissn=2169-3536&rft.coden=IAECCG&rft_id=info:doi/10.1109/ACCESS.2021.3096548&rft_dat=%3Cproquest_ieee_%3E2555727299%3C/proquest_ieee_%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2555727299&rft_id=info:pmid/&rft_ieee_id=9481260&rft_doaj_id=oai_doaj_org_article_5371f09913854d9387f8c013a03e9c9a&rfr_iscdi=true