Learning Non-Locally Regularized Compressed Sensing Network With Half-Quadratic Splitting

Deep learning-based Compressed Sensing (CS) reconstruction attracts much attention in recent years, due to its significant superiority of reconstruction quality. Its success is mainly attributed to the employment of a large dataset for pre-training the network to learn a reconstruction mapping. In t...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on multimedia 2020-12, Vol.22 (12), p.3236-3248
Hauptverfasser: Sun, Yubao, Yang, Ying, Liu, Qingshan, Chen, Jiwei, Yuan, Xiao-Tong, Guo, Guodong
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 3248
container_issue 12
container_start_page 3236
container_title IEEE transactions on multimedia
container_volume 22
creator Sun, Yubao
Yang, Ying
Liu, Qingshan
Chen, Jiwei
Yuan, Xiao-Tong
Guo, Guodong
description Deep learning-based Compressed Sensing (CS) reconstruction attracts much attention in recent years, due to its significant superiority of reconstruction quality. Its success is mainly attributed to the employment of a large dataset for pre-training the network to learn a reconstruction mapping. In this paper, we propose a non-locally regularized compressed sensing network for reconstructing image sequences, which can achieve high reconstruction quality without pre-training. Specifically, the proposed method attempts to learn a deep network prior for the reconstruction of an individual instance under the constraint that the network output can well match the given CS measurement. The non-local prior is designed to guide the network to capture the long-range dependencies by exploiting the self-similarities among images, and it can also make the network noise-aware. In order to deal with the compound of non-local prior and deep network prior, we construct a half-quadratic splitting based optimization method for network learning, in which the two priors are decoupled into two simple sub-problems by introducing an auxiliary variable and a quadratic fidelity constraint. Extensive experimental results demonstrate that our method is competitive to the popular methods, including sparsity prior based methods and deep learning based methods, even better than them in the cases of low measurement rates.
doi_str_mv 10.1109/TMM.2020.2973862
format Article
fullrecord <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_ieee_primary_8999514</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>8999514</ieee_id><sourcerecordid>2462224702</sourcerecordid><originalsourceid>FETCH-LOGICAL-c291t-38560bbe005e4cc0c8658ffde9479a7206b17bae02334e58b66b266ce3368b863</originalsourceid><addsrcrecordid>eNo9kEtLw0AUhQdRsFb3gpuA69Q7j8xjKUWtkCrairgaJulNTU2TOpMg9debWnF1z-I758JHyDmFEaVgrubT6YgBgxEzimvJDsiAGkFjAKUO-5wwiA2jcExOQlgBUJGAGpC3FJ2vy3oZPTR1nDa5q6pt9IzLrnK-_MZFNG7WG48h9HGGdfhFsf1q_Ef0Wrbv0cRVRfzUuYV3bZlHs01Vtm1PnZKjwlUBz_7ukLzc3szHkzh9vLsfX6dxzgxtY64TCVmGAAmKPIdcy0QXxQKNUMYpBjKjKnMIjHOBic6kzJiUOXIudaYlH5LL_e7GN58dhtaums7X_UvLhGSMCdV3hwT2VO6bEDwWduPLtfNbS8HuBNpeoN0JtH8C-8rFvlIi4j-ujTEJFfwHo6Vr-w</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2462224702</pqid></control><display><type>article</type><title>Learning Non-Locally Regularized Compressed Sensing Network With Half-Quadratic Splitting</title><source>IEEE Electronic Library (IEL)</source><creator>Sun, Yubao ; Yang, Ying ; Liu, Qingshan ; Chen, Jiwei ; Yuan, Xiao-Tong ; Guo, Guodong</creator><creatorcontrib>Sun, Yubao ; Yang, Ying ; Liu, Qingshan ; Chen, Jiwei ; Yuan, Xiao-Tong ; Guo, Guodong</creatorcontrib><description>Deep learning-based Compressed Sensing (CS) reconstruction attracts much attention in recent years, due to its significant superiority of reconstruction quality. Its success is mainly attributed to the employment of a large dataset for pre-training the network to learn a reconstruction mapping. In this paper, we propose a non-locally regularized compressed sensing network for reconstructing image sequences, which can achieve high reconstruction quality without pre-training. Specifically, the proposed method attempts to learn a deep network prior for the reconstruction of an individual instance under the constraint that the network output can well match the given CS measurement. The non-local prior is designed to guide the network to capture the long-range dependencies by exploiting the self-similarities among images, and it can also make the network noise-aware. In order to deal with the compound of non-local prior and deep network prior, we construct a half-quadratic splitting based optimization method for network learning, in which the two priors are decoupled into two simple sub-problems by introducing an auxiliary variable and a quadratic fidelity constraint. Extensive experimental results demonstrate that our method is competitive to the popular methods, including sparsity prior based methods and deep learning based methods, even better than them in the cases of low measurement rates.</description><identifier>ISSN: 1520-9210</identifier><identifier>EISSN: 1941-0077</identifier><identifier>DOI: 10.1109/TMM.2020.2973862</identifier><identifier>CODEN: ITMUF8</identifier><language>eng</language><publisher>Piscataway: IEEE</publisher><subject>Compressed sensing ; Deep learning ; deep network prior ; Electronics packaging ; half-quadratic splitting ; Image reconstruction ; Image sequences ; Machine learning ; Noise measurement ; non-local prior ; Optimization ; Splitting ; Training ; Training data</subject><ispartof>IEEE transactions on multimedia, 2020-12, Vol.22 (12), p.3236-3248</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2020</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c291t-38560bbe005e4cc0c8658ffde9479a7206b17bae02334e58b66b266ce3368b863</citedby><cites>FETCH-LOGICAL-c291t-38560bbe005e4cc0c8658ffde9479a7206b17bae02334e58b66b266ce3368b863</cites><orcidid>0000-0001-9583-0055 ; 0000-0002-7835-5704 ; 0000-0002-0462-3729 ; 0000-0002-7151-8806 ; 0000-0002-5512-6984</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/8999514$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,780,784,796,27924,27925,54758</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/8999514$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Sun, Yubao</creatorcontrib><creatorcontrib>Yang, Ying</creatorcontrib><creatorcontrib>Liu, Qingshan</creatorcontrib><creatorcontrib>Chen, Jiwei</creatorcontrib><creatorcontrib>Yuan, Xiao-Tong</creatorcontrib><creatorcontrib>Guo, Guodong</creatorcontrib><title>Learning Non-Locally Regularized Compressed Sensing Network With Half-Quadratic Splitting</title><title>IEEE transactions on multimedia</title><addtitle>TMM</addtitle><description>Deep learning-based Compressed Sensing (CS) reconstruction attracts much attention in recent years, due to its significant superiority of reconstruction quality. Its success is mainly attributed to the employment of a large dataset for pre-training the network to learn a reconstruction mapping. In this paper, we propose a non-locally regularized compressed sensing network for reconstructing image sequences, which can achieve high reconstruction quality without pre-training. Specifically, the proposed method attempts to learn a deep network prior for the reconstruction of an individual instance under the constraint that the network output can well match the given CS measurement. The non-local prior is designed to guide the network to capture the long-range dependencies by exploiting the self-similarities among images, and it can also make the network noise-aware. In order to deal with the compound of non-local prior and deep network prior, we construct a half-quadratic splitting based optimization method for network learning, in which the two priors are decoupled into two simple sub-problems by introducing an auxiliary variable and a quadratic fidelity constraint. Extensive experimental results demonstrate that our method is competitive to the popular methods, including sparsity prior based methods and deep learning based methods, even better than them in the cases of low measurement rates.</description><subject>Compressed sensing</subject><subject>Deep learning</subject><subject>deep network prior</subject><subject>Electronics packaging</subject><subject>half-quadratic splitting</subject><subject>Image reconstruction</subject><subject>Image sequences</subject><subject>Machine learning</subject><subject>Noise measurement</subject><subject>non-local prior</subject><subject>Optimization</subject><subject>Splitting</subject><subject>Training</subject><subject>Training data</subject><issn>1520-9210</issn><issn>1941-0077</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2020</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNo9kEtLw0AUhQdRsFb3gpuA69Q7j8xjKUWtkCrairgaJulNTU2TOpMg9debWnF1z-I758JHyDmFEaVgrubT6YgBgxEzimvJDsiAGkFjAKUO-5wwiA2jcExOQlgBUJGAGpC3FJ2vy3oZPTR1nDa5q6pt9IzLrnK-_MZFNG7WG48h9HGGdfhFsf1q_Ef0Wrbv0cRVRfzUuYV3bZlHs01Vtm1PnZKjwlUBz_7ukLzc3szHkzh9vLsfX6dxzgxtY64TCVmGAAmKPIdcy0QXxQKNUMYpBjKjKnMIjHOBic6kzJiUOXIudaYlH5LL_e7GN58dhtaums7X_UvLhGSMCdV3hwT2VO6bEDwWduPLtfNbS8HuBNpeoN0JtH8C-8rFvlIi4j-ujTEJFfwHo6Vr-w</recordid><startdate>20201201</startdate><enddate>20201201</enddate><creator>Sun, Yubao</creator><creator>Yang, Ying</creator><creator>Liu, Qingshan</creator><creator>Chen, Jiwei</creator><creator>Yuan, Xiao-Tong</creator><creator>Guo, Guodong</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7SP</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><orcidid>https://orcid.org/0000-0001-9583-0055</orcidid><orcidid>https://orcid.org/0000-0002-7835-5704</orcidid><orcidid>https://orcid.org/0000-0002-0462-3729</orcidid><orcidid>https://orcid.org/0000-0002-7151-8806</orcidid><orcidid>https://orcid.org/0000-0002-5512-6984</orcidid></search><sort><creationdate>20201201</creationdate><title>Learning Non-Locally Regularized Compressed Sensing Network With Half-Quadratic Splitting</title><author>Sun, Yubao ; Yang, Ying ; Liu, Qingshan ; Chen, Jiwei ; Yuan, Xiao-Tong ; Guo, Guodong</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c291t-38560bbe005e4cc0c8658ffde9479a7206b17bae02334e58b66b266ce3368b863</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2020</creationdate><topic>Compressed sensing</topic><topic>Deep learning</topic><topic>deep network prior</topic><topic>Electronics packaging</topic><topic>half-quadratic splitting</topic><topic>Image reconstruction</topic><topic>Image sequences</topic><topic>Machine learning</topic><topic>Noise measurement</topic><topic>non-local prior</topic><topic>Optimization</topic><topic>Splitting</topic><topic>Training</topic><topic>Training data</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Sun, Yubao</creatorcontrib><creatorcontrib>Yang, Ying</creatorcontrib><creatorcontrib>Liu, Qingshan</creatorcontrib><creatorcontrib>Chen, Jiwei</creatorcontrib><creatorcontrib>Yuan, Xiao-Tong</creatorcontrib><creatorcontrib>Guo, Guodong</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics &amp; Communications Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>IEEE transactions on multimedia</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Sun, Yubao</au><au>Yang, Ying</au><au>Liu, Qingshan</au><au>Chen, Jiwei</au><au>Yuan, Xiao-Tong</au><au>Guo, Guodong</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Learning Non-Locally Regularized Compressed Sensing Network With Half-Quadratic Splitting</atitle><jtitle>IEEE transactions on multimedia</jtitle><stitle>TMM</stitle><date>2020-12-01</date><risdate>2020</risdate><volume>22</volume><issue>12</issue><spage>3236</spage><epage>3248</epage><pages>3236-3248</pages><issn>1520-9210</issn><eissn>1941-0077</eissn><coden>ITMUF8</coden><abstract>Deep learning-based Compressed Sensing (CS) reconstruction attracts much attention in recent years, due to its significant superiority of reconstruction quality. Its success is mainly attributed to the employment of a large dataset for pre-training the network to learn a reconstruction mapping. In this paper, we propose a non-locally regularized compressed sensing network for reconstructing image sequences, which can achieve high reconstruction quality without pre-training. Specifically, the proposed method attempts to learn a deep network prior for the reconstruction of an individual instance under the constraint that the network output can well match the given CS measurement. The non-local prior is designed to guide the network to capture the long-range dependencies by exploiting the self-similarities among images, and it can also make the network noise-aware. In order to deal with the compound of non-local prior and deep network prior, we construct a half-quadratic splitting based optimization method for network learning, in which the two priors are decoupled into two simple sub-problems by introducing an auxiliary variable and a quadratic fidelity constraint. Extensive experimental results demonstrate that our method is competitive to the popular methods, including sparsity prior based methods and deep learning based methods, even better than them in the cases of low measurement rates.</abstract><cop>Piscataway</cop><pub>IEEE</pub><doi>10.1109/TMM.2020.2973862</doi><tpages>13</tpages><orcidid>https://orcid.org/0000-0001-9583-0055</orcidid><orcidid>https://orcid.org/0000-0002-7835-5704</orcidid><orcidid>https://orcid.org/0000-0002-0462-3729</orcidid><orcidid>https://orcid.org/0000-0002-7151-8806</orcidid><orcidid>https://orcid.org/0000-0002-5512-6984</orcidid></addata></record>
fulltext fulltext_linktorsrc
identifier ISSN: 1520-9210
ispartof IEEE transactions on multimedia, 2020-12, Vol.22 (12), p.3236-3248
issn 1520-9210
1941-0077
language eng
recordid cdi_ieee_primary_8999514
source IEEE Electronic Library (IEL)
subjects Compressed sensing
Deep learning
deep network prior
Electronics packaging
half-quadratic splitting
Image reconstruction
Image sequences
Machine learning
Noise measurement
non-local prior
Optimization
Splitting
Training
Training data
title Learning Non-Locally Regularized Compressed Sensing Network With Half-Quadratic Splitting
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-29T09%3A24%3A23IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Learning%20Non-Locally%20Regularized%20Compressed%20Sensing%20Network%20With%20Half-Quadratic%20Splitting&rft.jtitle=IEEE%20transactions%20on%20multimedia&rft.au=Sun,%20Yubao&rft.date=2020-12-01&rft.volume=22&rft.issue=12&rft.spage=3236&rft.epage=3248&rft.pages=3236-3248&rft.issn=1520-9210&rft.eissn=1941-0077&rft.coden=ITMUF8&rft_id=info:doi/10.1109/TMM.2020.2973862&rft_dat=%3Cproquest_RIE%3E2462224702%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2462224702&rft_id=info:pmid/&rft_ieee_id=8999514&rfr_iscdi=true