Learning Non-Locally Regularized Compressed Sensing Network With Half-Quadratic Splitting
Deep learning-based Compressed Sensing (CS) reconstruction attracts much attention in recent years, due to its significant superiority of reconstruction quality. Its success is mainly attributed to the employment of a large dataset for pre-training the network to learn a reconstruction mapping. In t...
Gespeichert in:
Veröffentlicht in: | IEEE transactions on multimedia 2020-12, Vol.22 (12), p.3236-3248 |
---|---|
Hauptverfasser: | , , , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 3248 |
---|---|
container_issue | 12 |
container_start_page | 3236 |
container_title | IEEE transactions on multimedia |
container_volume | 22 |
creator | Sun, Yubao Yang, Ying Liu, Qingshan Chen, Jiwei Yuan, Xiao-Tong Guo, Guodong |
description | Deep learning-based Compressed Sensing (CS) reconstruction attracts much attention in recent years, due to its significant superiority of reconstruction quality. Its success is mainly attributed to the employment of a large dataset for pre-training the network to learn a reconstruction mapping. In this paper, we propose a non-locally regularized compressed sensing network for reconstructing image sequences, which can achieve high reconstruction quality without pre-training. Specifically, the proposed method attempts to learn a deep network prior for the reconstruction of an individual instance under the constraint that the network output can well match the given CS measurement. The non-local prior is designed to guide the network to capture the long-range dependencies by exploiting the self-similarities among images, and it can also make the network noise-aware. In order to deal with the compound of non-local prior and deep network prior, we construct a half-quadratic splitting based optimization method for network learning, in which the two priors are decoupled into two simple sub-problems by introducing an auxiliary variable and a quadratic fidelity constraint. Extensive experimental results demonstrate that our method is competitive to the popular methods, including sparsity prior based methods and deep learning based methods, even better than them in the cases of low measurement rates. |
doi_str_mv | 10.1109/TMM.2020.2973862 |
format | Article |
fullrecord | <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_ieee_primary_8999514</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>8999514</ieee_id><sourcerecordid>2462224702</sourcerecordid><originalsourceid>FETCH-LOGICAL-c291t-38560bbe005e4cc0c8658ffde9479a7206b17bae02334e58b66b266ce3368b863</originalsourceid><addsrcrecordid>eNo9kEtLw0AUhQdRsFb3gpuA69Q7j8xjKUWtkCrairgaJulNTU2TOpMg9debWnF1z-I758JHyDmFEaVgrubT6YgBgxEzimvJDsiAGkFjAKUO-5wwiA2jcExOQlgBUJGAGpC3FJ2vy3oZPTR1nDa5q6pt9IzLrnK-_MZFNG7WG48h9HGGdfhFsf1q_Ef0Wrbv0cRVRfzUuYV3bZlHs01Vtm1PnZKjwlUBz_7ukLzc3szHkzh9vLsfX6dxzgxtY64TCVmGAAmKPIdcy0QXxQKNUMYpBjKjKnMIjHOBic6kzJiUOXIudaYlH5LL_e7GN58dhtaums7X_UvLhGSMCdV3hwT2VO6bEDwWduPLtfNbS8HuBNpeoN0JtH8C-8rFvlIi4j-ujTEJFfwHo6Vr-w</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2462224702</pqid></control><display><type>article</type><title>Learning Non-Locally Regularized Compressed Sensing Network With Half-Quadratic Splitting</title><source>IEEE Electronic Library (IEL)</source><creator>Sun, Yubao ; Yang, Ying ; Liu, Qingshan ; Chen, Jiwei ; Yuan, Xiao-Tong ; Guo, Guodong</creator><creatorcontrib>Sun, Yubao ; Yang, Ying ; Liu, Qingshan ; Chen, Jiwei ; Yuan, Xiao-Tong ; Guo, Guodong</creatorcontrib><description>Deep learning-based Compressed Sensing (CS) reconstruction attracts much attention in recent years, due to its significant superiority of reconstruction quality. Its success is mainly attributed to the employment of a large dataset for pre-training the network to learn a reconstruction mapping. In this paper, we propose a non-locally regularized compressed sensing network for reconstructing image sequences, which can achieve high reconstruction quality without pre-training. Specifically, the proposed method attempts to learn a deep network prior for the reconstruction of an individual instance under the constraint that the network output can well match the given CS measurement. The non-local prior is designed to guide the network to capture the long-range dependencies by exploiting the self-similarities among images, and it can also make the network noise-aware. In order to deal with the compound of non-local prior and deep network prior, we construct a half-quadratic splitting based optimization method for network learning, in which the two priors are decoupled into two simple sub-problems by introducing an auxiliary variable and a quadratic fidelity constraint. Extensive experimental results demonstrate that our method is competitive to the popular methods, including sparsity prior based methods and deep learning based methods, even better than them in the cases of low measurement rates.</description><identifier>ISSN: 1520-9210</identifier><identifier>EISSN: 1941-0077</identifier><identifier>DOI: 10.1109/TMM.2020.2973862</identifier><identifier>CODEN: ITMUF8</identifier><language>eng</language><publisher>Piscataway: IEEE</publisher><subject>Compressed sensing ; Deep learning ; deep network prior ; Electronics packaging ; half-quadratic splitting ; Image reconstruction ; Image sequences ; Machine learning ; Noise measurement ; non-local prior ; Optimization ; Splitting ; Training ; Training data</subject><ispartof>IEEE transactions on multimedia, 2020-12, Vol.22 (12), p.3236-3248</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2020</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c291t-38560bbe005e4cc0c8658ffde9479a7206b17bae02334e58b66b266ce3368b863</citedby><cites>FETCH-LOGICAL-c291t-38560bbe005e4cc0c8658ffde9479a7206b17bae02334e58b66b266ce3368b863</cites><orcidid>0000-0001-9583-0055 ; 0000-0002-7835-5704 ; 0000-0002-0462-3729 ; 0000-0002-7151-8806 ; 0000-0002-5512-6984</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/8999514$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,780,784,796,27924,27925,54758</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/8999514$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Sun, Yubao</creatorcontrib><creatorcontrib>Yang, Ying</creatorcontrib><creatorcontrib>Liu, Qingshan</creatorcontrib><creatorcontrib>Chen, Jiwei</creatorcontrib><creatorcontrib>Yuan, Xiao-Tong</creatorcontrib><creatorcontrib>Guo, Guodong</creatorcontrib><title>Learning Non-Locally Regularized Compressed Sensing Network With Half-Quadratic Splitting</title><title>IEEE transactions on multimedia</title><addtitle>TMM</addtitle><description>Deep learning-based Compressed Sensing (CS) reconstruction attracts much attention in recent years, due to its significant superiority of reconstruction quality. Its success is mainly attributed to the employment of a large dataset for pre-training the network to learn a reconstruction mapping. In this paper, we propose a non-locally regularized compressed sensing network for reconstructing image sequences, which can achieve high reconstruction quality without pre-training. Specifically, the proposed method attempts to learn a deep network prior for the reconstruction of an individual instance under the constraint that the network output can well match the given CS measurement. The non-local prior is designed to guide the network to capture the long-range dependencies by exploiting the self-similarities among images, and it can also make the network noise-aware. In order to deal with the compound of non-local prior and deep network prior, we construct a half-quadratic splitting based optimization method for network learning, in which the two priors are decoupled into two simple sub-problems by introducing an auxiliary variable and a quadratic fidelity constraint. Extensive experimental results demonstrate that our method is competitive to the popular methods, including sparsity prior based methods and deep learning based methods, even better than them in the cases of low measurement rates.</description><subject>Compressed sensing</subject><subject>Deep learning</subject><subject>deep network prior</subject><subject>Electronics packaging</subject><subject>half-quadratic splitting</subject><subject>Image reconstruction</subject><subject>Image sequences</subject><subject>Machine learning</subject><subject>Noise measurement</subject><subject>non-local prior</subject><subject>Optimization</subject><subject>Splitting</subject><subject>Training</subject><subject>Training data</subject><issn>1520-9210</issn><issn>1941-0077</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2020</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNo9kEtLw0AUhQdRsFb3gpuA69Q7j8xjKUWtkCrairgaJulNTU2TOpMg9debWnF1z-I758JHyDmFEaVgrubT6YgBgxEzimvJDsiAGkFjAKUO-5wwiA2jcExOQlgBUJGAGpC3FJ2vy3oZPTR1nDa5q6pt9IzLrnK-_MZFNG7WG48h9HGGdfhFsf1q_Ef0Wrbv0cRVRfzUuYV3bZlHs01Vtm1PnZKjwlUBz_7ukLzc3szHkzh9vLsfX6dxzgxtY64TCVmGAAmKPIdcy0QXxQKNUMYpBjKjKnMIjHOBic6kzJiUOXIudaYlH5LL_e7GN58dhtaums7X_UvLhGSMCdV3hwT2VO6bEDwWduPLtfNbS8HuBNpeoN0JtH8C-8rFvlIi4j-ujTEJFfwHo6Vr-w</recordid><startdate>20201201</startdate><enddate>20201201</enddate><creator>Sun, Yubao</creator><creator>Yang, Ying</creator><creator>Liu, Qingshan</creator><creator>Chen, Jiwei</creator><creator>Yuan, Xiao-Tong</creator><creator>Guo, Guodong</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7SP</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><orcidid>https://orcid.org/0000-0001-9583-0055</orcidid><orcidid>https://orcid.org/0000-0002-7835-5704</orcidid><orcidid>https://orcid.org/0000-0002-0462-3729</orcidid><orcidid>https://orcid.org/0000-0002-7151-8806</orcidid><orcidid>https://orcid.org/0000-0002-5512-6984</orcidid></search><sort><creationdate>20201201</creationdate><title>Learning Non-Locally Regularized Compressed Sensing Network With Half-Quadratic Splitting</title><author>Sun, Yubao ; Yang, Ying ; Liu, Qingshan ; Chen, Jiwei ; Yuan, Xiao-Tong ; Guo, Guodong</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c291t-38560bbe005e4cc0c8658ffde9479a7206b17bae02334e58b66b266ce3368b863</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2020</creationdate><topic>Compressed sensing</topic><topic>Deep learning</topic><topic>deep network prior</topic><topic>Electronics packaging</topic><topic>half-quadratic splitting</topic><topic>Image reconstruction</topic><topic>Image sequences</topic><topic>Machine learning</topic><topic>Noise measurement</topic><topic>non-local prior</topic><topic>Optimization</topic><topic>Splitting</topic><topic>Training</topic><topic>Training data</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Sun, Yubao</creatorcontrib><creatorcontrib>Yang, Ying</creatorcontrib><creatorcontrib>Liu, Qingshan</creatorcontrib><creatorcontrib>Chen, Jiwei</creatorcontrib><creatorcontrib>Yuan, Xiao-Tong</creatorcontrib><creatorcontrib>Guo, Guodong</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics & Communications Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>IEEE transactions on multimedia</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Sun, Yubao</au><au>Yang, Ying</au><au>Liu, Qingshan</au><au>Chen, Jiwei</au><au>Yuan, Xiao-Tong</au><au>Guo, Guodong</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Learning Non-Locally Regularized Compressed Sensing Network With Half-Quadratic Splitting</atitle><jtitle>IEEE transactions on multimedia</jtitle><stitle>TMM</stitle><date>2020-12-01</date><risdate>2020</risdate><volume>22</volume><issue>12</issue><spage>3236</spage><epage>3248</epage><pages>3236-3248</pages><issn>1520-9210</issn><eissn>1941-0077</eissn><coden>ITMUF8</coden><abstract>Deep learning-based Compressed Sensing (CS) reconstruction attracts much attention in recent years, due to its significant superiority of reconstruction quality. Its success is mainly attributed to the employment of a large dataset for pre-training the network to learn a reconstruction mapping. In this paper, we propose a non-locally regularized compressed sensing network for reconstructing image sequences, which can achieve high reconstruction quality without pre-training. Specifically, the proposed method attempts to learn a deep network prior for the reconstruction of an individual instance under the constraint that the network output can well match the given CS measurement. The non-local prior is designed to guide the network to capture the long-range dependencies by exploiting the self-similarities among images, and it can also make the network noise-aware. In order to deal with the compound of non-local prior and deep network prior, we construct a half-quadratic splitting based optimization method for network learning, in which the two priors are decoupled into two simple sub-problems by introducing an auxiliary variable and a quadratic fidelity constraint. Extensive experimental results demonstrate that our method is competitive to the popular methods, including sparsity prior based methods and deep learning based methods, even better than them in the cases of low measurement rates.</abstract><cop>Piscataway</cop><pub>IEEE</pub><doi>10.1109/TMM.2020.2973862</doi><tpages>13</tpages><orcidid>https://orcid.org/0000-0001-9583-0055</orcidid><orcidid>https://orcid.org/0000-0002-7835-5704</orcidid><orcidid>https://orcid.org/0000-0002-0462-3729</orcidid><orcidid>https://orcid.org/0000-0002-7151-8806</orcidid><orcidid>https://orcid.org/0000-0002-5512-6984</orcidid></addata></record> |
fulltext | fulltext_linktorsrc |
identifier | ISSN: 1520-9210 |
ispartof | IEEE transactions on multimedia, 2020-12, Vol.22 (12), p.3236-3248 |
issn | 1520-9210 1941-0077 |
language | eng |
recordid | cdi_ieee_primary_8999514 |
source | IEEE Electronic Library (IEL) |
subjects | Compressed sensing Deep learning deep network prior Electronics packaging half-quadratic splitting Image reconstruction Image sequences Machine learning Noise measurement non-local prior Optimization Splitting Training Training data |
title | Learning Non-Locally Regularized Compressed Sensing Network With Half-Quadratic Splitting |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-29T09%3A24%3A23IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Learning%20Non-Locally%20Regularized%20Compressed%20Sensing%20Network%20With%20Half-Quadratic%20Splitting&rft.jtitle=IEEE%20transactions%20on%20multimedia&rft.au=Sun,%20Yubao&rft.date=2020-12-01&rft.volume=22&rft.issue=12&rft.spage=3236&rft.epage=3248&rft.pages=3236-3248&rft.issn=1520-9210&rft.eissn=1941-0077&rft.coden=ITMUF8&rft_id=info:doi/10.1109/TMM.2020.2973862&rft_dat=%3Cproquest_RIE%3E2462224702%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2462224702&rft_id=info:pmid/&rft_ieee_id=8999514&rfr_iscdi=true |