Stabilizing Nonuniformly Quantized Compressed Sensing With Scalar Companders
This paper addresses the problem of stably recovering sparse or compressible signals from compressed sensing measurements that have undergone optimal nonuniform scalar quantization, i.e., minimizing the common ℓ 2 -norm distortion. Generally, this quantized compressed sensing (QCS) problem is solved...
Gespeichert in:
Veröffentlicht in: | IEEE transactions on information theory 2013-12, Vol.59 (12), p.7969-7984 |
---|---|
Hauptverfasser: | , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 7984 |
---|---|
container_issue | 12 |
container_start_page | 7969 |
container_title | IEEE transactions on information theory |
container_volume | 59 |
creator | Jacques, Laurent Hammond, David K. Fadili, M. Jalal |
description | This paper addresses the problem of stably recovering sparse or compressible signals from compressed sensing measurements that have undergone optimal nonuniform scalar quantization, i.e., minimizing the common ℓ 2 -norm distortion. Generally, this quantized compressed sensing (QCS) problem is solved by minimizing the ℓ 1 -norm constrained by the ℓ 2 -norm distortion. In such cases, remeasurement and quantization of the reconstructed signal do not necessarily match the initial observations, showing that the whole QCS model is not consistent. Our approach considers instead that quantization distortion more closely resembles heteroscedastic uniform noise, with variance depending on the observed quantization bin. Generalizing our previous work on uniform quantization, we show that for nonuniform quantizers described by the "compander" formalism, quantization distortion may be better characterized as having bounded weighted ℓ p -norm (p ≥ 2), for a particular weighting. We develop a new reconstruction approach, termed Generalized Basis Pursuit DeNoise (GBPDN), which minimizes the ℓ 1 -norm of the signal to reconstruct constrained by this weighted ℓ p -norm fidelity. We prove that, for standard Gaussian sensing matrices and K sparse or compressible signals in R N with at least Ω((K logN/K) p/2 ) measurements, i.e., under strongly oversampled QCS scenario, GBPDN is ℓ 2 -ℓ 1 instance optimal and stable recovers all such sparse or compressible signals. The reconstruction error decreases as O(2 -B /√(p+1)) given a budget of B bits per measurement. This yields a reduction by a factor √(p+1) of the reconstruction error compared to the one produced by ℓ 2 -norm constrained decoders. We also propose an primal-dual proximal splitting scheme to solve the GBPDN program which is efficient for large-scale problems. Interestingly, extensive simulations testing the GBPDN effectiveness confirm the trend predicted by the theory, that the reconstruction error can indeed be reduced by increasing p, but this is achieved at a much less stringent oversampling regime than the one expected by the theoretical bounds. Besides the QCS scenario, we also show that GBPDN applies straightforwardly to the related case of CS measurements corrupted by heteroscedastic generalized Gaussian noise with provable reconstruction error reduction. |
doi_str_mv | 10.1109/TIT.2013.2281815 |
format | Article |
fullrecord | <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_crossref_primary_10_1109_TIT_2013_2281815</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>6600822</ieee_id><sourcerecordid>3142874101</sourcerecordid><originalsourceid>FETCH-LOGICAL-c397t-dbde8ebd278358996ad83111ff4e0408b71a93a3f0b3461b7870911ce0260f0d3</originalsourceid><addsrcrecordid>eNo9kE1LAzEQhoMoWD_ugpeCePCwdSbJbpJjKX4UiiKteAzZ3axN2e7WZCu0v97Ulp4yyTzzZngIuUEYIIJ6nI1nAwrIBpRKlJiekB6mqUhUlvJT0gNAmSjO5Tm5CGERrzxF2iOTaWdyV7uta777b22zblzV-mW96X-sTdO5rS37o3a58jaEWE5tE3bkl-vm_WlhauP_26YprQ9X5KwydbDXh_OSfD4_zUavyeT9ZTwaTpKCKdElZV5aafOSCslSqVRmSskQsaq4BQ4yF2gUM6yCnPEMcyEFKMTCAs2ggpJdkod97tzUeuXd0viNbo3Tr8OJ3r0BKJoJkf1iZO_27Mq3P2sbOr1o176J62nkGZWRyiBSsKcK34bgbXWMRdA7vzr61Tu_-uA3jtwfgk2IIipvmsKF4xyVIBiXMnK3e85Za4_t-ClIStkfxvOCDw</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>1462877660</pqid></control><display><type>article</type><title>Stabilizing Nonuniformly Quantized Compressed Sensing With Scalar Companders</title><source>IEEE Electronic Library (IEL)</source><creator>Jacques, Laurent ; Hammond, David K. ; Fadili, M. Jalal</creator><creatorcontrib>Jacques, Laurent ; Hammond, David K. ; Fadili, M. Jalal</creatorcontrib><description>This paper addresses the problem of stably recovering sparse or compressible signals from compressed sensing measurements that have undergone optimal nonuniform scalar quantization, i.e., minimizing the common ℓ 2 -norm distortion. Generally, this quantized compressed sensing (QCS) problem is solved by minimizing the ℓ 1 -norm constrained by the ℓ 2 -norm distortion. In such cases, remeasurement and quantization of the reconstructed signal do not necessarily match the initial observations, showing that the whole QCS model is not consistent. Our approach considers instead that quantization distortion more closely resembles heteroscedastic uniform noise, with variance depending on the observed quantization bin. Generalizing our previous work on uniform quantization, we show that for nonuniform quantizers described by the "compander" formalism, quantization distortion may be better characterized as having bounded weighted ℓ p -norm (p ≥ 2), for a particular weighting. We develop a new reconstruction approach, termed Generalized Basis Pursuit DeNoise (GBPDN), which minimizes the ℓ 1 -norm of the signal to reconstruct constrained by this weighted ℓ p -norm fidelity. We prove that, for standard Gaussian sensing matrices and K sparse or compressible signals in R N with at least Ω((K logN/K) p/2 ) measurements, i.e., under strongly oversampled QCS scenario, GBPDN is ℓ 2 -ℓ 1 instance optimal and stable recovers all such sparse or compressible signals. The reconstruction error decreases as O(2 -B /√(p+1)) given a budget of B bits per measurement. This yields a reduction by a factor √(p+1) of the reconstruction error compared to the one produced by ℓ 2 -norm constrained decoders. We also propose an primal-dual proximal splitting scheme to solve the GBPDN program which is efficient for large-scale problems. Interestingly, extensive simulations testing the GBPDN effectiveness confirm the trend predicted by the theory, that the reconstruction error can indeed be reduced by increasing p, but this is achieved at a much less stringent oversampling regime than the one expected by the theoretical bounds. Besides the QCS scenario, we also show that GBPDN applies straightforwardly to the related case of CS measurements corrupted by heteroscedastic generalized Gaussian noise with provable reconstruction error reduction.</description><identifier>ISSN: 0018-9448</identifier><identifier>EISSN: 1557-9654</identifier><identifier>DOI: 10.1109/TIT.2013.2281815</identifier><identifier>CODEN: IETTAW</identifier><language>eng</language><publisher>New York, NY: IEEE</publisher><subject>Applied sciences ; Basis pursuit ; Coding, codes ; compander theory ; Compressed sensing ; Computer Science ; convex optimization ; Detection, estimation, filtering, equalization, prediction ; Distortion measurement ; Errors ; Exact sciences and technology ; heteroscedasticity ; Image Processing ; Information theory ; Information, signal and communications theory ; instance optimality ; Measurement ; Noise ; Noise measurement ; noise stabilization ; non-uniform quantization ; Normal distribution ; oversampling ; quantization ; Quantization (signal) ; Reconstruction algorithms ; Sampling, quantization ; Sensors ; Signal and communications theory ; Signal, noise ; Telecommunications and information theory</subject><ispartof>IEEE transactions on information theory, 2013-12, Vol.59 (12), p.7969-7984</ispartof><rights>2015 INIST-CNRS</rights><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) Dec 2013</rights><rights>Distributed under a Creative Commons Attribution 4.0 International License</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c397t-dbde8ebd278358996ad83111ff4e0408b71a93a3f0b3461b7870911ce0260f0d3</citedby><cites>FETCH-LOGICAL-c397t-dbde8ebd278358996ad83111ff4e0408b71a93a3f0b3461b7870911ce0260f0d3</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/6600822$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>230,314,778,782,794,883,27907,27908,54741</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/6600822$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc><backlink>$$Uhttp://pascal-francis.inist.fr/vibad/index.php?action=getRecordDetail&idt=28073488$$DView record in Pascal Francis$$Hfree_for_read</backlink><backlink>$$Uhttps://hal.science/hal-00926776$$DView record in HAL$$Hfree_for_read</backlink></links><search><creatorcontrib>Jacques, Laurent</creatorcontrib><creatorcontrib>Hammond, David K.</creatorcontrib><creatorcontrib>Fadili, M. Jalal</creatorcontrib><title>Stabilizing Nonuniformly Quantized Compressed Sensing With Scalar Companders</title><title>IEEE transactions on information theory</title><addtitle>TIT</addtitle><description>This paper addresses the problem of stably recovering sparse or compressible signals from compressed sensing measurements that have undergone optimal nonuniform scalar quantization, i.e., minimizing the common ℓ 2 -norm distortion. Generally, this quantized compressed sensing (QCS) problem is solved by minimizing the ℓ 1 -norm constrained by the ℓ 2 -norm distortion. In such cases, remeasurement and quantization of the reconstructed signal do not necessarily match the initial observations, showing that the whole QCS model is not consistent. Our approach considers instead that quantization distortion more closely resembles heteroscedastic uniform noise, with variance depending on the observed quantization bin. Generalizing our previous work on uniform quantization, we show that for nonuniform quantizers described by the "compander" formalism, quantization distortion may be better characterized as having bounded weighted ℓ p -norm (p ≥ 2), for a particular weighting. We develop a new reconstruction approach, termed Generalized Basis Pursuit DeNoise (GBPDN), which minimizes the ℓ 1 -norm of the signal to reconstruct constrained by this weighted ℓ p -norm fidelity. We prove that, for standard Gaussian sensing matrices and K sparse or compressible signals in R N with at least Ω((K logN/K) p/2 ) measurements, i.e., under strongly oversampled QCS scenario, GBPDN is ℓ 2 -ℓ 1 instance optimal and stable recovers all such sparse or compressible signals. The reconstruction error decreases as O(2 -B /√(p+1)) given a budget of B bits per measurement. This yields a reduction by a factor √(p+1) of the reconstruction error compared to the one produced by ℓ 2 -norm constrained decoders. We also propose an primal-dual proximal splitting scheme to solve the GBPDN program which is efficient for large-scale problems. Interestingly, extensive simulations testing the GBPDN effectiveness confirm the trend predicted by the theory, that the reconstruction error can indeed be reduced by increasing p, but this is achieved at a much less stringent oversampling regime than the one expected by the theoretical bounds. Besides the QCS scenario, we also show that GBPDN applies straightforwardly to the related case of CS measurements corrupted by heteroscedastic generalized Gaussian noise with provable reconstruction error reduction.</description><subject>Applied sciences</subject><subject>Basis pursuit</subject><subject>Coding, codes</subject><subject>compander theory</subject><subject>Compressed sensing</subject><subject>Computer Science</subject><subject>convex optimization</subject><subject>Detection, estimation, filtering, equalization, prediction</subject><subject>Distortion measurement</subject><subject>Errors</subject><subject>Exact sciences and technology</subject><subject>heteroscedasticity</subject><subject>Image Processing</subject><subject>Information theory</subject><subject>Information, signal and communications theory</subject><subject>instance optimality</subject><subject>Measurement</subject><subject>Noise</subject><subject>Noise measurement</subject><subject>noise stabilization</subject><subject>non-uniform quantization</subject><subject>Normal distribution</subject><subject>oversampling</subject><subject>quantization</subject><subject>Quantization (signal)</subject><subject>Reconstruction algorithms</subject><subject>Sampling, quantization</subject><subject>Sensors</subject><subject>Signal and communications theory</subject><subject>Signal, noise</subject><subject>Telecommunications and information theory</subject><issn>0018-9448</issn><issn>1557-9654</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2013</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNo9kE1LAzEQhoMoWD_ugpeCePCwdSbJbpJjKX4UiiKteAzZ3axN2e7WZCu0v97Ulp4yyTzzZngIuUEYIIJ6nI1nAwrIBpRKlJiekB6mqUhUlvJT0gNAmSjO5Tm5CGERrzxF2iOTaWdyV7uta777b22zblzV-mW96X-sTdO5rS37o3a58jaEWE5tE3bkl-vm_WlhauP_26YprQ9X5KwydbDXh_OSfD4_zUavyeT9ZTwaTpKCKdElZV5aafOSCslSqVRmSskQsaq4BQ4yF2gUM6yCnPEMcyEFKMTCAs2ggpJdkod97tzUeuXd0viNbo3Tr8OJ3r0BKJoJkf1iZO_27Mq3P2sbOr1o176J62nkGZWRyiBSsKcK34bgbXWMRdA7vzr61Tu_-uA3jtwfgk2IIipvmsKF4xyVIBiXMnK3e85Za4_t-ClIStkfxvOCDw</recordid><startdate>20131201</startdate><enddate>20131201</enddate><creator>Jacques, Laurent</creator><creator>Hammond, David K.</creator><creator>Fadili, M. Jalal</creator><general>IEEE</general><general>Institute of Electrical and Electronics Engineers</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>IQODW</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7SP</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>1XC</scope><scope>VOOES</scope></search><sort><creationdate>20131201</creationdate><title>Stabilizing Nonuniformly Quantized Compressed Sensing With Scalar Companders</title><author>Jacques, Laurent ; Hammond, David K. ; Fadili, M. Jalal</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c397t-dbde8ebd278358996ad83111ff4e0408b71a93a3f0b3461b7870911ce0260f0d3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2013</creationdate><topic>Applied sciences</topic><topic>Basis pursuit</topic><topic>Coding, codes</topic><topic>compander theory</topic><topic>Compressed sensing</topic><topic>Computer Science</topic><topic>convex optimization</topic><topic>Detection, estimation, filtering, equalization, prediction</topic><topic>Distortion measurement</topic><topic>Errors</topic><topic>Exact sciences and technology</topic><topic>heteroscedasticity</topic><topic>Image Processing</topic><topic>Information theory</topic><topic>Information, signal and communications theory</topic><topic>instance optimality</topic><topic>Measurement</topic><topic>Noise</topic><topic>Noise measurement</topic><topic>noise stabilization</topic><topic>non-uniform quantization</topic><topic>Normal distribution</topic><topic>oversampling</topic><topic>quantization</topic><topic>Quantization (signal)</topic><topic>Reconstruction algorithms</topic><topic>Sampling, quantization</topic><topic>Sensors</topic><topic>Signal and communications theory</topic><topic>Signal, noise</topic><topic>Telecommunications and information theory</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Jacques, Laurent</creatorcontrib><creatorcontrib>Hammond, David K.</creatorcontrib><creatorcontrib>Fadili, M. Jalal</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>Pascal-Francis</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics & Communications Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>Hyper Article en Ligne (HAL)</collection><collection>Hyper Article en Ligne (HAL) (Open Access)</collection><jtitle>IEEE transactions on information theory</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Jacques, Laurent</au><au>Hammond, David K.</au><au>Fadili, M. Jalal</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Stabilizing Nonuniformly Quantized Compressed Sensing With Scalar Companders</atitle><jtitle>IEEE transactions on information theory</jtitle><stitle>TIT</stitle><date>2013-12-01</date><risdate>2013</risdate><volume>59</volume><issue>12</issue><spage>7969</spage><epage>7984</epage><pages>7969-7984</pages><issn>0018-9448</issn><eissn>1557-9654</eissn><coden>IETTAW</coden><abstract>This paper addresses the problem of stably recovering sparse or compressible signals from compressed sensing measurements that have undergone optimal nonuniform scalar quantization, i.e., minimizing the common ℓ 2 -norm distortion. Generally, this quantized compressed sensing (QCS) problem is solved by minimizing the ℓ 1 -norm constrained by the ℓ 2 -norm distortion. In such cases, remeasurement and quantization of the reconstructed signal do not necessarily match the initial observations, showing that the whole QCS model is not consistent. Our approach considers instead that quantization distortion more closely resembles heteroscedastic uniform noise, with variance depending on the observed quantization bin. Generalizing our previous work on uniform quantization, we show that for nonuniform quantizers described by the "compander" formalism, quantization distortion may be better characterized as having bounded weighted ℓ p -norm (p ≥ 2), for a particular weighting. We develop a new reconstruction approach, termed Generalized Basis Pursuit DeNoise (GBPDN), which minimizes the ℓ 1 -norm of the signal to reconstruct constrained by this weighted ℓ p -norm fidelity. We prove that, for standard Gaussian sensing matrices and K sparse or compressible signals in R N with at least Ω((K logN/K) p/2 ) measurements, i.e., under strongly oversampled QCS scenario, GBPDN is ℓ 2 -ℓ 1 instance optimal and stable recovers all such sparse or compressible signals. The reconstruction error decreases as O(2 -B /√(p+1)) given a budget of B bits per measurement. This yields a reduction by a factor √(p+1) of the reconstruction error compared to the one produced by ℓ 2 -norm constrained decoders. We also propose an primal-dual proximal splitting scheme to solve the GBPDN program which is efficient for large-scale problems. Interestingly, extensive simulations testing the GBPDN effectiveness confirm the trend predicted by the theory, that the reconstruction error can indeed be reduced by increasing p, but this is achieved at a much less stringent oversampling regime than the one expected by the theoretical bounds. Besides the QCS scenario, we also show that GBPDN applies straightforwardly to the related case of CS measurements corrupted by heteroscedastic generalized Gaussian noise with provable reconstruction error reduction.</abstract><cop>New York, NY</cop><pub>IEEE</pub><doi>10.1109/TIT.2013.2281815</doi><tpages>16</tpages><oa>free_for_read</oa></addata></record> |
fulltext | fulltext_linktorsrc |
identifier | ISSN: 0018-9448 |
ispartof | IEEE transactions on information theory, 2013-12, Vol.59 (12), p.7969-7984 |
issn | 0018-9448 1557-9654 |
language | eng |
recordid | cdi_crossref_primary_10_1109_TIT_2013_2281815 |
source | IEEE Electronic Library (IEL) |
subjects | Applied sciences Basis pursuit Coding, codes compander theory Compressed sensing Computer Science convex optimization Detection, estimation, filtering, equalization, prediction Distortion measurement Errors Exact sciences and technology heteroscedasticity Image Processing Information theory Information, signal and communications theory instance optimality Measurement Noise Noise measurement noise stabilization non-uniform quantization Normal distribution oversampling quantization Quantization (signal) Reconstruction algorithms Sampling, quantization Sensors Signal and communications theory Signal, noise Telecommunications and information theory |
title | Stabilizing Nonuniformly Quantized Compressed Sensing With Scalar Companders |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-17T00%3A15%3A21IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Stabilizing%20Nonuniformly%20Quantized%20Compressed%20Sensing%20With%20Scalar%20Companders&rft.jtitle=IEEE%20transactions%20on%20information%20theory&rft.au=Jacques,%20Laurent&rft.date=2013-12-01&rft.volume=59&rft.issue=12&rft.spage=7969&rft.epage=7984&rft.pages=7969-7984&rft.issn=0018-9448&rft.eissn=1557-9654&rft.coden=IETTAW&rft_id=info:doi/10.1109/TIT.2013.2281815&rft_dat=%3Cproquest_RIE%3E3142874101%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=1462877660&rft_id=info:pmid/&rft_ieee_id=6600822&rfr_iscdi=true |