Stabilizing Nonuniformly Quantized Compressed Sensing With Scalar Companders

This paper addresses the problem of stably recovering sparse or compressible signals from compressed sensing measurements that have undergone optimal nonuniform scalar quantization, i.e., minimizing the common ℓ 2 -norm distortion. Generally, this quantized compressed sensing (QCS) problem is solved...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on information theory 2013-12, Vol.59 (12), p.7969-7984
Hauptverfasser: Jacques, Laurent, Hammond, David K., Fadili, M. Jalal
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 7984
container_issue 12
container_start_page 7969
container_title IEEE transactions on information theory
container_volume 59
creator Jacques, Laurent
Hammond, David K.
Fadili, M. Jalal
description This paper addresses the problem of stably recovering sparse or compressible signals from compressed sensing measurements that have undergone optimal nonuniform scalar quantization, i.e., minimizing the common ℓ 2 -norm distortion. Generally, this quantized compressed sensing (QCS) problem is solved by minimizing the ℓ 1 -norm constrained by the ℓ 2 -norm distortion. In such cases, remeasurement and quantization of the reconstructed signal do not necessarily match the initial observations, showing that the whole QCS model is not consistent. Our approach considers instead that quantization distortion more closely resembles heteroscedastic uniform noise, with variance depending on the observed quantization bin. Generalizing our previous work on uniform quantization, we show that for nonuniform quantizers described by the "compander" formalism, quantization distortion may be better characterized as having bounded weighted ℓ p -norm (p ≥ 2), for a particular weighting. We develop a new reconstruction approach, termed Generalized Basis Pursuit DeNoise (GBPDN), which minimizes the ℓ 1 -norm of the signal to reconstruct constrained by this weighted ℓ p -norm fidelity. We prove that, for standard Gaussian sensing matrices and K sparse or compressible signals in R N with at least Ω((K logN/K) p/2 ) measurements, i.e., under strongly oversampled QCS scenario, GBPDN is ℓ 2 -ℓ 1 instance optimal and stable recovers all such sparse or compressible signals. The reconstruction error decreases as O(2 -B /√(p+1)) given a budget of B bits per measurement. This yields a reduction by a factor √(p+1) of the reconstruction error compared to the one produced by ℓ 2 -norm constrained decoders. We also propose an primal-dual proximal splitting scheme to solve the GBPDN program which is efficient for large-scale problems. Interestingly, extensive simulations testing the GBPDN effectiveness confirm the trend predicted by the theory, that the reconstruction error can indeed be reduced by increasing p, but this is achieved at a much less stringent oversampling regime than the one expected by the theoretical bounds. Besides the QCS scenario, we also show that GBPDN applies straightforwardly to the related case of CS measurements corrupted by heteroscedastic generalized Gaussian noise with provable reconstruction error reduction.
doi_str_mv 10.1109/TIT.2013.2281815
format Article
fullrecord <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_crossref_primary_10_1109_TIT_2013_2281815</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>6600822</ieee_id><sourcerecordid>3142874101</sourcerecordid><originalsourceid>FETCH-LOGICAL-c397t-dbde8ebd278358996ad83111ff4e0408b71a93a3f0b3461b7870911ce0260f0d3</originalsourceid><addsrcrecordid>eNo9kE1LAzEQhoMoWD_ugpeCePCwdSbJbpJjKX4UiiKteAzZ3axN2e7WZCu0v97Ulp4yyTzzZngIuUEYIIJ6nI1nAwrIBpRKlJiekB6mqUhUlvJT0gNAmSjO5Tm5CGERrzxF2iOTaWdyV7uta777b22zblzV-mW96X-sTdO5rS37o3a58jaEWE5tE3bkl-vm_WlhauP_26YprQ9X5KwydbDXh_OSfD4_zUavyeT9ZTwaTpKCKdElZV5aafOSCslSqVRmSskQsaq4BQ4yF2gUM6yCnPEMcyEFKMTCAs2ggpJdkod97tzUeuXd0viNbo3Tr8OJ3r0BKJoJkf1iZO_27Mq3P2sbOr1o176J62nkGZWRyiBSsKcK34bgbXWMRdA7vzr61Tu_-uA3jtwfgk2IIipvmsKF4xyVIBiXMnK3e85Za4_t-ClIStkfxvOCDw</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>1462877660</pqid></control><display><type>article</type><title>Stabilizing Nonuniformly Quantized Compressed Sensing With Scalar Companders</title><source>IEEE Electronic Library (IEL)</source><creator>Jacques, Laurent ; Hammond, David K. ; Fadili, M. Jalal</creator><creatorcontrib>Jacques, Laurent ; Hammond, David K. ; Fadili, M. Jalal</creatorcontrib><description>This paper addresses the problem of stably recovering sparse or compressible signals from compressed sensing measurements that have undergone optimal nonuniform scalar quantization, i.e., minimizing the common ℓ 2 -norm distortion. Generally, this quantized compressed sensing (QCS) problem is solved by minimizing the ℓ 1 -norm constrained by the ℓ 2 -norm distortion. In such cases, remeasurement and quantization of the reconstructed signal do not necessarily match the initial observations, showing that the whole QCS model is not consistent. Our approach considers instead that quantization distortion more closely resembles heteroscedastic uniform noise, with variance depending on the observed quantization bin. Generalizing our previous work on uniform quantization, we show that for nonuniform quantizers described by the "compander" formalism, quantization distortion may be better characterized as having bounded weighted ℓ p -norm (p ≥ 2), for a particular weighting. We develop a new reconstruction approach, termed Generalized Basis Pursuit DeNoise (GBPDN), which minimizes the ℓ 1 -norm of the signal to reconstruct constrained by this weighted ℓ p -norm fidelity. We prove that, for standard Gaussian sensing matrices and K sparse or compressible signals in R N with at least Ω((K logN/K) p/2 ) measurements, i.e., under strongly oversampled QCS scenario, GBPDN is ℓ 2 -ℓ 1 instance optimal and stable recovers all such sparse or compressible signals. The reconstruction error decreases as O(2 -B /√(p+1)) given a budget of B bits per measurement. This yields a reduction by a factor √(p+1) of the reconstruction error compared to the one produced by ℓ 2 -norm constrained decoders. We also propose an primal-dual proximal splitting scheme to solve the GBPDN program which is efficient for large-scale problems. Interestingly, extensive simulations testing the GBPDN effectiveness confirm the trend predicted by the theory, that the reconstruction error can indeed be reduced by increasing p, but this is achieved at a much less stringent oversampling regime than the one expected by the theoretical bounds. Besides the QCS scenario, we also show that GBPDN applies straightforwardly to the related case of CS measurements corrupted by heteroscedastic generalized Gaussian noise with provable reconstruction error reduction.</description><identifier>ISSN: 0018-9448</identifier><identifier>EISSN: 1557-9654</identifier><identifier>DOI: 10.1109/TIT.2013.2281815</identifier><identifier>CODEN: IETTAW</identifier><language>eng</language><publisher>New York, NY: IEEE</publisher><subject>Applied sciences ; Basis pursuit ; Coding, codes ; compander theory ; Compressed sensing ; Computer Science ; convex optimization ; Detection, estimation, filtering, equalization, prediction ; Distortion measurement ; Errors ; Exact sciences and technology ; heteroscedasticity ; Image Processing ; Information theory ; Information, signal and communications theory ; instance optimality ; Measurement ; Noise ; Noise measurement ; noise stabilization ; non-uniform quantization ; Normal distribution ; oversampling ; quantization ; Quantization (signal) ; Reconstruction algorithms ; Sampling, quantization ; Sensors ; Signal and communications theory ; Signal, noise ; Telecommunications and information theory</subject><ispartof>IEEE transactions on information theory, 2013-12, Vol.59 (12), p.7969-7984</ispartof><rights>2015 INIST-CNRS</rights><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) Dec 2013</rights><rights>Distributed under a Creative Commons Attribution 4.0 International License</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c397t-dbde8ebd278358996ad83111ff4e0408b71a93a3f0b3461b7870911ce0260f0d3</citedby><cites>FETCH-LOGICAL-c397t-dbde8ebd278358996ad83111ff4e0408b71a93a3f0b3461b7870911ce0260f0d3</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/6600822$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>230,314,778,782,794,883,27907,27908,54741</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/6600822$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc><backlink>$$Uhttp://pascal-francis.inist.fr/vibad/index.php?action=getRecordDetail&amp;idt=28073488$$DView record in Pascal Francis$$Hfree_for_read</backlink><backlink>$$Uhttps://hal.science/hal-00926776$$DView record in HAL$$Hfree_for_read</backlink></links><search><creatorcontrib>Jacques, Laurent</creatorcontrib><creatorcontrib>Hammond, David K.</creatorcontrib><creatorcontrib>Fadili, M. Jalal</creatorcontrib><title>Stabilizing Nonuniformly Quantized Compressed Sensing With Scalar Companders</title><title>IEEE transactions on information theory</title><addtitle>TIT</addtitle><description>This paper addresses the problem of stably recovering sparse or compressible signals from compressed sensing measurements that have undergone optimal nonuniform scalar quantization, i.e., minimizing the common ℓ 2 -norm distortion. Generally, this quantized compressed sensing (QCS) problem is solved by minimizing the ℓ 1 -norm constrained by the ℓ 2 -norm distortion. In such cases, remeasurement and quantization of the reconstructed signal do not necessarily match the initial observations, showing that the whole QCS model is not consistent. Our approach considers instead that quantization distortion more closely resembles heteroscedastic uniform noise, with variance depending on the observed quantization bin. Generalizing our previous work on uniform quantization, we show that for nonuniform quantizers described by the "compander" formalism, quantization distortion may be better characterized as having bounded weighted ℓ p -norm (p ≥ 2), for a particular weighting. We develop a new reconstruction approach, termed Generalized Basis Pursuit DeNoise (GBPDN), which minimizes the ℓ 1 -norm of the signal to reconstruct constrained by this weighted ℓ p -norm fidelity. We prove that, for standard Gaussian sensing matrices and K sparse or compressible signals in R N with at least Ω((K logN/K) p/2 ) measurements, i.e., under strongly oversampled QCS scenario, GBPDN is ℓ 2 -ℓ 1 instance optimal and stable recovers all such sparse or compressible signals. The reconstruction error decreases as O(2 -B /√(p+1)) given a budget of B bits per measurement. This yields a reduction by a factor √(p+1) of the reconstruction error compared to the one produced by ℓ 2 -norm constrained decoders. We also propose an primal-dual proximal splitting scheme to solve the GBPDN program which is efficient for large-scale problems. Interestingly, extensive simulations testing the GBPDN effectiveness confirm the trend predicted by the theory, that the reconstruction error can indeed be reduced by increasing p, but this is achieved at a much less stringent oversampling regime than the one expected by the theoretical bounds. Besides the QCS scenario, we also show that GBPDN applies straightforwardly to the related case of CS measurements corrupted by heteroscedastic generalized Gaussian noise with provable reconstruction error reduction.</description><subject>Applied sciences</subject><subject>Basis pursuit</subject><subject>Coding, codes</subject><subject>compander theory</subject><subject>Compressed sensing</subject><subject>Computer Science</subject><subject>convex optimization</subject><subject>Detection, estimation, filtering, equalization, prediction</subject><subject>Distortion measurement</subject><subject>Errors</subject><subject>Exact sciences and technology</subject><subject>heteroscedasticity</subject><subject>Image Processing</subject><subject>Information theory</subject><subject>Information, signal and communications theory</subject><subject>instance optimality</subject><subject>Measurement</subject><subject>Noise</subject><subject>Noise measurement</subject><subject>noise stabilization</subject><subject>non-uniform quantization</subject><subject>Normal distribution</subject><subject>oversampling</subject><subject>quantization</subject><subject>Quantization (signal)</subject><subject>Reconstruction algorithms</subject><subject>Sampling, quantization</subject><subject>Sensors</subject><subject>Signal and communications theory</subject><subject>Signal, noise</subject><subject>Telecommunications and information theory</subject><issn>0018-9448</issn><issn>1557-9654</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2013</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNo9kE1LAzEQhoMoWD_ugpeCePCwdSbJbpJjKX4UiiKteAzZ3axN2e7WZCu0v97Ulp4yyTzzZngIuUEYIIJ6nI1nAwrIBpRKlJiekB6mqUhUlvJT0gNAmSjO5Tm5CGERrzxF2iOTaWdyV7uta777b22zblzV-mW96X-sTdO5rS37o3a58jaEWE5tE3bkl-vm_WlhauP_26YprQ9X5KwydbDXh_OSfD4_zUavyeT9ZTwaTpKCKdElZV5aafOSCslSqVRmSskQsaq4BQ4yF2gUM6yCnPEMcyEFKMTCAs2ggpJdkod97tzUeuXd0viNbo3Tr8OJ3r0BKJoJkf1iZO_27Mq3P2sbOr1o176J62nkGZWRyiBSsKcK34bgbXWMRdA7vzr61Tu_-uA3jtwfgk2IIipvmsKF4xyVIBiXMnK3e85Za4_t-ClIStkfxvOCDw</recordid><startdate>20131201</startdate><enddate>20131201</enddate><creator>Jacques, Laurent</creator><creator>Hammond, David K.</creator><creator>Fadili, M. Jalal</creator><general>IEEE</general><general>Institute of Electrical and Electronics Engineers</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>IQODW</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7SP</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>1XC</scope><scope>VOOES</scope></search><sort><creationdate>20131201</creationdate><title>Stabilizing Nonuniformly Quantized Compressed Sensing With Scalar Companders</title><author>Jacques, Laurent ; Hammond, David K. ; Fadili, M. Jalal</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c397t-dbde8ebd278358996ad83111ff4e0408b71a93a3f0b3461b7870911ce0260f0d3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2013</creationdate><topic>Applied sciences</topic><topic>Basis pursuit</topic><topic>Coding, codes</topic><topic>compander theory</topic><topic>Compressed sensing</topic><topic>Computer Science</topic><topic>convex optimization</topic><topic>Detection, estimation, filtering, equalization, prediction</topic><topic>Distortion measurement</topic><topic>Errors</topic><topic>Exact sciences and technology</topic><topic>heteroscedasticity</topic><topic>Image Processing</topic><topic>Information theory</topic><topic>Information, signal and communications theory</topic><topic>instance optimality</topic><topic>Measurement</topic><topic>Noise</topic><topic>Noise measurement</topic><topic>noise stabilization</topic><topic>non-uniform quantization</topic><topic>Normal distribution</topic><topic>oversampling</topic><topic>quantization</topic><topic>Quantization (signal)</topic><topic>Reconstruction algorithms</topic><topic>Sampling, quantization</topic><topic>Sensors</topic><topic>Signal and communications theory</topic><topic>Signal, noise</topic><topic>Telecommunications and information theory</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Jacques, Laurent</creatorcontrib><creatorcontrib>Hammond, David K.</creatorcontrib><creatorcontrib>Fadili, M. Jalal</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>Pascal-Francis</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics &amp; Communications Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>Hyper Article en Ligne (HAL)</collection><collection>Hyper Article en Ligne (HAL) (Open Access)</collection><jtitle>IEEE transactions on information theory</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Jacques, Laurent</au><au>Hammond, David K.</au><au>Fadili, M. Jalal</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Stabilizing Nonuniformly Quantized Compressed Sensing With Scalar Companders</atitle><jtitle>IEEE transactions on information theory</jtitle><stitle>TIT</stitle><date>2013-12-01</date><risdate>2013</risdate><volume>59</volume><issue>12</issue><spage>7969</spage><epage>7984</epage><pages>7969-7984</pages><issn>0018-9448</issn><eissn>1557-9654</eissn><coden>IETTAW</coden><abstract>This paper addresses the problem of stably recovering sparse or compressible signals from compressed sensing measurements that have undergone optimal nonuniform scalar quantization, i.e., minimizing the common ℓ 2 -norm distortion. Generally, this quantized compressed sensing (QCS) problem is solved by minimizing the ℓ 1 -norm constrained by the ℓ 2 -norm distortion. In such cases, remeasurement and quantization of the reconstructed signal do not necessarily match the initial observations, showing that the whole QCS model is not consistent. Our approach considers instead that quantization distortion more closely resembles heteroscedastic uniform noise, with variance depending on the observed quantization bin. Generalizing our previous work on uniform quantization, we show that for nonuniform quantizers described by the "compander" formalism, quantization distortion may be better characterized as having bounded weighted ℓ p -norm (p ≥ 2), for a particular weighting. We develop a new reconstruction approach, termed Generalized Basis Pursuit DeNoise (GBPDN), which minimizes the ℓ 1 -norm of the signal to reconstruct constrained by this weighted ℓ p -norm fidelity. We prove that, for standard Gaussian sensing matrices and K sparse or compressible signals in R N with at least Ω((K logN/K) p/2 ) measurements, i.e., under strongly oversampled QCS scenario, GBPDN is ℓ 2 -ℓ 1 instance optimal and stable recovers all such sparse or compressible signals. The reconstruction error decreases as O(2 -B /√(p+1)) given a budget of B bits per measurement. This yields a reduction by a factor √(p+1) of the reconstruction error compared to the one produced by ℓ 2 -norm constrained decoders. We also propose an primal-dual proximal splitting scheme to solve the GBPDN program which is efficient for large-scale problems. Interestingly, extensive simulations testing the GBPDN effectiveness confirm the trend predicted by the theory, that the reconstruction error can indeed be reduced by increasing p, but this is achieved at a much less stringent oversampling regime than the one expected by the theoretical bounds. Besides the QCS scenario, we also show that GBPDN applies straightforwardly to the related case of CS measurements corrupted by heteroscedastic generalized Gaussian noise with provable reconstruction error reduction.</abstract><cop>New York, NY</cop><pub>IEEE</pub><doi>10.1109/TIT.2013.2281815</doi><tpages>16</tpages><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier ISSN: 0018-9448
ispartof IEEE transactions on information theory, 2013-12, Vol.59 (12), p.7969-7984
issn 0018-9448
1557-9654
language eng
recordid cdi_crossref_primary_10_1109_TIT_2013_2281815
source IEEE Electronic Library (IEL)
subjects Applied sciences
Basis pursuit
Coding, codes
compander theory
Compressed sensing
Computer Science
convex optimization
Detection, estimation, filtering, equalization, prediction
Distortion measurement
Errors
Exact sciences and technology
heteroscedasticity
Image Processing
Information theory
Information, signal and communications theory
instance optimality
Measurement
Noise
Noise measurement
noise stabilization
non-uniform quantization
Normal distribution
oversampling
quantization
Quantization (signal)
Reconstruction algorithms
Sampling, quantization
Sensors
Signal and communications theory
Signal, noise
Telecommunications and information theory
title Stabilizing Nonuniformly Quantized Compressed Sensing With Scalar Companders
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-17T00%3A15%3A21IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Stabilizing%20Nonuniformly%20Quantized%20Compressed%20Sensing%20With%20Scalar%20Companders&rft.jtitle=IEEE%20transactions%20on%20information%20theory&rft.au=Jacques,%20Laurent&rft.date=2013-12-01&rft.volume=59&rft.issue=12&rft.spage=7969&rft.epage=7984&rft.pages=7969-7984&rft.issn=0018-9448&rft.eissn=1557-9654&rft.coden=IETTAW&rft_id=info:doi/10.1109/TIT.2013.2281815&rft_dat=%3Cproquest_RIE%3E3142874101%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=1462877660&rft_id=info:pmid/&rft_ieee_id=6600822&rfr_iscdi=true