Improved Turbo Message Passing for Compressive Robust Principal Component Analysis: Algorithm Design and Asymptotic Analysis
Compressive Robust Principal Component Analysis (CRPCA) naturally arises in various applications as a means to recover a low-rank matrix low-rank matrix $\boldsymbol{L}$ and a sparse matrix $\boldsymbol{S}$ from compressive measurements. In this paper, we approach the problem from a Bayesian inferen...
Gespeichert in:
Hauptverfasser: | , , |
---|---|
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | |
---|---|
container_issue | |
container_start_page | |
container_title | |
container_volume | |
creator | He, Zhuohang Ma, Junjie Yuan, Xiaojun |
description | Compressive Robust Principal Component Analysis (CRPCA) naturally arises in
various applications as a means to recover a low-rank matrix low-rank matrix
$\boldsymbol{L}$ and a sparse matrix $\boldsymbol{S}$ from compressive
measurements. In this paper, we approach the problem from a Bayesian inference
perspective. We establish a probabilistic model for the problem and develop an
improved turbo message passing (ITMP) algorithm based on the sum-product rule
and the appropriate approximations. Additionally, we establish a state
evolution framework to characterize the asymptotic behavior of the ITMP
algorithm in the large-system limit. By analyzing the established state
evolution, we further propose sufficient conditions for the global convergence
of our algorithm. Our numerical results validate the theoretical results,
demonstrating that the proposed asymptotic framework accurately characterize
the dynamical behavior of the ITMP algorithm, and the phase transition curve
specified by the sufficient condition agrees well with numerical simulations. |
doi_str_mv | 10.48550/arxiv.2412.03106 |
format | Article |
fullrecord | <record><control><sourceid>arxiv_GOX</sourceid><recordid>TN_cdi_arxiv_primary_2412_03106</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2412_03106</sourcerecordid><originalsourceid>FETCH-arxiv_primary_2412_031063</originalsourceid><addsrcrecordid>eNqFjsEKgkAURWfTIqoPaNX7gUxTI9qJFbUIJNzLqKM90BmZN0pCH59JtG114dyzOIwtHdvy9r5vb7h-YmdtPWdr2a5j76bsda0brTqRQ9zqVMFNEPFSQMSJUJZQKA2hGpyBYyfgrtKWDEQaZYYNr8ZTSSENBJJXPSEdIKhKpdE8ajgKwlIClzkE1NeNUQaznzlnk4JXJBbfnbHV-RSHl_XYmTQaa6775NObjL3uf-MNUfhNYw</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Improved Turbo Message Passing for Compressive Robust Principal Component Analysis: Algorithm Design and Asymptotic Analysis</title><source>arXiv.org</source><creator>He, Zhuohang ; Ma, Junjie ; Yuan, Xiaojun</creator><creatorcontrib>He, Zhuohang ; Ma, Junjie ; Yuan, Xiaojun</creatorcontrib><description>Compressive Robust Principal Component Analysis (CRPCA) naturally arises in
various applications as a means to recover a low-rank matrix low-rank matrix
$\boldsymbol{L}$ and a sparse matrix $\boldsymbol{S}$ from compressive
measurements. In this paper, we approach the problem from a Bayesian inference
perspective. We establish a probabilistic model for the problem and develop an
improved turbo message passing (ITMP) algorithm based on the sum-product rule
and the appropriate approximations. Additionally, we establish a state
evolution framework to characterize the asymptotic behavior of the ITMP
algorithm in the large-system limit. By analyzing the established state
evolution, we further propose sufficient conditions for the global convergence
of our algorithm. Our numerical results validate the theoretical results,
demonstrating that the proposed asymptotic framework accurately characterize
the dynamical behavior of the ITMP algorithm, and the phase transition curve
specified by the sufficient condition agrees well with numerical simulations.</description><identifier>DOI: 10.48550/arxiv.2412.03106</identifier><language>eng</language><subject>Computer Science - Information Theory ; Mathematics - Information Theory</subject><creationdate>2024-12</creationdate><rights>http://creativecommons.org/licenses/by/4.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,778,883</link.rule.ids><linktorsrc>$$Uhttps://arxiv.org/abs/2412.03106$$EView_record_in_Cornell_University$$FView_record_in_$$GCornell_University$$Hfree_for_read</linktorsrc><backlink>$$Uhttps://doi.org/10.48550/arXiv.2412.03106$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>He, Zhuohang</creatorcontrib><creatorcontrib>Ma, Junjie</creatorcontrib><creatorcontrib>Yuan, Xiaojun</creatorcontrib><title>Improved Turbo Message Passing for Compressive Robust Principal Component Analysis: Algorithm Design and Asymptotic Analysis</title><description>Compressive Robust Principal Component Analysis (CRPCA) naturally arises in
various applications as a means to recover a low-rank matrix low-rank matrix
$\boldsymbol{L}$ and a sparse matrix $\boldsymbol{S}$ from compressive
measurements. In this paper, we approach the problem from a Bayesian inference
perspective. We establish a probabilistic model for the problem and develop an
improved turbo message passing (ITMP) algorithm based on the sum-product rule
and the appropriate approximations. Additionally, we establish a state
evolution framework to characterize the asymptotic behavior of the ITMP
algorithm in the large-system limit. By analyzing the established state
evolution, we further propose sufficient conditions for the global convergence
of our algorithm. Our numerical results validate the theoretical results,
demonstrating that the proposed asymptotic framework accurately characterize
the dynamical behavior of the ITMP algorithm, and the phase transition curve
specified by the sufficient condition agrees well with numerical simulations.</description><subject>Computer Science - Information Theory</subject><subject>Mathematics - Information Theory</subject><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><sourceid>GOX</sourceid><recordid>eNqFjsEKgkAURWfTIqoPaNX7gUxTI9qJFbUIJNzLqKM90BmZN0pCH59JtG114dyzOIwtHdvy9r5vb7h-YmdtPWdr2a5j76bsda0brTqRQ9zqVMFNEPFSQMSJUJZQKA2hGpyBYyfgrtKWDEQaZYYNr8ZTSSENBJJXPSEdIKhKpdE8ajgKwlIClzkE1NeNUQaznzlnk4JXJBbfnbHV-RSHl_XYmTQaa6775NObjL3uf-MNUfhNYw</recordid><startdate>20241204</startdate><enddate>20241204</enddate><creator>He, Zhuohang</creator><creator>Ma, Junjie</creator><creator>Yuan, Xiaojun</creator><scope>AKY</scope><scope>AKZ</scope><scope>GOX</scope></search><sort><creationdate>20241204</creationdate><title>Improved Turbo Message Passing for Compressive Robust Principal Component Analysis: Algorithm Design and Asymptotic Analysis</title><author>He, Zhuohang ; Ma, Junjie ; Yuan, Xiaojun</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-arxiv_primary_2412_031063</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Computer Science - Information Theory</topic><topic>Mathematics - Information Theory</topic><toplevel>online_resources</toplevel><creatorcontrib>He, Zhuohang</creatorcontrib><creatorcontrib>Ma, Junjie</creatorcontrib><creatorcontrib>Yuan, Xiaojun</creatorcontrib><collection>arXiv Computer Science</collection><collection>arXiv Mathematics</collection><collection>arXiv.org</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>He, Zhuohang</au><au>Ma, Junjie</au><au>Yuan, Xiaojun</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Improved Turbo Message Passing for Compressive Robust Principal Component Analysis: Algorithm Design and Asymptotic Analysis</atitle><date>2024-12-04</date><risdate>2024</risdate><abstract>Compressive Robust Principal Component Analysis (CRPCA) naturally arises in
various applications as a means to recover a low-rank matrix low-rank matrix
$\boldsymbol{L}$ and a sparse matrix $\boldsymbol{S}$ from compressive
measurements. In this paper, we approach the problem from a Bayesian inference
perspective. We establish a probabilistic model for the problem and develop an
improved turbo message passing (ITMP) algorithm based on the sum-product rule
and the appropriate approximations. Additionally, we establish a state
evolution framework to characterize the asymptotic behavior of the ITMP
algorithm in the large-system limit. By analyzing the established state
evolution, we further propose sufficient conditions for the global convergence
of our algorithm. Our numerical results validate the theoretical results,
demonstrating that the proposed asymptotic framework accurately characterize
the dynamical behavior of the ITMP algorithm, and the phase transition curve
specified by the sufficient condition agrees well with numerical simulations.</abstract><doi>10.48550/arxiv.2412.03106</doi><oa>free_for_read</oa></addata></record> |
fulltext | fulltext_linktorsrc |
identifier | DOI: 10.48550/arxiv.2412.03106 |
ispartof | |
issn | |
language | eng |
recordid | cdi_arxiv_primary_2412_03106 |
source | arXiv.org |
subjects | Computer Science - Information Theory Mathematics - Information Theory |
title | Improved Turbo Message Passing for Compressive Robust Principal Component Analysis: Algorithm Design and Asymptotic Analysis |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-17T02%3A51%3A03IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-arxiv_GOX&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Improved%20Turbo%20Message%20Passing%20for%20Compressive%20Robust%20Principal%20Component%20Analysis:%20Algorithm%20Design%20and%20Asymptotic%20Analysis&rft.au=He,%20Zhuohang&rft.date=2024-12-04&rft_id=info:doi/10.48550/arxiv.2412.03106&rft_dat=%3Carxiv_GOX%3E2412_03106%3C/arxiv_GOX%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true |