Single-pixel imaging based on deep learning

Single-pixel imaging can collect images at the wavelengths outside the reach of conventional focal plane array detectors. However, the limited image quality and lengthy computational times for iterative reconstruction still impede the practical application of single-pixel imaging. Recently, deep lea...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Song, Kai, Bian, Yaoxing, Wu, Ku, Liu, Hongrui, Han, Shuangping, Li, Jiaming, Tian, Jiazhao, Qin, Chengbin, Hu, Jianyong, Xiao, Liantuan
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator Song, Kai
Bian, Yaoxing
Wu, Ku
Liu, Hongrui
Han, Shuangping
Li, Jiaming
Tian, Jiazhao
Qin, Chengbin
Hu, Jianyong
Xiao, Liantuan
description Single-pixel imaging can collect images at the wavelengths outside the reach of conventional focal plane array detectors. However, the limited image quality and lengthy computational times for iterative reconstruction still impede the practical application of single-pixel imaging. Recently, deep learning has been introduced into single-pixel imaging, which has attracted a lot of attention due to its exceptional reconstruction quality, fast reconstruction speed, and the potential to complete advanced sensing tasks without reconstructing images. Here, this advance is discussed and some opinions are offered. Firstly, based on the fundamental principles of single-pixel imaging and deep learning, the principles and algorithms of single-pixel imaging based on deep learning are described and analyzed. Subsequently, the implementation technologies of single-pixel imaging based on deep learning are reviewed. They are divided into super-resolution single-pixel imaging, single-pixel imaging through scattering media, photon-level single-pixel imaging, optical encryption based on single-pixel imaging, color single-pixel imaging, and image-free sensing according to diverse application fields. Finally, major challenges and corresponding feasible approaches are discussed, as well as more possible applications in the future.
doi_str_mv 10.48550/arxiv.2310.16869
format Article
fullrecord <record><control><sourceid>arxiv_GOX</sourceid><recordid>TN_cdi_arxiv_primary_2310_16869</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2310_16869</sourcerecordid><originalsourceid>FETCH-LOGICAL-a679-f213005fc9ea07e2415a0115cb503f5a1f15e2ad875ac1efea5bd633214735f53</originalsourceid><addsrcrecordid>eNotzksLgkAUBeDZtAjrB7Rq9mHNnfH6WIb0AqFF7uWqd0QwE4Wof59Zq8M5i8MnxArU1gsR1Y76V_3cajMO4Id-NBebW91WDbtd_eJG1neqxi5zGriUj1aWzJ1smPp2nBdiZqkZePlPR6THQxqf3eR6usT7xCU_iFyrwSiFtoiYVMDaAyQFgEWOylgksICsqQwDpALYMmFe-sZo8AKDFo0j1r_bSZt1_ajq39lXnU1q8wGCDDuR</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Single-pixel imaging based on deep learning</title><source>arXiv.org</source><creator>Song, Kai ; Bian, Yaoxing ; Wu, Ku ; Liu, Hongrui ; Han, Shuangping ; Li, Jiaming ; Tian, Jiazhao ; Qin, Chengbin ; Hu, Jianyong ; Xiao, Liantuan</creator><creatorcontrib>Song, Kai ; Bian, Yaoxing ; Wu, Ku ; Liu, Hongrui ; Han, Shuangping ; Li, Jiaming ; Tian, Jiazhao ; Qin, Chengbin ; Hu, Jianyong ; Xiao, Liantuan</creatorcontrib><description>Single-pixel imaging can collect images at the wavelengths outside the reach of conventional focal plane array detectors. However, the limited image quality and lengthy computational times for iterative reconstruction still impede the practical application of single-pixel imaging. Recently, deep learning has been introduced into single-pixel imaging, which has attracted a lot of attention due to its exceptional reconstruction quality, fast reconstruction speed, and the potential to complete advanced sensing tasks without reconstructing images. Here, this advance is discussed and some opinions are offered. Firstly, based on the fundamental principles of single-pixel imaging and deep learning, the principles and algorithms of single-pixel imaging based on deep learning are described and analyzed. Subsequently, the implementation technologies of single-pixel imaging based on deep learning are reviewed. They are divided into super-resolution single-pixel imaging, single-pixel imaging through scattering media, photon-level single-pixel imaging, optical encryption based on single-pixel imaging, color single-pixel imaging, and image-free sensing according to diverse application fields. Finally, major challenges and corresponding feasible approaches are discussed, as well as more possible applications in the future.</description><identifier>DOI: 10.48550/arxiv.2310.16869</identifier><language>eng</language><subject>Physics - Optics</subject><creationdate>2023-10</creationdate><rights>http://arxiv.org/licenses/nonexclusive-distrib/1.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,780,885</link.rule.ids><linktorsrc>$$Uhttps://arxiv.org/abs/2310.16869$$EView_record_in_Cornell_University$$FView_record_in_$$GCornell_University$$Hfree_for_read</linktorsrc><backlink>$$Uhttps://doi.org/10.48550/arXiv.2310.16869$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Song, Kai</creatorcontrib><creatorcontrib>Bian, Yaoxing</creatorcontrib><creatorcontrib>Wu, Ku</creatorcontrib><creatorcontrib>Liu, Hongrui</creatorcontrib><creatorcontrib>Han, Shuangping</creatorcontrib><creatorcontrib>Li, Jiaming</creatorcontrib><creatorcontrib>Tian, Jiazhao</creatorcontrib><creatorcontrib>Qin, Chengbin</creatorcontrib><creatorcontrib>Hu, Jianyong</creatorcontrib><creatorcontrib>Xiao, Liantuan</creatorcontrib><title>Single-pixel imaging based on deep learning</title><description>Single-pixel imaging can collect images at the wavelengths outside the reach of conventional focal plane array detectors. However, the limited image quality and lengthy computational times for iterative reconstruction still impede the practical application of single-pixel imaging. Recently, deep learning has been introduced into single-pixel imaging, which has attracted a lot of attention due to its exceptional reconstruction quality, fast reconstruction speed, and the potential to complete advanced sensing tasks without reconstructing images. Here, this advance is discussed and some opinions are offered. Firstly, based on the fundamental principles of single-pixel imaging and deep learning, the principles and algorithms of single-pixel imaging based on deep learning are described and analyzed. Subsequently, the implementation technologies of single-pixel imaging based on deep learning are reviewed. They are divided into super-resolution single-pixel imaging, single-pixel imaging through scattering media, photon-level single-pixel imaging, optical encryption based on single-pixel imaging, color single-pixel imaging, and image-free sensing according to diverse application fields. Finally, major challenges and corresponding feasible approaches are discussed, as well as more possible applications in the future.</description><subject>Physics - Optics</subject><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><sourceid>GOX</sourceid><recordid>eNotzksLgkAUBeDZtAjrB7Rq9mHNnfH6WIb0AqFF7uWqd0QwE4Wof59Zq8M5i8MnxArU1gsR1Y76V_3cajMO4Id-NBebW91WDbtd_eJG1neqxi5zGriUj1aWzJ1smPp2nBdiZqkZePlPR6THQxqf3eR6usT7xCU_iFyrwSiFtoiYVMDaAyQFgEWOylgksICsqQwDpALYMmFe-sZo8AKDFo0j1r_bSZt1_ajq39lXnU1q8wGCDDuR</recordid><startdate>20231025</startdate><enddate>20231025</enddate><creator>Song, Kai</creator><creator>Bian, Yaoxing</creator><creator>Wu, Ku</creator><creator>Liu, Hongrui</creator><creator>Han, Shuangping</creator><creator>Li, Jiaming</creator><creator>Tian, Jiazhao</creator><creator>Qin, Chengbin</creator><creator>Hu, Jianyong</creator><creator>Xiao, Liantuan</creator><scope>GOX</scope></search><sort><creationdate>20231025</creationdate><title>Single-pixel imaging based on deep learning</title><author>Song, Kai ; Bian, Yaoxing ; Wu, Ku ; Liu, Hongrui ; Han, Shuangping ; Li, Jiaming ; Tian, Jiazhao ; Qin, Chengbin ; Hu, Jianyong ; Xiao, Liantuan</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a679-f213005fc9ea07e2415a0115cb503f5a1f15e2ad875ac1efea5bd633214735f53</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Physics - Optics</topic><toplevel>online_resources</toplevel><creatorcontrib>Song, Kai</creatorcontrib><creatorcontrib>Bian, Yaoxing</creatorcontrib><creatorcontrib>Wu, Ku</creatorcontrib><creatorcontrib>Liu, Hongrui</creatorcontrib><creatorcontrib>Han, Shuangping</creatorcontrib><creatorcontrib>Li, Jiaming</creatorcontrib><creatorcontrib>Tian, Jiazhao</creatorcontrib><creatorcontrib>Qin, Chengbin</creatorcontrib><creatorcontrib>Hu, Jianyong</creatorcontrib><creatorcontrib>Xiao, Liantuan</creatorcontrib><collection>arXiv.org</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Song, Kai</au><au>Bian, Yaoxing</au><au>Wu, Ku</au><au>Liu, Hongrui</au><au>Han, Shuangping</au><au>Li, Jiaming</au><au>Tian, Jiazhao</au><au>Qin, Chengbin</au><au>Hu, Jianyong</au><au>Xiao, Liantuan</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Single-pixel imaging based on deep learning</atitle><date>2023-10-25</date><risdate>2023</risdate><abstract>Single-pixel imaging can collect images at the wavelengths outside the reach of conventional focal plane array detectors. However, the limited image quality and lengthy computational times for iterative reconstruction still impede the practical application of single-pixel imaging. Recently, deep learning has been introduced into single-pixel imaging, which has attracted a lot of attention due to its exceptional reconstruction quality, fast reconstruction speed, and the potential to complete advanced sensing tasks without reconstructing images. Here, this advance is discussed and some opinions are offered. Firstly, based on the fundamental principles of single-pixel imaging and deep learning, the principles and algorithms of single-pixel imaging based on deep learning are described and analyzed. Subsequently, the implementation technologies of single-pixel imaging based on deep learning are reviewed. They are divided into super-resolution single-pixel imaging, single-pixel imaging through scattering media, photon-level single-pixel imaging, optical encryption based on single-pixel imaging, color single-pixel imaging, and image-free sensing according to diverse application fields. Finally, major challenges and corresponding feasible approaches are discussed, as well as more possible applications in the future.</abstract><doi>10.48550/arxiv.2310.16869</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier DOI: 10.48550/arxiv.2310.16869
ispartof
issn
language eng
recordid cdi_arxiv_primary_2310_16869
source arXiv.org
subjects Physics - Optics
title Single-pixel imaging based on deep learning
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-03T07%3A44%3A05IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-arxiv_GOX&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Single-pixel%20imaging%20based%20on%20deep%20learning&rft.au=Song,%20Kai&rft.date=2023-10-25&rft_id=info:doi/10.48550/arxiv.2310.16869&rft_dat=%3Carxiv_GOX%3E2310_16869%3C/arxiv_GOX%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true