Role of Transients in Two-Bounce Non-Line-of-Sight Imaging

The goal of non-line-of-sight (NLOS) imaging is to image objects occluded from the camera's field of view using multiply scattered light. Recent works have demonstrated the feasibility of two-bounce (2B) NLOS imaging by scanning a laser and measuring cast shadows of occluded objects in scenes w...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Somasundaram, Siddharth, Dave, Akshat, Henley, Connor, Veeraraghavan, Ashok, Raskar, Ramesh
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator Somasundaram, Siddharth
Dave, Akshat
Henley, Connor
Veeraraghavan, Ashok
Raskar, Ramesh
description The goal of non-line-of-sight (NLOS) imaging is to image objects occluded from the camera's field of view using multiply scattered light. Recent works have demonstrated the feasibility of two-bounce (2B) NLOS imaging by scanning a laser and measuring cast shadows of occluded objects in scenes with two relay surfaces. In this work, we study the role of time-of-flight (ToF) measurements, \ie transients, in 2B-NLOS under multiplexed illumination. Specifically, we study how ToF information can reduce the number of measurements and spatial resolution needed for shape reconstruction. We present our findings with respect to tradeoffs in (1) temporal resolution, (2) spatial resolution, and (3) number of image captures by studying SNR and recoverability as functions of system parameters. This leads to a formal definition of the mathematical constraints for 2B lidar. We believe that our work lays an analytical groundwork for design of future NLOS imaging systems, especially as ToF sensors become increasingly ubiquitous.
doi_str_mv 10.48550/arxiv.2304.01308
format Article
fullrecord <record><control><sourceid>arxiv_GOX</sourceid><recordid>TN_cdi_arxiv_primary_2304_01308</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2304_01308</sourcerecordid><originalsourceid>FETCH-LOGICAL-a678-cf3ac50dd51fd7c6ecaa321ab1367a8154d805e99b5316f6dde6abd1982f013b3</originalsourceid><addsrcrecordid>eNotj71uwjAYAL0wIOABmOoXcGrHseOwUQQtUgRSmz364p_UUmKjBGj79gXa6bbTHUJLRpNMCUGfYfj21yTlNEso41RN0eo9dhZHh6sBwuhtOI_YB1x9RfISL0FbfIiBlD5YEh358O3nGe97aH1o52jioBvt4p8zVO221eaNlMfX_WZdEpC5Itpx0IIaI5gzuZZWA_CUQcO4zEExkRlFhS2KRnAmnTTGSmgMK1Tqbo0Nn6GnP-0jvj4Nvofhp75P1I8J_gu7gEEW</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Role of Transients in Two-Bounce Non-Line-of-Sight Imaging</title><source>arXiv.org</source><creator>Somasundaram, Siddharth ; Dave, Akshat ; Henley, Connor ; Veeraraghavan, Ashok ; Raskar, Ramesh</creator><creatorcontrib>Somasundaram, Siddharth ; Dave, Akshat ; Henley, Connor ; Veeraraghavan, Ashok ; Raskar, Ramesh</creatorcontrib><description>The goal of non-line-of-sight (NLOS) imaging is to image objects occluded from the camera's field of view using multiply scattered light. Recent works have demonstrated the feasibility of two-bounce (2B) NLOS imaging by scanning a laser and measuring cast shadows of occluded objects in scenes with two relay surfaces. In this work, we study the role of time-of-flight (ToF) measurements, \ie transients, in 2B-NLOS under multiplexed illumination. Specifically, we study how ToF information can reduce the number of measurements and spatial resolution needed for shape reconstruction. We present our findings with respect to tradeoffs in (1) temporal resolution, (2) spatial resolution, and (3) number of image captures by studying SNR and recoverability as functions of system parameters. This leads to a formal definition of the mathematical constraints for 2B lidar. We believe that our work lays an analytical groundwork for design of future NLOS imaging systems, especially as ToF sensors become increasingly ubiquitous.</description><identifier>DOI: 10.48550/arxiv.2304.01308</identifier><language>eng</language><subject>Computer Science - Computer Vision and Pattern Recognition</subject><creationdate>2023-04</creationdate><rights>http://creativecommons.org/licenses/by-nc-nd/4.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,777,882</link.rule.ids><linktorsrc>$$Uhttps://arxiv.org/abs/2304.01308$$EView_record_in_Cornell_University$$FView_record_in_$$GCornell_University$$Hfree_for_read</linktorsrc><backlink>$$Uhttps://doi.org/10.48550/arXiv.2304.01308$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Somasundaram, Siddharth</creatorcontrib><creatorcontrib>Dave, Akshat</creatorcontrib><creatorcontrib>Henley, Connor</creatorcontrib><creatorcontrib>Veeraraghavan, Ashok</creatorcontrib><creatorcontrib>Raskar, Ramesh</creatorcontrib><title>Role of Transients in Two-Bounce Non-Line-of-Sight Imaging</title><description>The goal of non-line-of-sight (NLOS) imaging is to image objects occluded from the camera's field of view using multiply scattered light. Recent works have demonstrated the feasibility of two-bounce (2B) NLOS imaging by scanning a laser and measuring cast shadows of occluded objects in scenes with two relay surfaces. In this work, we study the role of time-of-flight (ToF) measurements, \ie transients, in 2B-NLOS under multiplexed illumination. Specifically, we study how ToF information can reduce the number of measurements and spatial resolution needed for shape reconstruction. We present our findings with respect to tradeoffs in (1) temporal resolution, (2) spatial resolution, and (3) number of image captures by studying SNR and recoverability as functions of system parameters. This leads to a formal definition of the mathematical constraints for 2B lidar. We believe that our work lays an analytical groundwork for design of future NLOS imaging systems, especially as ToF sensors become increasingly ubiquitous.</description><subject>Computer Science - Computer Vision and Pattern Recognition</subject><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><sourceid>GOX</sourceid><recordid>eNotj71uwjAYAL0wIOABmOoXcGrHseOwUQQtUgRSmz364p_UUmKjBGj79gXa6bbTHUJLRpNMCUGfYfj21yTlNEso41RN0eo9dhZHh6sBwuhtOI_YB1x9RfISL0FbfIiBlD5YEh358O3nGe97aH1o52jioBvt4p8zVO221eaNlMfX_WZdEpC5Itpx0IIaI5gzuZZWA_CUQcO4zEExkRlFhS2KRnAmnTTGSmgMK1Tqbo0Nn6GnP-0jvj4Nvofhp75P1I8J_gu7gEEW</recordid><startdate>20230403</startdate><enddate>20230403</enddate><creator>Somasundaram, Siddharth</creator><creator>Dave, Akshat</creator><creator>Henley, Connor</creator><creator>Veeraraghavan, Ashok</creator><creator>Raskar, Ramesh</creator><scope>AKY</scope><scope>GOX</scope></search><sort><creationdate>20230403</creationdate><title>Role of Transients in Two-Bounce Non-Line-of-Sight Imaging</title><author>Somasundaram, Siddharth ; Dave, Akshat ; Henley, Connor ; Veeraraghavan, Ashok ; Raskar, Ramesh</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a678-cf3ac50dd51fd7c6ecaa321ab1367a8154d805e99b5316f6dde6abd1982f013b3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Computer Science - Computer Vision and Pattern Recognition</topic><toplevel>online_resources</toplevel><creatorcontrib>Somasundaram, Siddharth</creatorcontrib><creatorcontrib>Dave, Akshat</creatorcontrib><creatorcontrib>Henley, Connor</creatorcontrib><creatorcontrib>Veeraraghavan, Ashok</creatorcontrib><creatorcontrib>Raskar, Ramesh</creatorcontrib><collection>arXiv Computer Science</collection><collection>arXiv.org</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Somasundaram, Siddharth</au><au>Dave, Akshat</au><au>Henley, Connor</au><au>Veeraraghavan, Ashok</au><au>Raskar, Ramesh</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Role of Transients in Two-Bounce Non-Line-of-Sight Imaging</atitle><date>2023-04-03</date><risdate>2023</risdate><abstract>The goal of non-line-of-sight (NLOS) imaging is to image objects occluded from the camera's field of view using multiply scattered light. Recent works have demonstrated the feasibility of two-bounce (2B) NLOS imaging by scanning a laser and measuring cast shadows of occluded objects in scenes with two relay surfaces. In this work, we study the role of time-of-flight (ToF) measurements, \ie transients, in 2B-NLOS under multiplexed illumination. Specifically, we study how ToF information can reduce the number of measurements and spatial resolution needed for shape reconstruction. We present our findings with respect to tradeoffs in (1) temporal resolution, (2) spatial resolution, and (3) number of image captures by studying SNR and recoverability as functions of system parameters. This leads to a formal definition of the mathematical constraints for 2B lidar. We believe that our work lays an analytical groundwork for design of future NLOS imaging systems, especially as ToF sensors become increasingly ubiquitous.</abstract><doi>10.48550/arxiv.2304.01308</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier DOI: 10.48550/arxiv.2304.01308
ispartof
issn
language eng
recordid cdi_arxiv_primary_2304_01308
source arXiv.org
subjects Computer Science - Computer Vision and Pattern Recognition
title Role of Transients in Two-Bounce Non-Line-of-Sight Imaging
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-20T08%3A02%3A45IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-arxiv_GOX&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Role%20of%20Transients%20in%20Two-Bounce%20Non-Line-of-Sight%20Imaging&rft.au=Somasundaram,%20Siddharth&rft.date=2023-04-03&rft_id=info:doi/10.48550/arxiv.2304.01308&rft_dat=%3Carxiv_GOX%3E2304_01308%3C/arxiv_GOX%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true