DARTS: Diffusion Approximated Residual Time Sampling for Time-of-flight Rendering in Homogeneous Scattering Media
Time-of-flight (ToF) devices have greatly propelled the advancement of various multi-modal perception applications. However, achieving accurate rendering of time-resolved information remains a challenge, particularly in scenes involving complex geometries, diverse materials and participating media....
Gespeichert in:
Veröffentlicht in: | ACM transactions on graphics 2024-12, Vol.43 (6), p.1-14, Article 240 |
---|---|
Hauptverfasser: | , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 14 |
---|---|
container_issue | 6 |
container_start_page | 1 |
container_title | ACM transactions on graphics |
container_volume | 43 |
creator | He, Qianyue Du, Dongyu Jiang, Haitian Jin, Xin |
description | Time-of-flight (ToF) devices have greatly propelled the advancement of various multi-modal perception applications. However, achieving accurate rendering of time-resolved information remains a challenge, particularly in scenes involving complex geometries, diverse materials and participating media. Existing ToF rendering works have demonstrated notable results, yet they struggle with scenes involving scattering media and camera-warped settings. Other steady-state volumetric rendering methods exhibit significant bias or variance when directly applied to ToF rendering tasks. To address these challenges, we integrate transient diffusion theory into path construction and propose novel sampling methods for free-path distance and scattering direction, via resampled importance sampling and offline tabulation. An elliptical sampling method is further adapted to provide controllable vertex connection satisfying any required photon traversal time. In contrast to the existing temporal uniform sampling strategy, our method is the first to consider the contribution of transient radiance to importance-sample the full path, and thus enables improved temporal path construction under multiple scattering settings. The proposed method can be integrated into both path tracing and photon-based frameworks, delivering significant improvements in quality and efficiency with at least a 5x MSE reduction versus SOTA methods in equal rendering time. |
doi_str_mv | 10.1145/3687930 |
format | Article |
fullrecord | <record><control><sourceid>acm_cross</sourceid><recordid>TN_cdi_crossref_primary_10_1145_3687930</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>3687930</sourcerecordid><originalsourceid>FETCH-LOGICAL-a840-98d4ac0039225b0bca053c6805a5a75b7f4ad8b04a5eb842457639baeaef36db3</originalsourceid><addsrcrecordid>eNo9kMFLwzAUh4MoOKd495Sbp-hrkzStt7GpEybC1nt5aZMZaZvadKD_vZ2bnh6_9308eD9CriO4iyIh73mSqozDCZlEUiqmxnxKJqA4MOAQnZOLED4AIBEimZDPxWydbx7owlm7C863dNZ1vf9yDQ6momsTXLXDmuauMXSDTVe7dkut7383zFtma7d9H0azrUy_h66lS9_4rWmN3wW6KXEYDuTVVA4vyZnFOpir45yS_Okxny_Z6u35ZT5bMUwFsCytBJYAPItjqUGXCJKXSQoSJSqplRVYpRoESqNTEQupEp5pNGgsTyrNp-T2cLbsfQi9sUXXj0_130UExb6o4ljUaN4cTCybf-kP_gBZUWOa</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>DARTS: Diffusion Approximated Residual Time Sampling for Time-of-flight Rendering in Homogeneous Scattering Media</title><source>ACM Digital Library</source><creator>He, Qianyue ; Du, Dongyu ; Jiang, Haitian ; Jin, Xin</creator><creatorcontrib>He, Qianyue ; Du, Dongyu ; Jiang, Haitian ; Jin, Xin</creatorcontrib><description>Time-of-flight (ToF) devices have greatly propelled the advancement of various multi-modal perception applications. However, achieving accurate rendering of time-resolved information remains a challenge, particularly in scenes involving complex geometries, diverse materials and participating media. Existing ToF rendering works have demonstrated notable results, yet they struggle with scenes involving scattering media and camera-warped settings. Other steady-state volumetric rendering methods exhibit significant bias or variance when directly applied to ToF rendering tasks. To address these challenges, we integrate transient diffusion theory into path construction and propose novel sampling methods for free-path distance and scattering direction, via resampled importance sampling and offline tabulation. An elliptical sampling method is further adapted to provide controllable vertex connection satisfying any required photon traversal time. In contrast to the existing temporal uniform sampling strategy, our method is the first to consider the contribution of transient radiance to importance-sample the full path, and thus enables improved temporal path construction under multiple scattering settings. The proposed method can be integrated into both path tracing and photon-based frameworks, delivering significant improvements in quality and efficiency with at least a 5x MSE reduction versus SOTA methods in equal rendering time.</description><identifier>ISSN: 0730-0301</identifier><identifier>EISSN: 1557-7368</identifier><identifier>DOI: 10.1145/3687930</identifier><language>eng</language><publisher>New York, NY, USA: ACM</publisher><subject>Computer graphics ; Computing methodologies ; Ray tracing ; Rendering</subject><ispartof>ACM transactions on graphics, 2024-12, Vol.43 (6), p.1-14, Article 240</ispartof><rights>Copyright is held by the owner/author(s). Publication rights licensed to ACM.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-a840-98d4ac0039225b0bca053c6805a5a75b7f4ad8b04a5eb842457639baeaef36db3</cites><orcidid>0000-0003-2298-9721 ; 0009-0006-8555-5284 ; 0009-0009-7127-4192 ; 0000-0001-6655-3888</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://dl.acm.org/doi/pdf/10.1145/3687930$$EPDF$$P50$$Gacm$$Hfree_for_read</linktopdf><link.rule.ids>314,776,780,2276,27901,27902,40172,75970</link.rule.ids></links><search><creatorcontrib>He, Qianyue</creatorcontrib><creatorcontrib>Du, Dongyu</creatorcontrib><creatorcontrib>Jiang, Haitian</creatorcontrib><creatorcontrib>Jin, Xin</creatorcontrib><title>DARTS: Diffusion Approximated Residual Time Sampling for Time-of-flight Rendering in Homogeneous Scattering Media</title><title>ACM transactions on graphics</title><addtitle>ACM TOG</addtitle><description>Time-of-flight (ToF) devices have greatly propelled the advancement of various multi-modal perception applications. However, achieving accurate rendering of time-resolved information remains a challenge, particularly in scenes involving complex geometries, diverse materials and participating media. Existing ToF rendering works have demonstrated notable results, yet they struggle with scenes involving scattering media and camera-warped settings. Other steady-state volumetric rendering methods exhibit significant bias or variance when directly applied to ToF rendering tasks. To address these challenges, we integrate transient diffusion theory into path construction and propose novel sampling methods for free-path distance and scattering direction, via resampled importance sampling and offline tabulation. An elliptical sampling method is further adapted to provide controllable vertex connection satisfying any required photon traversal time. In contrast to the existing temporal uniform sampling strategy, our method is the first to consider the contribution of transient radiance to importance-sample the full path, and thus enables improved temporal path construction under multiple scattering settings. The proposed method can be integrated into both path tracing and photon-based frameworks, delivering significant improvements in quality and efficiency with at least a 5x MSE reduction versus SOTA methods in equal rendering time.</description><subject>Computer graphics</subject><subject>Computing methodologies</subject><subject>Ray tracing</subject><subject>Rendering</subject><issn>0730-0301</issn><issn>1557-7368</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><recordid>eNo9kMFLwzAUh4MoOKd495Sbp-hrkzStt7GpEybC1nt5aZMZaZvadKD_vZ2bnh6_9308eD9CriO4iyIh73mSqozDCZlEUiqmxnxKJqA4MOAQnZOLED4AIBEimZDPxWydbx7owlm7C863dNZ1vf9yDQ6momsTXLXDmuauMXSDTVe7dkut7383zFtma7d9H0azrUy_h66lS9_4rWmN3wW6KXEYDuTVVA4vyZnFOpir45yS_Okxny_Z6u35ZT5bMUwFsCytBJYAPItjqUGXCJKXSQoSJSqplRVYpRoESqNTEQupEp5pNGgsTyrNp-T2cLbsfQi9sUXXj0_130UExb6o4ljUaN4cTCybf-kP_gBZUWOa</recordid><startdate>20241219</startdate><enddate>20241219</enddate><creator>He, Qianyue</creator><creator>Du, Dongyu</creator><creator>Jiang, Haitian</creator><creator>Jin, Xin</creator><general>ACM</general><scope>AAYXX</scope><scope>CITATION</scope><orcidid>https://orcid.org/0000-0003-2298-9721</orcidid><orcidid>https://orcid.org/0009-0006-8555-5284</orcidid><orcidid>https://orcid.org/0009-0009-7127-4192</orcidid><orcidid>https://orcid.org/0000-0001-6655-3888</orcidid></search><sort><creationdate>20241219</creationdate><title>DARTS: Diffusion Approximated Residual Time Sampling for Time-of-flight Rendering in Homogeneous Scattering Media</title><author>He, Qianyue ; Du, Dongyu ; Jiang, Haitian ; Jin, Xin</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a840-98d4ac0039225b0bca053c6805a5a75b7f4ad8b04a5eb842457639baeaef36db3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Computer graphics</topic><topic>Computing methodologies</topic><topic>Ray tracing</topic><topic>Rendering</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>He, Qianyue</creatorcontrib><creatorcontrib>Du, Dongyu</creatorcontrib><creatorcontrib>Jiang, Haitian</creatorcontrib><creatorcontrib>Jin, Xin</creatorcontrib><collection>CrossRef</collection><jtitle>ACM transactions on graphics</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>He, Qianyue</au><au>Du, Dongyu</au><au>Jiang, Haitian</au><au>Jin, Xin</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>DARTS: Diffusion Approximated Residual Time Sampling for Time-of-flight Rendering in Homogeneous Scattering Media</atitle><jtitle>ACM transactions on graphics</jtitle><stitle>ACM TOG</stitle><date>2024-12-19</date><risdate>2024</risdate><volume>43</volume><issue>6</issue><spage>1</spage><epage>14</epage><pages>1-14</pages><artnum>240</artnum><issn>0730-0301</issn><eissn>1557-7368</eissn><abstract>Time-of-flight (ToF) devices have greatly propelled the advancement of various multi-modal perception applications. However, achieving accurate rendering of time-resolved information remains a challenge, particularly in scenes involving complex geometries, diverse materials and participating media. Existing ToF rendering works have demonstrated notable results, yet they struggle with scenes involving scattering media and camera-warped settings. Other steady-state volumetric rendering methods exhibit significant bias or variance when directly applied to ToF rendering tasks. To address these challenges, we integrate transient diffusion theory into path construction and propose novel sampling methods for free-path distance and scattering direction, via resampled importance sampling and offline tabulation. An elliptical sampling method is further adapted to provide controllable vertex connection satisfying any required photon traversal time. In contrast to the existing temporal uniform sampling strategy, our method is the first to consider the contribution of transient radiance to importance-sample the full path, and thus enables improved temporal path construction under multiple scattering settings. The proposed method can be integrated into both path tracing and photon-based frameworks, delivering significant improvements in quality and efficiency with at least a 5x MSE reduction versus SOTA methods in equal rendering time.</abstract><cop>New York, NY, USA</cop><pub>ACM</pub><doi>10.1145/3687930</doi><tpages>14</tpages><orcidid>https://orcid.org/0000-0003-2298-9721</orcidid><orcidid>https://orcid.org/0009-0006-8555-5284</orcidid><orcidid>https://orcid.org/0009-0009-7127-4192</orcidid><orcidid>https://orcid.org/0000-0001-6655-3888</orcidid><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | ISSN: 0730-0301 |
ispartof | ACM transactions on graphics, 2024-12, Vol.43 (6), p.1-14, Article 240 |
issn | 0730-0301 1557-7368 |
language | eng |
recordid | cdi_crossref_primary_10_1145_3687930 |
source | ACM Digital Library |
subjects | Computer graphics Computing methodologies Ray tracing Rendering |
title | DARTS: Diffusion Approximated Residual Time Sampling for Time-of-flight Rendering in Homogeneous Scattering Media |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-12T15%3A06%3A00IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-acm_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=DARTS:%20Diffusion%20Approximated%20Residual%20Time%20Sampling%20for%20Time-of-flight%20Rendering%20in%20Homogeneous%20Scattering%20Media&rft.jtitle=ACM%20transactions%20on%20graphics&rft.au=He,%20Qianyue&rft.date=2024-12-19&rft.volume=43&rft.issue=6&rft.spage=1&rft.epage=14&rft.pages=1-14&rft.artnum=240&rft.issn=0730-0301&rft.eissn=1557-7368&rft_id=info:doi/10.1145/3687930&rft_dat=%3Cacm_cross%3E3687930%3C/acm_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true |