High-quality streamable free-viewpoint video
We present the first end-to-end solution to create high-quality free-viewpoint video encoded as a compact data stream. Our system records performances using a dense set of RGB and IR video cameras, generates dynamic textured surfaces, and compresses these to a streamable 3D video format. Four techni...
Gespeichert in:
| Veröffentlicht in: | ACM transactions on graphics 2015-07, Vol.34 (4), p.1-13 |
|---|---|
| Hauptverfasser: | , , , , , , , , |
| Format: | Artikel |
| Sprache: | eng |
| Schlagworte: | |
| Online-Zugang: | Volltext |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| container_end_page | 13 |
|---|---|
| container_issue | 4 |
| container_start_page | 1 |
| container_title | ACM transactions on graphics |
| container_volume | 34 |
| creator | Collet, Alvaro Chuang, Ming Sweeney, Pat Gillett, Don Evseev, Dennis Calabrese, David Hoppe, Hugues Kirk, Adam Sullivan, Steve |
| description | We present the first end-to-end solution to create high-quality free-viewpoint video encoded as a compact data stream. Our system records performances using a dense set of RGB and IR video cameras, generates dynamic textured surfaces, and compresses these to a streamable 3D video format. Four technical advances contribute to high fidelity and robustness: multimodal multi-view stereo fusing RGB, IR, and silhouette information; adaptive meshing guided by automatic detection of perceptually salient areas; mesh tracking to create temporally coherent subsequences; and encoding of tracked textured meshes as an MPEG video stream. Quantitative experiments demonstrate geometric accuracy, texture fidelity, and encoding efficiency. We release several datasets with calibrated inputs and processed results to foster future research. |
| doi_str_mv | 10.1145/2766945 |
| format | Article |
| fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_1793241170</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>1793241170</sourcerecordid><originalsourceid>FETCH-LOGICAL-c357t-199c5c860ee22de47ed4a936d78a70eef0ff2d6c8663963a831f539a59683433</originalsourceid><addsrcrecordid>eNotkM1Kw0AURgdRMFbxFbLThaN3cucns5SiVii46T6MyR0dSZp0Jqn07Y20qw8-DmdxGLsV8CiEVE-F0dpKdcYyoZThBnV5zjIwCBwQxCW7SukHALSUOmMPq_D1zXeTa8N4yNMYyXXus6XcRyK-D_Q79GE75vvQUH_NLrxrE92cdsE2ry-b5YqvP97el89rXqMyIxfW1qouNRAVRUPSUCOdRd2Y0pn59OB90eiZ0Gg1uhKFV2idsrpEibhg90ftEPvdRGmsupBqalu3pX5KlTAWCymEgRm9O6J17FOK5Kshhs7FQyWg-s9RnXLgH9suUAY</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>1793241170</pqid></control><display><type>article</type><title>High-quality streamable free-viewpoint video</title><source>ACM Digital Library Complete</source><creator>Collet, Alvaro ; Chuang, Ming ; Sweeney, Pat ; Gillett, Don ; Evseev, Dennis ; Calabrese, David ; Hoppe, Hugues ; Kirk, Adam ; Sullivan, Steve</creator><creatorcontrib>Collet, Alvaro ; Chuang, Ming ; Sweeney, Pat ; Gillett, Don ; Evseev, Dennis ; Calabrese, David ; Hoppe, Hugues ; Kirk, Adam ; Sullivan, Steve</creatorcontrib><description>We present the first end-to-end solution to create high-quality free-viewpoint video encoded as a compact data stream. Our system records performances using a dense set of RGB and IR video cameras, generates dynamic textured surfaces, and compresses these to a streamable 3D video format. Four technical advances contribute to high fidelity and robustness: multimodal multi-view stereo fusing RGB, IR, and silhouette information; adaptive meshing guided by automatic detection of perceptually salient areas; mesh tracking to create temporally coherent subsequences; and encoding of tracked textured meshes as an MPEG video stream. Quantitative experiments demonstrate geometric accuracy, texture fidelity, and encoding efficiency. We release several datasets with calibrated inputs and processed results to foster future research.</description><identifier>ISSN: 0730-0301</identifier><identifier>EISSN: 1557-7368</identifier><identifier>DOI: 10.1145/2766945</identifier><language>eng</language><subject>Data transmission ; Dynamical systems ; Dynamics ; Encoding ; Surface layer ; Texture ; Three dimensional ; Tracking</subject><ispartof>ACM transactions on graphics, 2015-07, Vol.34 (4), p.1-13</ispartof><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c357t-199c5c860ee22de47ed4a936d78a70eef0ff2d6c8663963a831f539a59683433</citedby><cites>FETCH-LOGICAL-c357t-199c5c860ee22de47ed4a936d78a70eef0ff2d6c8663963a831f539a59683433</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,777,781,27905,27906</link.rule.ids></links><search><creatorcontrib>Collet, Alvaro</creatorcontrib><creatorcontrib>Chuang, Ming</creatorcontrib><creatorcontrib>Sweeney, Pat</creatorcontrib><creatorcontrib>Gillett, Don</creatorcontrib><creatorcontrib>Evseev, Dennis</creatorcontrib><creatorcontrib>Calabrese, David</creatorcontrib><creatorcontrib>Hoppe, Hugues</creatorcontrib><creatorcontrib>Kirk, Adam</creatorcontrib><creatorcontrib>Sullivan, Steve</creatorcontrib><title>High-quality streamable free-viewpoint video</title><title>ACM transactions on graphics</title><description>We present the first end-to-end solution to create high-quality free-viewpoint video encoded as a compact data stream. Our system records performances using a dense set of RGB and IR video cameras, generates dynamic textured surfaces, and compresses these to a streamable 3D video format. Four technical advances contribute to high fidelity and robustness: multimodal multi-view stereo fusing RGB, IR, and silhouette information; adaptive meshing guided by automatic detection of perceptually salient areas; mesh tracking to create temporally coherent subsequences; and encoding of tracked textured meshes as an MPEG video stream. Quantitative experiments demonstrate geometric accuracy, texture fidelity, and encoding efficiency. We release several datasets with calibrated inputs and processed results to foster future research.</description><subject>Data transmission</subject><subject>Dynamical systems</subject><subject>Dynamics</subject><subject>Encoding</subject><subject>Surface layer</subject><subject>Texture</subject><subject>Three dimensional</subject><subject>Tracking</subject><issn>0730-0301</issn><issn>1557-7368</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2015</creationdate><recordtype>article</recordtype><recordid>eNotkM1Kw0AURgdRMFbxFbLThaN3cucns5SiVii46T6MyR0dSZp0Jqn07Y20qw8-DmdxGLsV8CiEVE-F0dpKdcYyoZThBnV5zjIwCBwQxCW7SukHALSUOmMPq_D1zXeTa8N4yNMYyXXus6XcRyK-D_Q79GE75vvQUH_NLrxrE92cdsE2ry-b5YqvP97el89rXqMyIxfW1qouNRAVRUPSUCOdRd2Y0pn59OB90eiZ0Gg1uhKFV2idsrpEibhg90ftEPvdRGmsupBqalu3pX5KlTAWCymEgRm9O6J17FOK5Kshhs7FQyWg-s9RnXLgH9suUAY</recordid><startdate>20150727</startdate><enddate>20150727</enddate><creator>Collet, Alvaro</creator><creator>Chuang, Ming</creator><creator>Sweeney, Pat</creator><creator>Gillett, Don</creator><creator>Evseev, Dennis</creator><creator>Calabrese, David</creator><creator>Hoppe, Hugues</creator><creator>Kirk, Adam</creator><creator>Sullivan, Steve</creator><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope></search><sort><creationdate>20150727</creationdate><title>High-quality streamable free-viewpoint video</title><author>Collet, Alvaro ; Chuang, Ming ; Sweeney, Pat ; Gillett, Don ; Evseev, Dennis ; Calabrese, David ; Hoppe, Hugues ; Kirk, Adam ; Sullivan, Steve</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c357t-199c5c860ee22de47ed4a936d78a70eef0ff2d6c8663963a831f539a59683433</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2015</creationdate><topic>Data transmission</topic><topic>Dynamical systems</topic><topic>Dynamics</topic><topic>Encoding</topic><topic>Surface layer</topic><topic>Texture</topic><topic>Three dimensional</topic><topic>Tracking</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Collet, Alvaro</creatorcontrib><creatorcontrib>Chuang, Ming</creatorcontrib><creatorcontrib>Sweeney, Pat</creatorcontrib><creatorcontrib>Gillett, Don</creatorcontrib><creatorcontrib>Evseev, Dennis</creatorcontrib><creatorcontrib>Calabrese, David</creatorcontrib><creatorcontrib>Hoppe, Hugues</creatorcontrib><creatorcontrib>Kirk, Adam</creatorcontrib><creatorcontrib>Sullivan, Steve</creatorcontrib><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>ACM transactions on graphics</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Collet, Alvaro</au><au>Chuang, Ming</au><au>Sweeney, Pat</au><au>Gillett, Don</au><au>Evseev, Dennis</au><au>Calabrese, David</au><au>Hoppe, Hugues</au><au>Kirk, Adam</au><au>Sullivan, Steve</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>High-quality streamable free-viewpoint video</atitle><jtitle>ACM transactions on graphics</jtitle><date>2015-07-27</date><risdate>2015</risdate><volume>34</volume><issue>4</issue><spage>1</spage><epage>13</epage><pages>1-13</pages><issn>0730-0301</issn><eissn>1557-7368</eissn><abstract>We present the first end-to-end solution to create high-quality free-viewpoint video encoded as a compact data stream. Our system records performances using a dense set of RGB and IR video cameras, generates dynamic textured surfaces, and compresses these to a streamable 3D video format. Four technical advances contribute to high fidelity and robustness: multimodal multi-view stereo fusing RGB, IR, and silhouette information; adaptive meshing guided by automatic detection of perceptually salient areas; mesh tracking to create temporally coherent subsequences; and encoding of tracked textured meshes as an MPEG video stream. Quantitative experiments demonstrate geometric accuracy, texture fidelity, and encoding efficiency. We release several datasets with calibrated inputs and processed results to foster future research.</abstract><doi>10.1145/2766945</doi><tpages>13</tpages><oa>free_for_read</oa></addata></record> |
| fulltext | fulltext |
| identifier | ISSN: 0730-0301 |
| ispartof | ACM transactions on graphics, 2015-07, Vol.34 (4), p.1-13 |
| issn | 0730-0301 1557-7368 |
| language | eng |
| recordid | cdi_proquest_miscellaneous_1793241170 |
| source | ACM Digital Library Complete |
| subjects | Data transmission Dynamical systems Dynamics Encoding Surface layer Texture Three dimensional Tracking |
| title | High-quality streamable free-viewpoint video |
| url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-19T06%3A13%3A57IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=High-quality%20streamable%20free-viewpoint%20video&rft.jtitle=ACM%20transactions%20on%20graphics&rft.au=Collet,%20Alvaro&rft.date=2015-07-27&rft.volume=34&rft.issue=4&rft.spage=1&rft.epage=13&rft.pages=1-13&rft.issn=0730-0301&rft.eissn=1557-7368&rft_id=info:doi/10.1145/2766945&rft_dat=%3Cproquest_cross%3E1793241170%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=1793241170&rft_id=info:pmid/&rfr_iscdi=true |