Tangible video teleconference system using real-time image-based relighting
This paper deals with a real-time image based relighting system for tangible video teleconference. The proposed image based relighting system renders the extracted human object using the virtual environmental images. The proposed system can homogenize virtually the lighting environments of remote us...
Gespeichert in:
| Veröffentlicht in: | IEEE transactions on consumer electronics 2009-08, Vol.55 (3), p.1162-1168 |
|---|---|
| Hauptverfasser: | , , , |
| Format: | Artikel |
| Sprache: | eng |
| Schlagworte: | |
| Online-Zugang: | Volltext bestellen |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| container_end_page | 1168 |
|---|---|
| container_issue | 3 |
| container_start_page | 1162 |
| container_title | IEEE transactions on consumer electronics |
| container_volume | 55 |
| creator | Ryu, Sae-woon Lee, Sang Ahn, Sang Park, Jong-il |
| description | This paper deals with a real-time image based relighting system for tangible video teleconference. The proposed image based relighting system renders the extracted human object using the virtual environmental images. The proposed system can homogenize virtually the lighting environments of remote users on the video teleconference, or render the humans like they are in the virtual places. To realize the video teleconference, the paper obtains the reflectance models of users in real-time using the controlled lighting system. The reflectance models of human surface are obtained by a pair of lighting sources which are turned on and off alternatively. The images with different illuminations are exploited to model the reflectance on the object surfaces. The environment map for rendering is acquired by the mirror ball images or virtual background ones. And the relighting algorithm is implemented by GPU based programming for real-time operation. According to the simulations, the proposed system estimates the reflectance models of human faces, and relights the human faces in real-time. The objects are rendered by the reflectance models and virtual environment map. The proposed system enables the users to immerse video teleconference just as they are in the virtual environments. |
| doi_str_mv | 10.1109/TCE.2009.5277971 |
| format | Article |
| fullrecord | <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_proquest_miscellaneous_869848195</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>5277971</ieee_id><sourcerecordid>2295241591</sourcerecordid><originalsourceid>FETCH-LOGICAL-c353t-ef8e652ae41c528311ea86e19e55c90f1747164c206705b7c11cf0dccd3d36d73</originalsourceid><addsrcrecordid>eNp9kbtPwzAQxi0EEuWxI7FEDDCl-Ow4tkdUlYeoxFJmy3UuIVUexU6Q-t_jqoWBgemk-37f6e4-Qq6ATgGovl_O5lNGqZ4KJqWWcEQmIIRKM2DymEyiolJOc35KzkJYUwqZYGpCXpe2q-pVg8lXXWCfDNig67sSPXYOk7ANA7bJGOquSjzaJh3qFpO6tRWmKxuwiN2mrj6GCFyQk9I2AS8P9Zy8P86Xs-d08fb0MntYpI4LPqRYKswFs5iBiztwALQqR9AohNO0BJlJyDPHaC6pWEkH4EpaOFfwgueF5Ofkbj934_vPEcNg2jo4bBrbYT8Go3KtMgVaRPL2X5LnXCgGOoI3f8B1P_ouXmGU2O3DBI8Q3UPO9yF4LM3Gx0_4rQFqdiGYGILZhWAOIUTL9d5SI-Iv_qN-A7l6ggg</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>857471253</pqid></control><display><type>article</type><title>Tangible video teleconference system using real-time image-based relighting</title><source>IEEE Electronic Library (IEL)</source><creator>Ryu, Sae-woon ; Lee, Sang ; Ahn, Sang ; Park, Jong-il</creator><creatorcontrib>Ryu, Sae-woon ; Lee, Sang ; Ahn, Sang ; Park, Jong-il</creatorcontrib><description>This paper deals with a real-time image based relighting system for tangible video teleconference. The proposed image based relighting system renders the extracted human object using the virtual environmental images. The proposed system can homogenize virtually the lighting environments of remote users on the video teleconference, or render the humans like they are in the virtual places. To realize the video teleconference, the paper obtains the reflectance models of users in real-time using the controlled lighting system. The reflectance models of human surface are obtained by a pair of lighting sources which are turned on and off alternatively. The images with different illuminations are exploited to model the reflectance on the object surfaces. The environment map for rendering is acquired by the mirror ball images or virtual background ones. And the relighting algorithm is implemented by GPU based programming for real-time operation. According to the simulations, the proposed system estimates the reflectance models of human faces, and relights the human faces in real-time. The objects are rendered by the reflectance models and virtual environment map. The proposed system enables the users to immerse video teleconference just as they are in the virtual environments.</description><identifier>ISSN: 0098-3063</identifier><identifier>EISSN: 1558-4127</identifier><identifier>DOI: 10.1109/TCE.2009.5277971</identifier><identifier>CODEN: ITCEDA</identifier><language>eng</language><publisher>New York: IEEE</publisher><subject>Control system synthesis ; controlled lighting ; environment map ; Face ; GPU ; Human ; Humans ; Illumination ; Image based relighting ; Lighting ; Lighting control ; Mirrors ; Real time ; Real time systems ; Reflectance ; reflectance model ; Reflectivity ; Rendering ; Rendering (computer graphics) ; Teleconferencing ; Video teleconference ; Virtual environment</subject><ispartof>IEEE transactions on consumer electronics, 2009-08, Vol.55 (3), p.1162-1168</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2009</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c353t-ef8e652ae41c528311ea86e19e55c90f1747164c206705b7c11cf0dccd3d36d73</citedby><cites>FETCH-LOGICAL-c353t-ef8e652ae41c528311ea86e19e55c90f1747164c206705b7c11cf0dccd3d36d73</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/5277971$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,780,784,796,27924,27925,54758</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/5277971$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Ryu, Sae-woon</creatorcontrib><creatorcontrib>Lee, Sang</creatorcontrib><creatorcontrib>Ahn, Sang</creatorcontrib><creatorcontrib>Park, Jong-il</creatorcontrib><title>Tangible video teleconference system using real-time image-based relighting</title><title>IEEE transactions on consumer electronics</title><addtitle>T-CE</addtitle><description>This paper deals with a real-time image based relighting system for tangible video teleconference. The proposed image based relighting system renders the extracted human object using the virtual environmental images. The proposed system can homogenize virtually the lighting environments of remote users on the video teleconference, or render the humans like they are in the virtual places. To realize the video teleconference, the paper obtains the reflectance models of users in real-time using the controlled lighting system. The reflectance models of human surface are obtained by a pair of lighting sources which are turned on and off alternatively. The images with different illuminations are exploited to model the reflectance on the object surfaces. The environment map for rendering is acquired by the mirror ball images or virtual background ones. And the relighting algorithm is implemented by GPU based programming for real-time operation. According to the simulations, the proposed system estimates the reflectance models of human faces, and relights the human faces in real-time. The objects are rendered by the reflectance models and virtual environment map. The proposed system enables the users to immerse video teleconference just as they are in the virtual environments.</description><subject>Control system synthesis</subject><subject>controlled lighting</subject><subject>environment map</subject><subject>Face</subject><subject>GPU</subject><subject>Human</subject><subject>Humans</subject><subject>Illumination</subject><subject>Image based relighting</subject><subject>Lighting</subject><subject>Lighting control</subject><subject>Mirrors</subject><subject>Real time</subject><subject>Real time systems</subject><subject>Reflectance</subject><subject>reflectance model</subject><subject>Reflectivity</subject><subject>Rendering</subject><subject>Rendering (computer graphics)</subject><subject>Teleconferencing</subject><subject>Video teleconference</subject><subject>Virtual environment</subject><issn>0098-3063</issn><issn>1558-4127</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2009</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNp9kbtPwzAQxi0EEuWxI7FEDDCl-Ow4tkdUlYeoxFJmy3UuIVUexU6Q-t_jqoWBgemk-37f6e4-Qq6ATgGovl_O5lNGqZ4KJqWWcEQmIIRKM2DymEyiolJOc35KzkJYUwqZYGpCXpe2q-pVg8lXXWCfDNig67sSPXYOk7ANA7bJGOquSjzaJh3qFpO6tRWmKxuwiN2mrj6GCFyQk9I2AS8P9Zy8P86Xs-d08fb0MntYpI4LPqRYKswFs5iBiztwALQqR9AohNO0BJlJyDPHaC6pWEkH4EpaOFfwgueF5Ofkbj934_vPEcNg2jo4bBrbYT8Go3KtMgVaRPL2X5LnXCgGOoI3f8B1P_ouXmGU2O3DBI8Q3UPO9yF4LM3Gx0_4rQFqdiGYGILZhWAOIUTL9d5SI-Iv_qN-A7l6ggg</recordid><startdate>20090801</startdate><enddate>20090801</enddate><creator>Ryu, Sae-woon</creator><creator>Lee, Sang</creator><creator>Ahn, Sang</creator><creator>Park, Jong-il</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SP</scope><scope>8FD</scope><scope>F28</scope><scope>FR3</scope><scope>L7M</scope></search><sort><creationdate>20090801</creationdate><title>Tangible video teleconference system using real-time image-based relighting</title><author>Ryu, Sae-woon ; Lee, Sang ; Ahn, Sang ; Park, Jong-il</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c353t-ef8e652ae41c528311ea86e19e55c90f1747164c206705b7c11cf0dccd3d36d73</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2009</creationdate><topic>Control system synthesis</topic><topic>controlled lighting</topic><topic>environment map</topic><topic>Face</topic><topic>GPU</topic><topic>Human</topic><topic>Humans</topic><topic>Illumination</topic><topic>Image based relighting</topic><topic>Lighting</topic><topic>Lighting control</topic><topic>Mirrors</topic><topic>Real time</topic><topic>Real time systems</topic><topic>Reflectance</topic><topic>reflectance model</topic><topic>Reflectivity</topic><topic>Rendering</topic><topic>Rendering (computer graphics)</topic><topic>Teleconferencing</topic><topic>Video teleconference</topic><topic>Virtual environment</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Ryu, Sae-woon</creatorcontrib><creatorcontrib>Lee, Sang</creatorcontrib><creatorcontrib>Ahn, Sang</creatorcontrib><creatorcontrib>Park, Jong-il</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Electronics & Communications Abstracts</collection><collection>Technology Research Database</collection><collection>ANTE: Abstracts in New Technology & Engineering</collection><collection>Engineering Research Database</collection><collection>Advanced Technologies Database with Aerospace</collection><jtitle>IEEE transactions on consumer electronics</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Ryu, Sae-woon</au><au>Lee, Sang</au><au>Ahn, Sang</au><au>Park, Jong-il</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Tangible video teleconference system using real-time image-based relighting</atitle><jtitle>IEEE transactions on consumer electronics</jtitle><stitle>T-CE</stitle><date>2009-08-01</date><risdate>2009</risdate><volume>55</volume><issue>3</issue><spage>1162</spage><epage>1168</epage><pages>1162-1168</pages><issn>0098-3063</issn><eissn>1558-4127</eissn><coden>ITCEDA</coden><abstract>This paper deals with a real-time image based relighting system for tangible video teleconference. The proposed image based relighting system renders the extracted human object using the virtual environmental images. The proposed system can homogenize virtually the lighting environments of remote users on the video teleconference, or render the humans like they are in the virtual places. To realize the video teleconference, the paper obtains the reflectance models of users in real-time using the controlled lighting system. The reflectance models of human surface are obtained by a pair of lighting sources which are turned on and off alternatively. The images with different illuminations are exploited to model the reflectance on the object surfaces. The environment map for rendering is acquired by the mirror ball images or virtual background ones. And the relighting algorithm is implemented by GPU based programming for real-time operation. According to the simulations, the proposed system estimates the reflectance models of human faces, and relights the human faces in real-time. The objects are rendered by the reflectance models and virtual environment map. The proposed system enables the users to immerse video teleconference just as they are in the virtual environments.</abstract><cop>New York</cop><pub>IEEE</pub><doi>10.1109/TCE.2009.5277971</doi><tpages>7</tpages></addata></record> |
| fulltext | fulltext_linktorsrc |
| identifier | ISSN: 0098-3063 |
| ispartof | IEEE transactions on consumer electronics, 2009-08, Vol.55 (3), p.1162-1168 |
| issn | 0098-3063 1558-4127 |
| language | eng |
| recordid | cdi_proquest_miscellaneous_869848195 |
| source | IEEE Electronic Library (IEL) |
| subjects | Control system synthesis controlled lighting environment map Face GPU Human Humans Illumination Image based relighting Lighting Lighting control Mirrors Real time Real time systems Reflectance reflectance model Reflectivity Rendering Rendering (computer graphics) Teleconferencing Video teleconference Virtual environment |
| title | Tangible video teleconference system using real-time image-based relighting |
| url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-26T14%3A26%3A47IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Tangible%20video%20teleconference%20system%20using%20real-time%20image-based%20relighting&rft.jtitle=IEEE%20transactions%20on%20consumer%20electronics&rft.au=Ryu,%20Sae-woon&rft.date=2009-08-01&rft.volume=55&rft.issue=3&rft.spage=1162&rft.epage=1168&rft.pages=1162-1168&rft.issn=0098-3063&rft.eissn=1558-4127&rft.coden=ITCEDA&rft_id=info:doi/10.1109/TCE.2009.5277971&rft_dat=%3Cproquest_RIE%3E2295241591%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=857471253&rft_id=info:pmid/&rft_ieee_id=5277971&rfr_iscdi=true |