Video object inpainting using posture mapping

This paper presents a novel framework for object-based video inpainting. To complete an occluded object, our method first samples a 3-D volume of the video into directional spatio-temporal slices, and then performs patch-based image inpainting to repair the partially damaged object trajectories in t...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Chih-Hung Ling, Chia-Wen Lin, Chih-Wen Su, Liao, H.-Y.M., Yong-Sheng Chen
Format: Tagungsbericht
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 2788
container_issue
container_start_page 2785
container_title
container_volume
creator Chih-Hung Ling
Chia-Wen Lin
Chih-Wen Su
Liao, H.-Y.M.
Yong-Sheng Chen
description This paper presents a novel framework for object-based video inpainting. To complete an occluded object, our method first samples a 3-D volume of the video into directional spatio-temporal slices, and then performs patch-based image inpainting to repair the partially damaged object trajectories in the 2-D slices. The completed slices are subsequently combined to obtain a sequence of virtual contours of the damaged object. The virtual contours and a posture sequence retrieval technique are then used to retrieve the most similar sequence of object postures in the available non-occluded postures. Key-posture selection and indexing are performed to reduce the complexity of posture sequence retrieval. We also propose a synthetic posture generation scheme that enriches the collection of key-postures so as to reduce the effect of insufficient key-postures. Our experimental results demonstrate that the proposed method can maintain the spatial consistency and temporal motion continuity of an object simultaneously.
doi_str_mv 10.1109/ICIP.2009.5414183
format Conference Proceeding
fullrecord <record><control><sourceid>ieee_6IE</sourceid><recordid>TN_cdi_ieee_primary_5414183</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>5414183</ieee_id><sourcerecordid>5414183</sourcerecordid><originalsourceid>FETCH-LOGICAL-i175t-837bd16e90183e619a7e8050ecf4cf14035c0a56bf9580a15a2646a19cd9c7953</originalsourceid><addsrcrecordid>eNpVj81OwzAQhM2fRCh9AMQlL-Cwa3sd-4gifiJVggNwrRxng1zRJGrSA29PEb1wmdHok0YzQtwgFIjg7-qqfi0UgC_IoEGnT8TSlw6NMoYsEZyKTGmH0pHxZ_-YtuciQ1JKGufgUlxN0wZAAWrMhPxILQ_50Gw4znnqx5D6OfWf-X761XGY5v2O820Yx0O-Fhdd-Jp4efSFeH98eKue5erlqa7uVzJhSbN0umxatOzhMJQt-lCyAwKOnYkdGtAUIZBtOk8OAlJQ1tiAPrY-lp70Qtz-9SZmXo-7tA277_Xxuf4BgydGvQ</addsrcrecordid><sourcetype>Publisher</sourcetype><iscdi>true</iscdi><recordtype>conference_proceeding</recordtype></control><display><type>conference_proceeding</type><title>Video object inpainting using posture mapping</title><source>IEEE Electronic Library (IEL) Conference Proceedings</source><creator>Chih-Hung Ling ; Chia-Wen Lin ; Chih-Wen Su ; Liao, H.-Y.M. ; Yong-Sheng Chen</creator><creatorcontrib>Chih-Hung Ling ; Chia-Wen Lin ; Chih-Wen Su ; Liao, H.-Y.M. ; Yong-Sheng Chen</creatorcontrib><description>This paper presents a novel framework for object-based video inpainting. To complete an occluded object, our method first samples a 3-D volume of the video into directional spatio-temporal slices, and then performs patch-based image inpainting to repair the partially damaged object trajectories in the 2-D slices. The completed slices are subsequently combined to obtain a sequence of virtual contours of the damaged object. The virtual contours and a posture sequence retrieval technique are then used to retrieve the most similar sequence of object postures in the available non-occluded postures. Key-posture selection and indexing are performed to reduce the complexity of posture sequence retrieval. We also propose a synthetic posture generation scheme that enriches the collection of key-postures so as to reduce the effect of insufficient key-postures. Our experimental results demonstrate that the proposed method can maintain the spatial consistency and temporal motion continuity of an object simultaneously.</description><identifier>ISSN: 1522-4880</identifier><identifier>ISBN: 9781424456536</identifier><identifier>ISBN: 1424456533</identifier><identifier>EISSN: 2381-8549</identifier><identifier>EISBN: 9781424456550</identifier><identifier>EISBN: 9781424456543</identifier><identifier>EISBN: 142445655X</identifier><identifier>EISBN: 1424456541</identifier><identifier>DOI: 10.1109/ICIP.2009.5414183</identifier><language>eng</language><publisher>IEEE</publisher><subject>Cameras ; Computer science ; Filling ; Image reconstruction ; Information science ; Lighting ; object completion ; posture mapping ; synthetic posture ; Tensile stress ; video inpainitng ; Visual effects ; Voting</subject><ispartof>2009 16th IEEE International Conference on Image Processing (ICIP), 2009, p.2785-2788</ispartof><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/5414183$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>309,310,776,780,785,786,2052,27904,54898</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/5414183$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Chih-Hung Ling</creatorcontrib><creatorcontrib>Chia-Wen Lin</creatorcontrib><creatorcontrib>Chih-Wen Su</creatorcontrib><creatorcontrib>Liao, H.-Y.M.</creatorcontrib><creatorcontrib>Yong-Sheng Chen</creatorcontrib><title>Video object inpainting using posture mapping</title><title>2009 16th IEEE International Conference on Image Processing (ICIP)</title><addtitle>ICIP</addtitle><description>This paper presents a novel framework for object-based video inpainting. To complete an occluded object, our method first samples a 3-D volume of the video into directional spatio-temporal slices, and then performs patch-based image inpainting to repair the partially damaged object trajectories in the 2-D slices. The completed slices are subsequently combined to obtain a sequence of virtual contours of the damaged object. The virtual contours and a posture sequence retrieval technique are then used to retrieve the most similar sequence of object postures in the available non-occluded postures. Key-posture selection and indexing are performed to reduce the complexity of posture sequence retrieval. We also propose a synthetic posture generation scheme that enriches the collection of key-postures so as to reduce the effect of insufficient key-postures. Our experimental results demonstrate that the proposed method can maintain the spatial consistency and temporal motion continuity of an object simultaneously.</description><subject>Cameras</subject><subject>Computer science</subject><subject>Filling</subject><subject>Image reconstruction</subject><subject>Information science</subject><subject>Lighting</subject><subject>object completion</subject><subject>posture mapping</subject><subject>synthetic posture</subject><subject>Tensile stress</subject><subject>video inpainitng</subject><subject>Visual effects</subject><subject>Voting</subject><issn>1522-4880</issn><issn>2381-8549</issn><isbn>9781424456536</isbn><isbn>1424456533</isbn><isbn>9781424456550</isbn><isbn>9781424456543</isbn><isbn>142445655X</isbn><isbn>1424456541</isbn><fulltext>true</fulltext><rsrctype>conference_proceeding</rsrctype><creationdate>2009</creationdate><recordtype>conference_proceeding</recordtype><sourceid>6IE</sourceid><sourceid>RIE</sourceid><recordid>eNpVj81OwzAQhM2fRCh9AMQlL-Cwa3sd-4gifiJVggNwrRxng1zRJGrSA29PEb1wmdHok0YzQtwgFIjg7-qqfi0UgC_IoEGnT8TSlw6NMoYsEZyKTGmH0pHxZ_-YtuciQ1JKGufgUlxN0wZAAWrMhPxILQ_50Gw4znnqx5D6OfWf-X761XGY5v2O820Yx0O-Fhdd-Jp4efSFeH98eKue5erlqa7uVzJhSbN0umxatOzhMJQt-lCyAwKOnYkdGtAUIZBtOk8OAlJQ1tiAPrY-lp70Qtz-9SZmXo-7tA277_Xxuf4BgydGvQ</recordid><startdate>200911</startdate><enddate>200911</enddate><creator>Chih-Hung Ling</creator><creator>Chia-Wen Lin</creator><creator>Chih-Wen Su</creator><creator>Liao, H.-Y.M.</creator><creator>Yong-Sheng Chen</creator><general>IEEE</general><scope>6IE</scope><scope>6IH</scope><scope>CBEJK</scope><scope>RIE</scope><scope>RIO</scope></search><sort><creationdate>200911</creationdate><title>Video object inpainting using posture mapping</title><author>Chih-Hung Ling ; Chia-Wen Lin ; Chih-Wen Su ; Liao, H.-Y.M. ; Yong-Sheng Chen</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-i175t-837bd16e90183e619a7e8050ecf4cf14035c0a56bf9580a15a2646a19cd9c7953</frbrgroupid><rsrctype>conference_proceedings</rsrctype><prefilter>conference_proceedings</prefilter><language>eng</language><creationdate>2009</creationdate><topic>Cameras</topic><topic>Computer science</topic><topic>Filling</topic><topic>Image reconstruction</topic><topic>Information science</topic><topic>Lighting</topic><topic>object completion</topic><topic>posture mapping</topic><topic>synthetic posture</topic><topic>Tensile stress</topic><topic>video inpainitng</topic><topic>Visual effects</topic><topic>Voting</topic><toplevel>online_resources</toplevel><creatorcontrib>Chih-Hung Ling</creatorcontrib><creatorcontrib>Chia-Wen Lin</creatorcontrib><creatorcontrib>Chih-Wen Su</creatorcontrib><creatorcontrib>Liao, H.-Y.M.</creatorcontrib><creatorcontrib>Yong-Sheng Chen</creatorcontrib><collection>IEEE Electronic Library (IEL) Conference Proceedings</collection><collection>IEEE Proceedings Order Plan (POP) 1998-present by volume</collection><collection>IEEE Xplore All Conference Proceedings</collection><collection>IEEE Electronic Library Online</collection><collection>IEEE Proceedings Order Plans (POP) 1998-present</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Chih-Hung Ling</au><au>Chia-Wen Lin</au><au>Chih-Wen Su</au><au>Liao, H.-Y.M.</au><au>Yong-Sheng Chen</au><format>book</format><genre>proceeding</genre><ristype>CONF</ristype><atitle>Video object inpainting using posture mapping</atitle><btitle>2009 16th IEEE International Conference on Image Processing (ICIP)</btitle><stitle>ICIP</stitle><date>2009-11</date><risdate>2009</risdate><spage>2785</spage><epage>2788</epage><pages>2785-2788</pages><issn>1522-4880</issn><eissn>2381-8549</eissn><isbn>9781424456536</isbn><isbn>1424456533</isbn><eisbn>9781424456550</eisbn><eisbn>9781424456543</eisbn><eisbn>142445655X</eisbn><eisbn>1424456541</eisbn><abstract>This paper presents a novel framework for object-based video inpainting. To complete an occluded object, our method first samples a 3-D volume of the video into directional spatio-temporal slices, and then performs patch-based image inpainting to repair the partially damaged object trajectories in the 2-D slices. The completed slices are subsequently combined to obtain a sequence of virtual contours of the damaged object. The virtual contours and a posture sequence retrieval technique are then used to retrieve the most similar sequence of object postures in the available non-occluded postures. Key-posture selection and indexing are performed to reduce the complexity of posture sequence retrieval. We also propose a synthetic posture generation scheme that enriches the collection of key-postures so as to reduce the effect of insufficient key-postures. Our experimental results demonstrate that the proposed method can maintain the spatial consistency and temporal motion continuity of an object simultaneously.</abstract><pub>IEEE</pub><doi>10.1109/ICIP.2009.5414183</doi><tpages>4</tpages></addata></record>
fulltext fulltext_linktorsrc
identifier ISSN: 1522-4880
ispartof 2009 16th IEEE International Conference on Image Processing (ICIP), 2009, p.2785-2788
issn 1522-4880
2381-8549
language eng
recordid cdi_ieee_primary_5414183
source IEEE Electronic Library (IEL) Conference Proceedings
subjects Cameras
Computer science
Filling
Image reconstruction
Information science
Lighting
object completion
posture mapping
synthetic posture
Tensile stress
video inpainitng
Visual effects
Voting
title Video object inpainting using posture mapping
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-27T21%3A39%3A04IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-ieee_6IE&rft_val_fmt=info:ofi/fmt:kev:mtx:book&rft.genre=proceeding&rft.atitle=Video%20object%20inpainting%20using%20posture%20mapping&rft.btitle=2009%2016th%20IEEE%20International%20Conference%20on%20Image%20Processing%20(ICIP)&rft.au=Chih-Hung%20Ling&rft.date=2009-11&rft.spage=2785&rft.epage=2788&rft.pages=2785-2788&rft.issn=1522-4880&rft.eissn=2381-8549&rft.isbn=9781424456536&rft.isbn_list=1424456533&rft_id=info:doi/10.1109/ICIP.2009.5414183&rft_dat=%3Cieee_6IE%3E5414183%3C/ieee_6IE%3E%3Curl%3E%3C/url%3E&rft.eisbn=9781424456550&rft.eisbn_list=9781424456543&rft.eisbn_list=142445655X&rft.eisbn_list=1424456541&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rft_ieee_id=5414183&rfr_iscdi=true