BiggerSelfie: Selfie Video Expansion With Hand-Held Camera

Selfie photography from the hand-held camera is becoming a popular media type. Although being convenient and flexible, it suffers from low camera motion stability, small field of view, and limited background content. These limitations can annoy users, especially, when touring a place of interest and...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on image processing 2018-12, Vol.27 (12), p.5854-5865
Hauptverfasser: Wang, Miao, Shamir, Ariel, Yang, Guo-Ye, Lin, Jin-Kun, Yang, Guo-Wei, Lu, Shao-Ping, Hu, Shi-Min
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 5865
container_issue 12
container_start_page 5854
container_title IEEE transactions on image processing
container_volume 27
creator Wang, Miao
Shamir, Ariel
Yang, Guo-Ye
Lin, Jin-Kun
Yang, Guo-Wei
Lu, Shao-Ping
Hu, Shi-Min
description Selfie photography from the hand-held camera is becoming a popular media type. Although being convenient and flexible, it suffers from low camera motion stability, small field of view, and limited background content. These limitations can annoy users, especially, when touring a place of interest and taking selfie videos. In this paper, we present a novel method to create what we call a BiggerSelfie that deals with these shortcomings. Using a video of the environment that has partial content overlap with the selfie video, we stitch plausible frames selected from the environment video to the original selfie frames and stabilize the composed video content with a portrait-preserving constraint. Using the proposed method, one can easily obtain a stable selfie video with expanded background content by merely capturing some background shots. We show various results and several evaluations to demonstrate the applicability of our method.
doi_str_mv 10.1109/TIP.2018.2859628
format Article
fullrecord <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_pubmed_primary_30047880</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>8419717</ieee_id><sourcerecordid>2117160744</sourcerecordid><originalsourceid>FETCH-LOGICAL-c347t-cf0bf2e4bbc9d67892b2c78fbe05a324c3c444a049b412156e1c001f2f96154e3</originalsourceid><addsrcrecordid>eNpdkEFLw0AQRhdRbK3eBUECXryk7mwm2WxvWqotFBSselw2m0lNSZOabUH_vVtae_D0Dcyb4eMxdgm8D8DV3Wzy0hcc0r5IY5WI9Ih1QSGEnKM49jOPZSgBVYedObfgHDCG5JR1Ig_INOVdNngo53NqX6kqShoEuwzey5yaYPS9MrUrmzr4KNefwdjUeTimKg-GZkmtOWcnhakcXeyzx94eR7PhOJw-P02G99PQRijXoS14VgjCLLMqT2SqRCasTIuMeGwigTayiGg4qgxBQJwQWN-0EIVKIEaKeux293fVNl8bcmu9LJ2lqjI1NRunBZeJApAoPHrzD100m7b27bTwBCRcInqK7yjbNs61VOhVWy5N-6OB661X7b3qrVe99-pPrvePN9mS8sPBn0gPXO2AkogO6xRBSZDRL0-0eM0</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2117160744</pqid></control><display><type>article</type><title>BiggerSelfie: Selfie Video Expansion With Hand-Held Camera</title><source>IEEE Electronic Library (IEL)</source><creator>Wang, Miao ; Shamir, Ariel ; Yang, Guo-Ye ; Lin, Jin-Kun ; Yang, Guo-Wei ; Lu, Shao-Ping ; Hu, Shi-Min</creator><creatorcontrib>Wang, Miao ; Shamir, Ariel ; Yang, Guo-Ye ; Lin, Jin-Kun ; Yang, Guo-Wei ; Lu, Shao-Ping ; Hu, Shi-Min</creatorcontrib><description>Selfie photography from the hand-held camera is becoming a popular media type. Although being convenient and flexible, it suffers from low camera motion stability, small field of view, and limited background content. These limitations can annoy users, especially, when touring a place of interest and taking selfie videos. In this paper, we present a novel method to create what we call a BiggerSelfie that deals with these shortcomings. Using a video of the environment that has partial content overlap with the selfie video, we stitch plausible frames selected from the environment video to the original selfie frames and stabilize the composed video content with a portrait-preserving constraint. Using the proposed method, one can easily obtain a stable selfie video with expanded background content by merely capturing some background shots. We show various results and several evaluations to demonstrate the applicability of our method.</description><identifier>ISSN: 1057-7149</identifier><identifier>EISSN: 1941-0042</identifier><identifier>DOI: 10.1109/TIP.2018.2859628</identifier><identifier>PMID: 30047880</identifier><identifier>CODEN: IIPRE4</identifier><language>eng</language><publisher>United States: IEEE</publisher><subject>Algorithm design and analysis ; Cameras ; Feature extraction ; Field of view ; Frames ; Hand-held video editing ; Motion estimation ; Motion segmentation ; Motion stability ; Photography ; selfie ; video stitching</subject><ispartof>IEEE transactions on image processing, 2018-12, Vol.27 (12), p.5854-5865</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2018</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c347t-cf0bf2e4bbc9d67892b2c78fbe05a324c3c444a049b412156e1c001f2f96154e3</citedby><cites>FETCH-LOGICAL-c347t-cf0bf2e4bbc9d67892b2c78fbe05a324c3c444a049b412156e1c001f2f96154e3</cites><orcidid>0000-0002-8492-0925 ; 0000-0001-7507-6542 ; 0000-0002-4102-8582</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/8419717$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,776,780,792,27901,27902,54733</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/8419717$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/30047880$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Wang, Miao</creatorcontrib><creatorcontrib>Shamir, Ariel</creatorcontrib><creatorcontrib>Yang, Guo-Ye</creatorcontrib><creatorcontrib>Lin, Jin-Kun</creatorcontrib><creatorcontrib>Yang, Guo-Wei</creatorcontrib><creatorcontrib>Lu, Shao-Ping</creatorcontrib><creatorcontrib>Hu, Shi-Min</creatorcontrib><title>BiggerSelfie: Selfie Video Expansion With Hand-Held Camera</title><title>IEEE transactions on image processing</title><addtitle>TIP</addtitle><addtitle>IEEE Trans Image Process</addtitle><description>Selfie photography from the hand-held camera is becoming a popular media type. Although being convenient and flexible, it suffers from low camera motion stability, small field of view, and limited background content. These limitations can annoy users, especially, when touring a place of interest and taking selfie videos. In this paper, we present a novel method to create what we call a BiggerSelfie that deals with these shortcomings. Using a video of the environment that has partial content overlap with the selfie video, we stitch plausible frames selected from the environment video to the original selfie frames and stabilize the composed video content with a portrait-preserving constraint. Using the proposed method, one can easily obtain a stable selfie video with expanded background content by merely capturing some background shots. We show various results and several evaluations to demonstrate the applicability of our method.</description><subject>Algorithm design and analysis</subject><subject>Cameras</subject><subject>Feature extraction</subject><subject>Field of view</subject><subject>Frames</subject><subject>Hand-held video editing</subject><subject>Motion estimation</subject><subject>Motion segmentation</subject><subject>Motion stability</subject><subject>Photography</subject><subject>selfie</subject><subject>video stitching</subject><issn>1057-7149</issn><issn>1941-0042</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2018</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNpdkEFLw0AQRhdRbK3eBUECXryk7mwm2WxvWqotFBSselw2m0lNSZOabUH_vVtae_D0Dcyb4eMxdgm8D8DV3Wzy0hcc0r5IY5WI9Ih1QSGEnKM49jOPZSgBVYedObfgHDCG5JR1Ig_INOVdNngo53NqX6kqShoEuwzey5yaYPS9MrUrmzr4KNefwdjUeTimKg-GZkmtOWcnhakcXeyzx94eR7PhOJw-P02G99PQRijXoS14VgjCLLMqT2SqRCasTIuMeGwigTayiGg4qgxBQJwQWN-0EIVKIEaKeux293fVNl8bcmu9LJ2lqjI1NRunBZeJApAoPHrzD100m7b27bTwBCRcInqK7yjbNs61VOhVWy5N-6OB661X7b3qrVe99-pPrvePN9mS8sPBn0gPXO2AkogO6xRBSZDRL0-0eM0</recordid><startdate>20181201</startdate><enddate>20181201</enddate><creator>Wang, Miao</creator><creator>Shamir, Ariel</creator><creator>Yang, Guo-Ye</creator><creator>Lin, Jin-Kun</creator><creator>Yang, Guo-Wei</creator><creator>Lu, Shao-Ping</creator><creator>Hu, Shi-Min</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7SP</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>7X8</scope><orcidid>https://orcid.org/0000-0002-8492-0925</orcidid><orcidid>https://orcid.org/0000-0001-7507-6542</orcidid><orcidid>https://orcid.org/0000-0002-4102-8582</orcidid></search><sort><creationdate>20181201</creationdate><title>BiggerSelfie: Selfie Video Expansion With Hand-Held Camera</title><author>Wang, Miao ; Shamir, Ariel ; Yang, Guo-Ye ; Lin, Jin-Kun ; Yang, Guo-Wei ; Lu, Shao-Ping ; Hu, Shi-Min</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c347t-cf0bf2e4bbc9d67892b2c78fbe05a324c3c444a049b412156e1c001f2f96154e3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2018</creationdate><topic>Algorithm design and analysis</topic><topic>Cameras</topic><topic>Feature extraction</topic><topic>Field of view</topic><topic>Frames</topic><topic>Hand-held video editing</topic><topic>Motion estimation</topic><topic>Motion segmentation</topic><topic>Motion stability</topic><topic>Photography</topic><topic>selfie</topic><topic>video stitching</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Wang, Miao</creatorcontrib><creatorcontrib>Shamir, Ariel</creatorcontrib><creatorcontrib>Yang, Guo-Ye</creatorcontrib><creatorcontrib>Lin, Jin-Kun</creatorcontrib><creatorcontrib>Yang, Guo-Wei</creatorcontrib><creatorcontrib>Lu, Shao-Ping</creatorcontrib><creatorcontrib>Hu, Shi-Min</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics &amp; Communications Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>MEDLINE - Academic</collection><jtitle>IEEE transactions on image processing</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Wang, Miao</au><au>Shamir, Ariel</au><au>Yang, Guo-Ye</au><au>Lin, Jin-Kun</au><au>Yang, Guo-Wei</au><au>Lu, Shao-Ping</au><au>Hu, Shi-Min</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>BiggerSelfie: Selfie Video Expansion With Hand-Held Camera</atitle><jtitle>IEEE transactions on image processing</jtitle><stitle>TIP</stitle><addtitle>IEEE Trans Image Process</addtitle><date>2018-12-01</date><risdate>2018</risdate><volume>27</volume><issue>12</issue><spage>5854</spage><epage>5865</epage><pages>5854-5865</pages><issn>1057-7149</issn><eissn>1941-0042</eissn><coden>IIPRE4</coden><abstract>Selfie photography from the hand-held camera is becoming a popular media type. Although being convenient and flexible, it suffers from low camera motion stability, small field of view, and limited background content. These limitations can annoy users, especially, when touring a place of interest and taking selfie videos. In this paper, we present a novel method to create what we call a BiggerSelfie that deals with these shortcomings. Using a video of the environment that has partial content overlap with the selfie video, we stitch plausible frames selected from the environment video to the original selfie frames and stabilize the composed video content with a portrait-preserving constraint. Using the proposed method, one can easily obtain a stable selfie video with expanded background content by merely capturing some background shots. We show various results and several evaluations to demonstrate the applicability of our method.</abstract><cop>United States</cop><pub>IEEE</pub><pmid>30047880</pmid><doi>10.1109/TIP.2018.2859628</doi><tpages>12</tpages><orcidid>https://orcid.org/0000-0002-8492-0925</orcidid><orcidid>https://orcid.org/0000-0001-7507-6542</orcidid><orcidid>https://orcid.org/0000-0002-4102-8582</orcidid></addata></record>
fulltext fulltext_linktorsrc
identifier ISSN: 1057-7149
ispartof IEEE transactions on image processing, 2018-12, Vol.27 (12), p.5854-5865
issn 1057-7149
1941-0042
language eng
recordid cdi_pubmed_primary_30047880
source IEEE Electronic Library (IEL)
subjects Algorithm design and analysis
Cameras
Feature extraction
Field of view
Frames
Hand-held video editing
Motion estimation
Motion segmentation
Motion stability
Photography
selfie
video stitching
title BiggerSelfie: Selfie Video Expansion With Hand-Held Camera
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-12T17%3A29%3A05IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=BiggerSelfie:%20Selfie%20Video%20Expansion%20With%20Hand-Held%20Camera&rft.jtitle=IEEE%20transactions%20on%20image%20processing&rft.au=Wang,%20Miao&rft.date=2018-12-01&rft.volume=27&rft.issue=12&rft.spage=5854&rft.epage=5865&rft.pages=5854-5865&rft.issn=1057-7149&rft.eissn=1941-0042&rft.coden=IIPRE4&rft_id=info:doi/10.1109/TIP.2018.2859628&rft_dat=%3Cproquest_RIE%3E2117160744%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2117160744&rft_id=info:pmid/30047880&rft_ieee_id=8419717&rfr_iscdi=true