BiggerSelfie: Selfie Video Expansion With Hand-Held Camera
Selfie photography from the hand-held camera is becoming a popular media type. Although being convenient and flexible, it suffers from low camera motion stability, small field of view, and limited background content. These limitations can annoy users, especially, when touring a place of interest and...
Gespeichert in:
Veröffentlicht in: | IEEE transactions on image processing 2018-12, Vol.27 (12), p.5854-5865 |
---|---|
Hauptverfasser: | , , , , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 5865 |
---|---|
container_issue | 12 |
container_start_page | 5854 |
container_title | IEEE transactions on image processing |
container_volume | 27 |
creator | Wang, Miao Shamir, Ariel Yang, Guo-Ye Lin, Jin-Kun Yang, Guo-Wei Lu, Shao-Ping Hu, Shi-Min |
description | Selfie photography from the hand-held camera is becoming a popular media type. Although being convenient and flexible, it suffers from low camera motion stability, small field of view, and limited background content. These limitations can annoy users, especially, when touring a place of interest and taking selfie videos. In this paper, we present a novel method to create what we call a BiggerSelfie that deals with these shortcomings. Using a video of the environment that has partial content overlap with the selfie video, we stitch plausible frames selected from the environment video to the original selfie frames and stabilize the composed video content with a portrait-preserving constraint. Using the proposed method, one can easily obtain a stable selfie video with expanded background content by merely capturing some background shots. We show various results and several evaluations to demonstrate the applicability of our method. |
doi_str_mv | 10.1109/TIP.2018.2859628 |
format | Article |
fullrecord | <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_pubmed_primary_30047880</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>8419717</ieee_id><sourcerecordid>2117160744</sourcerecordid><originalsourceid>FETCH-LOGICAL-c347t-cf0bf2e4bbc9d67892b2c78fbe05a324c3c444a049b412156e1c001f2f96154e3</originalsourceid><addsrcrecordid>eNpdkEFLw0AQRhdRbK3eBUECXryk7mwm2WxvWqotFBSselw2m0lNSZOabUH_vVtae_D0Dcyb4eMxdgm8D8DV3Wzy0hcc0r5IY5WI9Ih1QSGEnKM49jOPZSgBVYedObfgHDCG5JR1Ig_INOVdNngo53NqX6kqShoEuwzey5yaYPS9MrUrmzr4KNefwdjUeTimKg-GZkmtOWcnhakcXeyzx94eR7PhOJw-P02G99PQRijXoS14VgjCLLMqT2SqRCasTIuMeGwigTayiGg4qgxBQJwQWN-0EIVKIEaKeux293fVNl8bcmu9LJ2lqjI1NRunBZeJApAoPHrzD100m7b27bTwBCRcInqK7yjbNs61VOhVWy5N-6OB661X7b3qrVe99-pPrvePN9mS8sPBn0gPXO2AkogO6xRBSZDRL0-0eM0</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2117160744</pqid></control><display><type>article</type><title>BiggerSelfie: Selfie Video Expansion With Hand-Held Camera</title><source>IEEE Electronic Library (IEL)</source><creator>Wang, Miao ; Shamir, Ariel ; Yang, Guo-Ye ; Lin, Jin-Kun ; Yang, Guo-Wei ; Lu, Shao-Ping ; Hu, Shi-Min</creator><creatorcontrib>Wang, Miao ; Shamir, Ariel ; Yang, Guo-Ye ; Lin, Jin-Kun ; Yang, Guo-Wei ; Lu, Shao-Ping ; Hu, Shi-Min</creatorcontrib><description>Selfie photography from the hand-held camera is becoming a popular media type. Although being convenient and flexible, it suffers from low camera motion stability, small field of view, and limited background content. These limitations can annoy users, especially, when touring a place of interest and taking selfie videos. In this paper, we present a novel method to create what we call a BiggerSelfie that deals with these shortcomings. Using a video of the environment that has partial content overlap with the selfie video, we stitch plausible frames selected from the environment video to the original selfie frames and stabilize the composed video content with a portrait-preserving constraint. Using the proposed method, one can easily obtain a stable selfie video with expanded background content by merely capturing some background shots. We show various results and several evaluations to demonstrate the applicability of our method.</description><identifier>ISSN: 1057-7149</identifier><identifier>EISSN: 1941-0042</identifier><identifier>DOI: 10.1109/TIP.2018.2859628</identifier><identifier>PMID: 30047880</identifier><identifier>CODEN: IIPRE4</identifier><language>eng</language><publisher>United States: IEEE</publisher><subject>Algorithm design and analysis ; Cameras ; Feature extraction ; Field of view ; Frames ; Hand-held video editing ; Motion estimation ; Motion segmentation ; Motion stability ; Photography ; selfie ; video stitching</subject><ispartof>IEEE transactions on image processing, 2018-12, Vol.27 (12), p.5854-5865</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2018</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c347t-cf0bf2e4bbc9d67892b2c78fbe05a324c3c444a049b412156e1c001f2f96154e3</citedby><cites>FETCH-LOGICAL-c347t-cf0bf2e4bbc9d67892b2c78fbe05a324c3c444a049b412156e1c001f2f96154e3</cites><orcidid>0000-0002-8492-0925 ; 0000-0001-7507-6542 ; 0000-0002-4102-8582</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/8419717$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,776,780,792,27901,27902,54733</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/8419717$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/30047880$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Wang, Miao</creatorcontrib><creatorcontrib>Shamir, Ariel</creatorcontrib><creatorcontrib>Yang, Guo-Ye</creatorcontrib><creatorcontrib>Lin, Jin-Kun</creatorcontrib><creatorcontrib>Yang, Guo-Wei</creatorcontrib><creatorcontrib>Lu, Shao-Ping</creatorcontrib><creatorcontrib>Hu, Shi-Min</creatorcontrib><title>BiggerSelfie: Selfie Video Expansion With Hand-Held Camera</title><title>IEEE transactions on image processing</title><addtitle>TIP</addtitle><addtitle>IEEE Trans Image Process</addtitle><description>Selfie photography from the hand-held camera is becoming a popular media type. Although being convenient and flexible, it suffers from low camera motion stability, small field of view, and limited background content. These limitations can annoy users, especially, when touring a place of interest and taking selfie videos. In this paper, we present a novel method to create what we call a BiggerSelfie that deals with these shortcomings. Using a video of the environment that has partial content overlap with the selfie video, we stitch plausible frames selected from the environment video to the original selfie frames and stabilize the composed video content with a portrait-preserving constraint. Using the proposed method, one can easily obtain a stable selfie video with expanded background content by merely capturing some background shots. We show various results and several evaluations to demonstrate the applicability of our method.</description><subject>Algorithm design and analysis</subject><subject>Cameras</subject><subject>Feature extraction</subject><subject>Field of view</subject><subject>Frames</subject><subject>Hand-held video editing</subject><subject>Motion estimation</subject><subject>Motion segmentation</subject><subject>Motion stability</subject><subject>Photography</subject><subject>selfie</subject><subject>video stitching</subject><issn>1057-7149</issn><issn>1941-0042</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2018</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNpdkEFLw0AQRhdRbK3eBUECXryk7mwm2WxvWqotFBSselw2m0lNSZOabUH_vVtae_D0Dcyb4eMxdgm8D8DV3Wzy0hcc0r5IY5WI9Ih1QSGEnKM49jOPZSgBVYedObfgHDCG5JR1Ig_INOVdNngo53NqX6kqShoEuwzey5yaYPS9MrUrmzr4KNefwdjUeTimKg-GZkmtOWcnhakcXeyzx94eR7PhOJw-P02G99PQRijXoS14VgjCLLMqT2SqRCasTIuMeGwigTayiGg4qgxBQJwQWN-0EIVKIEaKeux293fVNl8bcmu9LJ2lqjI1NRunBZeJApAoPHrzD100m7b27bTwBCRcInqK7yjbNs61VOhVWy5N-6OB661X7b3qrVe99-pPrvePN9mS8sPBn0gPXO2AkogO6xRBSZDRL0-0eM0</recordid><startdate>20181201</startdate><enddate>20181201</enddate><creator>Wang, Miao</creator><creator>Shamir, Ariel</creator><creator>Yang, Guo-Ye</creator><creator>Lin, Jin-Kun</creator><creator>Yang, Guo-Wei</creator><creator>Lu, Shao-Ping</creator><creator>Hu, Shi-Min</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7SP</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>7X8</scope><orcidid>https://orcid.org/0000-0002-8492-0925</orcidid><orcidid>https://orcid.org/0000-0001-7507-6542</orcidid><orcidid>https://orcid.org/0000-0002-4102-8582</orcidid></search><sort><creationdate>20181201</creationdate><title>BiggerSelfie: Selfie Video Expansion With Hand-Held Camera</title><author>Wang, Miao ; Shamir, Ariel ; Yang, Guo-Ye ; Lin, Jin-Kun ; Yang, Guo-Wei ; Lu, Shao-Ping ; Hu, Shi-Min</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c347t-cf0bf2e4bbc9d67892b2c78fbe05a324c3c444a049b412156e1c001f2f96154e3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2018</creationdate><topic>Algorithm design and analysis</topic><topic>Cameras</topic><topic>Feature extraction</topic><topic>Field of view</topic><topic>Frames</topic><topic>Hand-held video editing</topic><topic>Motion estimation</topic><topic>Motion segmentation</topic><topic>Motion stability</topic><topic>Photography</topic><topic>selfie</topic><topic>video stitching</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Wang, Miao</creatorcontrib><creatorcontrib>Shamir, Ariel</creatorcontrib><creatorcontrib>Yang, Guo-Ye</creatorcontrib><creatorcontrib>Lin, Jin-Kun</creatorcontrib><creatorcontrib>Yang, Guo-Wei</creatorcontrib><creatorcontrib>Lu, Shao-Ping</creatorcontrib><creatorcontrib>Hu, Shi-Min</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics & Communications Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>MEDLINE - Academic</collection><jtitle>IEEE transactions on image processing</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Wang, Miao</au><au>Shamir, Ariel</au><au>Yang, Guo-Ye</au><au>Lin, Jin-Kun</au><au>Yang, Guo-Wei</au><au>Lu, Shao-Ping</au><au>Hu, Shi-Min</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>BiggerSelfie: Selfie Video Expansion With Hand-Held Camera</atitle><jtitle>IEEE transactions on image processing</jtitle><stitle>TIP</stitle><addtitle>IEEE Trans Image Process</addtitle><date>2018-12-01</date><risdate>2018</risdate><volume>27</volume><issue>12</issue><spage>5854</spage><epage>5865</epage><pages>5854-5865</pages><issn>1057-7149</issn><eissn>1941-0042</eissn><coden>IIPRE4</coden><abstract>Selfie photography from the hand-held camera is becoming a popular media type. Although being convenient and flexible, it suffers from low camera motion stability, small field of view, and limited background content. These limitations can annoy users, especially, when touring a place of interest and taking selfie videos. In this paper, we present a novel method to create what we call a BiggerSelfie that deals with these shortcomings. Using a video of the environment that has partial content overlap with the selfie video, we stitch plausible frames selected from the environment video to the original selfie frames and stabilize the composed video content with a portrait-preserving constraint. Using the proposed method, one can easily obtain a stable selfie video with expanded background content by merely capturing some background shots. We show various results and several evaluations to demonstrate the applicability of our method.</abstract><cop>United States</cop><pub>IEEE</pub><pmid>30047880</pmid><doi>10.1109/TIP.2018.2859628</doi><tpages>12</tpages><orcidid>https://orcid.org/0000-0002-8492-0925</orcidid><orcidid>https://orcid.org/0000-0001-7507-6542</orcidid><orcidid>https://orcid.org/0000-0002-4102-8582</orcidid></addata></record> |
fulltext | fulltext_linktorsrc |
identifier | ISSN: 1057-7149 |
ispartof | IEEE transactions on image processing, 2018-12, Vol.27 (12), p.5854-5865 |
issn | 1057-7149 1941-0042 |
language | eng |
recordid | cdi_pubmed_primary_30047880 |
source | IEEE Electronic Library (IEL) |
subjects | Algorithm design and analysis Cameras Feature extraction Field of view Frames Hand-held video editing Motion estimation Motion segmentation Motion stability Photography selfie video stitching |
title | BiggerSelfie: Selfie Video Expansion With Hand-Held Camera |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-12T17%3A29%3A05IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=BiggerSelfie:%20Selfie%20Video%20Expansion%20With%20Hand-Held%20Camera&rft.jtitle=IEEE%20transactions%20on%20image%20processing&rft.au=Wang,%20Miao&rft.date=2018-12-01&rft.volume=27&rft.issue=12&rft.spage=5854&rft.epage=5865&rft.pages=5854-5865&rft.issn=1057-7149&rft.eissn=1941-0042&rft.coden=IIPRE4&rft_id=info:doi/10.1109/TIP.2018.2859628&rft_dat=%3Cproquest_RIE%3E2117160744%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2117160744&rft_id=info:pmid/30047880&rft_ieee_id=8419717&rfr_iscdi=true |