Low complexity content-aware video retargeting for mobile devices

In this paper, a low complexity content-aware video retargeting method suitable for mobile multimedia devices is presented. We propose two types of energy functions for intra- and inter-frames to obtain the pixel significance in the video frames. Since the energy functions are defined using only the...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on consumer electronics 2010-02, Vol.56 (1), p.182-189
Hauptverfasser: Nam, Hyeong-Min, Byun, Keun-Yung, Jeong, Jae-Yun, Choi, Kang-Sun, Ko, Sung-Jea
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 189
container_issue 1
container_start_page 182
container_title IEEE transactions on consumer electronics
container_volume 56
creator Nam, Hyeong-Min
Byun, Keun-Yung
Jeong, Jae-Yun
Choi, Kang-Sun
Ko, Sung-Jea
description In this paper, a low complexity content-aware video retargeting method suitable for mobile multimedia devices is presented. We propose two types of energy functions for intra- and inter-frames to obtain the pixel significance in the video frames. Since the energy functions are defined using only the compressed-domain information such as discrete cosine transform (DCT) coefficients and motion vectors (MVs), instead of fully decoded pixel domain information, the spatiotemporal energy map can be constructed without excessive computations. Based on the proposed energy function, we also introduce a fast seam carving method for mobile devices that carves out the one-dimensional (1-D) seams without annoying artifacts such as jitter and flicker, taking into account the object motion based on MVs. Experimental results show that the proposed video retargeting scheme can achieve high subjective quality with significantly reduced computational loads as compared with existing methods.
doi_str_mv 10.1109/TCE.2010.5439143
format Article
fullrecord <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_crossref_primary_10_1109_TCE_2010_5439143</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>5439143</ieee_id><sourcerecordid>2716611591</sourcerecordid><originalsourceid>FETCH-LOGICAL-c323t-5a2f89b0ac10ed5c41a1a64af97a2b79d0ded418848745f6e2eb795b84bd595c3</originalsourceid><addsrcrecordid>eNpdkDtPwzAQgC0EEqWwI7FEYmBK8TOxx6oqD6kSS5ktx7lUrpK42GlL_z2uWhiY7vXd6fQhdE_whBCsnpez-YTiVAnOFOHsAo2IEDLnhJaXaISxkjnDBbtGNzGuMSZcUDlC04XfZ9Z3mxa-3XBIaT9AP-RmbwJkO1eDzwIMJqxgcP0qa3zIOl-5FrIads5CvEVXjWkj3J3jGH2-zJezt3zx8fo-my5yyygbcmFoI1WFjSUYamE5McQU3DSqNLQqVY1rqDmRksuSi6YACqkrKsmrWihh2Rg9ne5ugv_aQhx056KFtjU9-G3UihaMUFmUiXz8R679NvTpOU0wLUmBaUEThU-UDT7GAI3eBNeZcEiQPirVSak-KtVnpWnl4bTiAOAP_53-APMTcZY</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>1027160262</pqid></control><display><type>article</type><title>Low complexity content-aware video retargeting for mobile devices</title><source>IEEE Electronic Library (IEL)</source><creator>Nam, Hyeong-Min ; Byun, Keun-Yung ; Jeong, Jae-Yun ; Choi, Kang-Sun ; Ko, Sung-Jea</creator><creatorcontrib>Nam, Hyeong-Min ; Byun, Keun-Yung ; Jeong, Jae-Yun ; Choi, Kang-Sun ; Ko, Sung-Jea</creatorcontrib><description>In this paper, a low complexity content-aware video retargeting method suitable for mobile multimedia devices is presented. We propose two types of energy functions for intra- and inter-frames to obtain the pixel significance in the video frames. Since the energy functions are defined using only the compressed-domain information such as discrete cosine transform (DCT) coefficients and motion vectors (MVs), instead of fully decoded pixel domain information, the spatiotemporal energy map can be constructed without excessive computations. Based on the proposed energy function, we also introduce a fast seam carving method for mobile devices that carves out the one-dimensional (1-D) seams without annoying artifacts such as jitter and flicker, taking into account the object motion based on MVs. Experimental results show that the proposed video retargeting scheme can achieve high subjective quality with significantly reduced computational loads as compared with existing methods.</description><identifier>ISSN: 0098-3063</identifier><identifier>EISSN: 1558-4127</identifier><identifier>DOI: 10.1109/TCE.2010.5439143</identifier><identifier>CODEN: ITCEDA</identifier><language>eng</language><publisher>New York: IEEE</publisher><subject>comdomain processing ; Complexity ; Computation ; Computer interfaces ; content-aware ; Decoding ; Discrete cosine transforms ; Energy use ; Hardware ; Jitter ; low complexity ; Mathematical analysis ; Mathematical models ; Mobile communication systems ; Mobile computing ; Pixels ; seam carvingpressed ; Seams ; Spatiotemporal phenomena ; Technological innovation ; Video compression ; Video retargeting</subject><ispartof>IEEE transactions on consumer electronics, 2010-02, Vol.56 (1), p.182-189</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) Feb 2010</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c323t-5a2f89b0ac10ed5c41a1a64af97a2b79d0ded418848745f6e2eb795b84bd595c3</citedby><cites>FETCH-LOGICAL-c323t-5a2f89b0ac10ed5c41a1a64af97a2b79d0ded418848745f6e2eb795b84bd595c3</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/5439143$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,780,784,796,27923,27924,54757</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/5439143$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Nam, Hyeong-Min</creatorcontrib><creatorcontrib>Byun, Keun-Yung</creatorcontrib><creatorcontrib>Jeong, Jae-Yun</creatorcontrib><creatorcontrib>Choi, Kang-Sun</creatorcontrib><creatorcontrib>Ko, Sung-Jea</creatorcontrib><title>Low complexity content-aware video retargeting for mobile devices</title><title>IEEE transactions on consumer electronics</title><addtitle>T-CE</addtitle><description>In this paper, a low complexity content-aware video retargeting method suitable for mobile multimedia devices is presented. We propose two types of energy functions for intra- and inter-frames to obtain the pixel significance in the video frames. Since the energy functions are defined using only the compressed-domain information such as discrete cosine transform (DCT) coefficients and motion vectors (MVs), instead of fully decoded pixel domain information, the spatiotemporal energy map can be constructed without excessive computations. Based on the proposed energy function, we also introduce a fast seam carving method for mobile devices that carves out the one-dimensional (1-D) seams without annoying artifacts such as jitter and flicker, taking into account the object motion based on MVs. Experimental results show that the proposed video retargeting scheme can achieve high subjective quality with significantly reduced computational loads as compared with existing methods.</description><subject>comdomain processing</subject><subject>Complexity</subject><subject>Computation</subject><subject>Computer interfaces</subject><subject>content-aware</subject><subject>Decoding</subject><subject>Discrete cosine transforms</subject><subject>Energy use</subject><subject>Hardware</subject><subject>Jitter</subject><subject>low complexity</subject><subject>Mathematical analysis</subject><subject>Mathematical models</subject><subject>Mobile communication systems</subject><subject>Mobile computing</subject><subject>Pixels</subject><subject>seam carvingpressed</subject><subject>Seams</subject><subject>Spatiotemporal phenomena</subject><subject>Technological innovation</subject><subject>Video compression</subject><subject>Video retargeting</subject><issn>0098-3063</issn><issn>1558-4127</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2010</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNpdkDtPwzAQgC0EEqWwI7FEYmBK8TOxx6oqD6kSS5ktx7lUrpK42GlL_z2uWhiY7vXd6fQhdE_whBCsnpez-YTiVAnOFOHsAo2IEDLnhJaXaISxkjnDBbtGNzGuMSZcUDlC04XfZ9Z3mxa-3XBIaT9AP-RmbwJkO1eDzwIMJqxgcP0qa3zIOl-5FrIads5CvEVXjWkj3J3jGH2-zJezt3zx8fo-my5yyygbcmFoI1WFjSUYamE5McQU3DSqNLQqVY1rqDmRksuSi6YACqkrKsmrWihh2Rg9ne5ugv_aQhx056KFtjU9-G3UihaMUFmUiXz8R679NvTpOU0wLUmBaUEThU-UDT7GAI3eBNeZcEiQPirVSak-KtVnpWnl4bTiAOAP_53-APMTcZY</recordid><startdate>201002</startdate><enddate>201002</enddate><creator>Nam, Hyeong-Min</creator><creator>Byun, Keun-Yung</creator><creator>Jeong, Jae-Yun</creator><creator>Choi, Kang-Sun</creator><creator>Ko, Sung-Jea</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SP</scope><scope>8FD</scope><scope>F28</scope><scope>FR3</scope><scope>L7M</scope></search><sort><creationdate>201002</creationdate><title>Low complexity content-aware video retargeting for mobile devices</title><author>Nam, Hyeong-Min ; Byun, Keun-Yung ; Jeong, Jae-Yun ; Choi, Kang-Sun ; Ko, Sung-Jea</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c323t-5a2f89b0ac10ed5c41a1a64af97a2b79d0ded418848745f6e2eb795b84bd595c3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2010</creationdate><topic>comdomain processing</topic><topic>Complexity</topic><topic>Computation</topic><topic>Computer interfaces</topic><topic>content-aware</topic><topic>Decoding</topic><topic>Discrete cosine transforms</topic><topic>Energy use</topic><topic>Hardware</topic><topic>Jitter</topic><topic>low complexity</topic><topic>Mathematical analysis</topic><topic>Mathematical models</topic><topic>Mobile communication systems</topic><topic>Mobile computing</topic><topic>Pixels</topic><topic>seam carvingpressed</topic><topic>Seams</topic><topic>Spatiotemporal phenomena</topic><topic>Technological innovation</topic><topic>Video compression</topic><topic>Video retargeting</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Nam, Hyeong-Min</creatorcontrib><creatorcontrib>Byun, Keun-Yung</creatorcontrib><creatorcontrib>Jeong, Jae-Yun</creatorcontrib><creatorcontrib>Choi, Kang-Sun</creatorcontrib><creatorcontrib>Ko, Sung-Jea</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Electronics &amp; Communications Abstracts</collection><collection>Technology Research Database</collection><collection>ANTE: Abstracts in New Technology &amp; Engineering</collection><collection>Engineering Research Database</collection><collection>Advanced Technologies Database with Aerospace</collection><jtitle>IEEE transactions on consumer electronics</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Nam, Hyeong-Min</au><au>Byun, Keun-Yung</au><au>Jeong, Jae-Yun</au><au>Choi, Kang-Sun</au><au>Ko, Sung-Jea</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Low complexity content-aware video retargeting for mobile devices</atitle><jtitle>IEEE transactions on consumer electronics</jtitle><stitle>T-CE</stitle><date>2010-02</date><risdate>2010</risdate><volume>56</volume><issue>1</issue><spage>182</spage><epage>189</epage><pages>182-189</pages><issn>0098-3063</issn><eissn>1558-4127</eissn><coden>ITCEDA</coden><abstract>In this paper, a low complexity content-aware video retargeting method suitable for mobile multimedia devices is presented. We propose two types of energy functions for intra- and inter-frames to obtain the pixel significance in the video frames. Since the energy functions are defined using only the compressed-domain information such as discrete cosine transform (DCT) coefficients and motion vectors (MVs), instead of fully decoded pixel domain information, the spatiotemporal energy map can be constructed without excessive computations. Based on the proposed energy function, we also introduce a fast seam carving method for mobile devices that carves out the one-dimensional (1-D) seams without annoying artifacts such as jitter and flicker, taking into account the object motion based on MVs. Experimental results show that the proposed video retargeting scheme can achieve high subjective quality with significantly reduced computational loads as compared with existing methods.</abstract><cop>New York</cop><pub>IEEE</pub><doi>10.1109/TCE.2010.5439143</doi><tpages>8</tpages></addata></record>
fulltext fulltext_linktorsrc
identifier ISSN: 0098-3063
ispartof IEEE transactions on consumer electronics, 2010-02, Vol.56 (1), p.182-189
issn 0098-3063
1558-4127
language eng
recordid cdi_crossref_primary_10_1109_TCE_2010_5439143
source IEEE Electronic Library (IEL)
subjects comdomain processing
Complexity
Computation
Computer interfaces
content-aware
Decoding
Discrete cosine transforms
Energy use
Hardware
Jitter
low complexity
Mathematical analysis
Mathematical models
Mobile communication systems
Mobile computing
Pixels
seam carvingpressed
Seams
Spatiotemporal phenomena
Technological innovation
Video compression
Video retargeting
title Low complexity content-aware video retargeting for mobile devices
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-12T13%3A58%3A12IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Low%20complexity%20content-aware%20video%20retargeting%20for%20mobile%20devices&rft.jtitle=IEEE%20transactions%20on%20consumer%20electronics&rft.au=Nam,%20Hyeong-Min&rft.date=2010-02&rft.volume=56&rft.issue=1&rft.spage=182&rft.epage=189&rft.pages=182-189&rft.issn=0098-3063&rft.eissn=1558-4127&rft.coden=ITCEDA&rft_id=info:doi/10.1109/TCE.2010.5439143&rft_dat=%3Cproquest_RIE%3E2716611591%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=1027160262&rft_id=info:pmid/&rft_ieee_id=5439143&rfr_iscdi=true