Omnidirectional 360° Video Coding Technology in Responses to the Joint Call for Proposals on Video Compression With Capability Beyond HEVC

Augmented reality (AR) and virtual reality (VR) applications have seen rising popularity in recent years. Omnidirectional 360° video is a video format often used in AR and VR applications. To address the industry needs, a new HEVC edition recently published includes several supplemental enhancement...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on circuits and systems for video technology 2020-05, Vol.30 (5), p.1241-1252
Hauptverfasser: Ye, Yan, Boyce, Jill M., Hanhart, Philippe
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 1252
container_issue 5
container_start_page 1241
container_title IEEE transactions on circuits and systems for video technology
container_volume 30
creator Ye, Yan
Boyce, Jill M.
Hanhart, Philippe
description Augmented reality (AR) and virtual reality (VR) applications have seen rising popularity in recent years. Omnidirectional 360° video is a video format often used in AR and VR applications. To address the industry needs, a new HEVC edition recently published includes several supplemental enhancement information (SEI) messages to enable the carriage of omnidirectional video using HEVC. However, further improvement in 360° video compression efficiency is needed. In order to address this challenge, the Joint Video Exploration Team (JVET) of ITU-T VCEG and ISO/IEC MPEG has been investigating 360° video coding technologies, including projection formats, pre- and post-processing technologies, as well as 360°-video-specific coding tools since 2016. The joint call for proposals (CfP) recently issued by ITU-T VCEG and ISO/IEC MPEG on video compression technologies beyond HEVC included a category on 360° video. Twelve CfP responses in the 360° video category were received. This paper describes technologies relevant to 360° video for VVC. A summary of projection formats, pre- and post-processing methods, and 360°-video specific coding tool modifications in these proposals is provided.
doi_str_mv 10.1109/TCSVT.2019.2953827
format Article
fullrecord <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_proquest_journals_2400103096</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>8902161</ieee_id><sourcerecordid>2400103096</sourcerecordid><originalsourceid>FETCH-LOGICAL-c295t-8ea68b486132bfe277a8f8a93e17459993359c3acff31545699380c8170416433</originalsourceid><addsrcrecordid>eNo9kE1OwzAQhSMEEqVwAdhYYp3inzixlxAVCqpUBKUsIzedtK5SO9jpImfgMpyBk-HSqqsZjd6bmfdF0TXBA0KwvJvm77PpgGIiB1RyJmh2EvUI5yKmFPPT0GNOYkEJP48uvF9jTBKRZL3oe7IxeqEdlK22RtWIpfj3B830AizK7UKbJZpCuTK2tssOaYPewDfWePCotahdAXqx2rQoV3WNKuvQq7ON9ar2yJrjnk3jwPtwAX3qdhXEjZrrWrcdeoDOmgUaDWf5ZXRWBR9cHWo_-ngcTvNRPJ48Pef347gM2dpYgErFPBEpYXReAc0yJSqhJAOSJVxKyRiXJVNlVTHCE56GicClIBlOSJow1o9u93sbZ7-24NtibbcuhPcFTQIZzLBMg4ruVaWz3juoisbpjXJdQXCxg178Qy920IsD9GC62Zs0ABwNQmJKwrt_Xf59-A</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2400103096</pqid></control><display><type>article</type><title>Omnidirectional 360° Video Coding Technology in Responses to the Joint Call for Proposals on Video Compression With Capability Beyond HEVC</title><source>IEEE Electronic Library (IEL)</source><creator>Ye, Yan ; Boyce, Jill M. ; Hanhart, Philippe</creator><creatorcontrib>Ye, Yan ; Boyce, Jill M. ; Hanhart, Philippe</creatorcontrib><description>Augmented reality (AR) and virtual reality (VR) applications have seen rising popularity in recent years. Omnidirectional 360° video is a video format often used in AR and VR applications. To address the industry needs, a new HEVC edition recently published includes several supplemental enhancement information (SEI) messages to enable the carriage of omnidirectional video using HEVC. However, further improvement in 360° video compression efficiency is needed. In order to address this challenge, the Joint Video Exploration Team (JVET) of ITU-T VCEG and ISO/IEC MPEG has been investigating 360° video coding technologies, including projection formats, pre- and post-processing technologies, as well as 360°-video-specific coding tools since 2016. The joint call for proposals (CfP) recently issued by ITU-T VCEG and ISO/IEC MPEG on video compression technologies beyond HEVC included a category on 360° video. Twelve CfP responses in the 360° video category were received. This paper describes technologies relevant to 360° video for VVC. A summary of projection formats, pre- and post-processing methods, and 360°-video specific coding tool modifications in these proposals is provided.</description><identifier>ISSN: 1051-8215</identifier><identifier>EISSN: 1558-2205</identifier><identifier>DOI: 10.1109/TCSVT.2019.2953827</identifier><identifier>CODEN: ITCTEM</identifier><language>eng</language><publisher>New York: IEEE</publisher><subject>360° video ; Augmented reality ; Coding ; Encoding ; Face ; HEVC ; high efficiency video coding ; MPEG encoders ; Omnidirectional video ; Post-processing ; Proposals ; Streaming media ; Two dimensional displays ; versatile video coding ; Video coding ; Video compression ; Virtual reality ; VR video ; VVC</subject><ispartof>IEEE transactions on circuits and systems for video technology, 2020-05, Vol.30 (5), p.1241-1252</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2020</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c295t-8ea68b486132bfe277a8f8a93e17459993359c3acff31545699380c8170416433</citedby><cites>FETCH-LOGICAL-c295t-8ea68b486132bfe277a8f8a93e17459993359c3acff31545699380c8170416433</cites><orcidid>0000-0001-8431-6739 ; 0000-0002-9364-9137 ; 0000-0002-7278-0822</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/8902161$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,776,780,792,27901,27902,54733</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/8902161$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Ye, Yan</creatorcontrib><creatorcontrib>Boyce, Jill M.</creatorcontrib><creatorcontrib>Hanhart, Philippe</creatorcontrib><title>Omnidirectional 360° Video Coding Technology in Responses to the Joint Call for Proposals on Video Compression With Capability Beyond HEVC</title><title>IEEE transactions on circuits and systems for video technology</title><addtitle>TCSVT</addtitle><description>Augmented reality (AR) and virtual reality (VR) applications have seen rising popularity in recent years. Omnidirectional 360° video is a video format often used in AR and VR applications. To address the industry needs, a new HEVC edition recently published includes several supplemental enhancement information (SEI) messages to enable the carriage of omnidirectional video using HEVC. However, further improvement in 360° video compression efficiency is needed. In order to address this challenge, the Joint Video Exploration Team (JVET) of ITU-T VCEG and ISO/IEC MPEG has been investigating 360° video coding technologies, including projection formats, pre- and post-processing technologies, as well as 360°-video-specific coding tools since 2016. The joint call for proposals (CfP) recently issued by ITU-T VCEG and ISO/IEC MPEG on video compression technologies beyond HEVC included a category on 360° video. Twelve CfP responses in the 360° video category were received. This paper describes technologies relevant to 360° video for VVC. A summary of projection formats, pre- and post-processing methods, and 360°-video specific coding tool modifications in these proposals is provided.</description><subject>360° video</subject><subject>Augmented reality</subject><subject>Coding</subject><subject>Encoding</subject><subject>Face</subject><subject>HEVC</subject><subject>high efficiency video coding</subject><subject>MPEG encoders</subject><subject>Omnidirectional video</subject><subject>Post-processing</subject><subject>Proposals</subject><subject>Streaming media</subject><subject>Two dimensional displays</subject><subject>versatile video coding</subject><subject>Video coding</subject><subject>Video compression</subject><subject>Virtual reality</subject><subject>VR video</subject><subject>VVC</subject><issn>1051-8215</issn><issn>1558-2205</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2020</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNo9kE1OwzAQhSMEEqVwAdhYYp3inzixlxAVCqpUBKUsIzedtK5SO9jpImfgMpyBk-HSqqsZjd6bmfdF0TXBA0KwvJvm77PpgGIiB1RyJmh2EvUI5yKmFPPT0GNOYkEJP48uvF9jTBKRZL3oe7IxeqEdlK22RtWIpfj3B830AizK7UKbJZpCuTK2tssOaYPewDfWePCotahdAXqx2rQoV3WNKuvQq7ON9ar2yJrjnk3jwPtwAX3qdhXEjZrrWrcdeoDOmgUaDWf5ZXRWBR9cHWo_-ngcTvNRPJ48Pef347gM2dpYgErFPBEpYXReAc0yJSqhJAOSJVxKyRiXJVNlVTHCE56GicClIBlOSJow1o9u93sbZ7-24NtibbcuhPcFTQIZzLBMg4ruVaWz3juoisbpjXJdQXCxg178Qy920IsD9GC62Zs0ABwNQmJKwrt_Xf59-A</recordid><startdate>20200501</startdate><enddate>20200501</enddate><creator>Ye, Yan</creator><creator>Boyce, Jill M.</creator><creator>Hanhart, Philippe</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7SP</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><orcidid>https://orcid.org/0000-0001-8431-6739</orcidid><orcidid>https://orcid.org/0000-0002-9364-9137</orcidid><orcidid>https://orcid.org/0000-0002-7278-0822</orcidid></search><sort><creationdate>20200501</creationdate><title>Omnidirectional 360° Video Coding Technology in Responses to the Joint Call for Proposals on Video Compression With Capability Beyond HEVC</title><author>Ye, Yan ; Boyce, Jill M. ; Hanhart, Philippe</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c295t-8ea68b486132bfe277a8f8a93e17459993359c3acff31545699380c8170416433</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2020</creationdate><topic>360° video</topic><topic>Augmented reality</topic><topic>Coding</topic><topic>Encoding</topic><topic>Face</topic><topic>HEVC</topic><topic>high efficiency video coding</topic><topic>MPEG encoders</topic><topic>Omnidirectional video</topic><topic>Post-processing</topic><topic>Proposals</topic><topic>Streaming media</topic><topic>Two dimensional displays</topic><topic>versatile video coding</topic><topic>Video coding</topic><topic>Video compression</topic><topic>Virtual reality</topic><topic>VR video</topic><topic>VVC</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Ye, Yan</creatorcontrib><creatorcontrib>Boyce, Jill M.</creatorcontrib><creatorcontrib>Hanhart, Philippe</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics &amp; Communications Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>IEEE transactions on circuits and systems for video technology</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Ye, Yan</au><au>Boyce, Jill M.</au><au>Hanhart, Philippe</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Omnidirectional 360° Video Coding Technology in Responses to the Joint Call for Proposals on Video Compression With Capability Beyond HEVC</atitle><jtitle>IEEE transactions on circuits and systems for video technology</jtitle><stitle>TCSVT</stitle><date>2020-05-01</date><risdate>2020</risdate><volume>30</volume><issue>5</issue><spage>1241</spage><epage>1252</epage><pages>1241-1252</pages><issn>1051-8215</issn><eissn>1558-2205</eissn><coden>ITCTEM</coden><abstract>Augmented reality (AR) and virtual reality (VR) applications have seen rising popularity in recent years. Omnidirectional 360° video is a video format often used in AR and VR applications. To address the industry needs, a new HEVC edition recently published includes several supplemental enhancement information (SEI) messages to enable the carriage of omnidirectional video using HEVC. However, further improvement in 360° video compression efficiency is needed. In order to address this challenge, the Joint Video Exploration Team (JVET) of ITU-T VCEG and ISO/IEC MPEG has been investigating 360° video coding technologies, including projection formats, pre- and post-processing technologies, as well as 360°-video-specific coding tools since 2016. The joint call for proposals (CfP) recently issued by ITU-T VCEG and ISO/IEC MPEG on video compression technologies beyond HEVC included a category on 360° video. Twelve CfP responses in the 360° video category were received. This paper describes technologies relevant to 360° video for VVC. A summary of projection formats, pre- and post-processing methods, and 360°-video specific coding tool modifications in these proposals is provided.</abstract><cop>New York</cop><pub>IEEE</pub><doi>10.1109/TCSVT.2019.2953827</doi><tpages>12</tpages><orcidid>https://orcid.org/0000-0001-8431-6739</orcidid><orcidid>https://orcid.org/0000-0002-9364-9137</orcidid><orcidid>https://orcid.org/0000-0002-7278-0822</orcidid></addata></record>
fulltext fulltext_linktorsrc
identifier ISSN: 1051-8215
ispartof IEEE transactions on circuits and systems for video technology, 2020-05, Vol.30 (5), p.1241-1252
issn 1051-8215
1558-2205
language eng
recordid cdi_proquest_journals_2400103096
source IEEE Electronic Library (IEL)
subjects 360° video
Augmented reality
Coding
Encoding
Face
HEVC
high efficiency video coding
MPEG encoders
Omnidirectional video
Post-processing
Proposals
Streaming media
Two dimensional displays
versatile video coding
Video coding
Video compression
Virtual reality
VR video
VVC
title Omnidirectional 360° Video Coding Technology in Responses to the Joint Call for Proposals on Video Compression With Capability Beyond HEVC
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-05T04%3A55%3A42IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Omnidirectional%20360%C2%B0%20Video%20Coding%20Technology%20in%20Responses%20to%20the%20Joint%20Call%20for%20Proposals%20on%20Video%20Compression%20With%20Capability%20Beyond%20HEVC&rft.jtitle=IEEE%20transactions%20on%20circuits%20and%20systems%20for%20video%20technology&rft.au=Ye,%20Yan&rft.date=2020-05-01&rft.volume=30&rft.issue=5&rft.spage=1241&rft.epage=1252&rft.pages=1241-1252&rft.issn=1051-8215&rft.eissn=1558-2205&rft.coden=ITCTEM&rft_id=info:doi/10.1109/TCSVT.2019.2953827&rft_dat=%3Cproquest_RIE%3E2400103096%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2400103096&rft_id=info:pmid/&rft_ieee_id=8902161&rfr_iscdi=true