Learning-Based Conditional Image Coder Using Color Separation

Recently, image compression codecs based on Neural Networks(NN) outperformed the state-of-art classic ones such as BPG, an image format based on HEVC intra. However, the typical NN codec has high complexity, and it has limited options for parallel data processing. In this work, we propose a conditio...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:arXiv.org 2022-12
Hauptverfasser: Jia, Panqi, Koyuncu, Ahmet Burakhan, Gaikov, Georgii, Karabutov, Alexander, Alshina, Elena, Kaup, Andre
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title arXiv.org
container_volume
creator Jia, Panqi
Koyuncu, Ahmet Burakhan
Gaikov, Georgii
Karabutov, Alexander
Alshina, Elena
Kaup, Andre
description Recently, image compression codecs based on Neural Networks(NN) outperformed the state-of-art classic ones such as BPG, an image format based on HEVC intra. However, the typical NN codec has high complexity, and it has limited options for parallel data processing. In this work, we propose a conditional separation principle that aims to improve parallelization and lower the computational requirements of an NN codec. We present a Conditional Color Separation (CCS) codec which follows this principle. The color components of an image are split into primary and non-primary ones. The processing of each component is done separately, by jointly trained networks. Our approach allows parallel processing of each component, flexibility to select different channel numbers, and an overall complexity reduction. The CCS codec uses over 40% less memory, has 2x faster encoding and 22% faster decoding speed, with only 4% BD-rate loss in RGB PSNR compared to our baseline model over BPG.
doi_str_mv 10.48550/arxiv.2212.06241
format Article
fullrecord <record><control><sourceid>proquest_arxiv</sourceid><recordid>TN_cdi_arxiv_primary_2212_06241</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2754223707</sourcerecordid><originalsourceid>FETCH-LOGICAL-a951-e06dc4ea431c477f13209319af273c8fc0d967e0e2288e0479aad762dbc77b823</originalsourceid><addsrcrecordid>eNotz01Lw0AQgOFFECy1P8CTAc-Js7O72c3BgwY_CgEP1nOYZjclJU3ibiv67922nmYYXgYexm44ZNIoBffkf7rvDJFjBjlKfsFmKARPjUS8YosQtgCAuUalxIw9VI780A2b9ImCs0k5Drbbd-NAfbLc0cbFi3U--QyxiXs_-uTDTeTpGF2zy5b64Bb_c85WL8-r8i2t3l-X5WOVUqF46iC3jXQkBW-k1i0XCIXgBbWoRWPaBmyRawcO0RgHUhdEVudo143Wa4Nizm7Pb0-2evLdjvxvfTTWJ2Ms7s7F5Mevgwv7ejsefESEGrWKcqFBiz8pIlLA</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2754223707</pqid></control><display><type>article</type><title>Learning-Based Conditional Image Coder Using Color Separation</title><source>arXiv.org</source><source>Free E- Journals</source><creator>Jia, Panqi ; Koyuncu, Ahmet Burakhan ; Gaikov, Georgii ; Karabutov, Alexander ; Alshina, Elena ; Kaup, Andre</creator><creatorcontrib>Jia, Panqi ; Koyuncu, Ahmet Burakhan ; Gaikov, Georgii ; Karabutov, Alexander ; Alshina, Elena ; Kaup, Andre</creatorcontrib><description>Recently, image compression codecs based on Neural Networks(NN) outperformed the state-of-art classic ones such as BPG, an image format based on HEVC intra. However, the typical NN codec has high complexity, and it has limited options for parallel data processing. In this work, we propose a conditional separation principle that aims to improve parallelization and lower the computational requirements of an NN codec. We present a Conditional Color Separation (CCS) codec which follows this principle. The color components of an image are split into primary and non-primary ones. The processing of each component is done separately, by jointly trained networks. Our approach allows parallel processing of each component, flexibility to select different channel numbers, and an overall complexity reduction. The CCS codec uses over 40% less memory, has 2x faster encoding and 22% faster decoding speed, with only 4% BD-rate loss in RGB PSNR compared to our baseline model over BPG.</description><identifier>EISSN: 2331-8422</identifier><identifier>DOI: 10.48550/arxiv.2212.06241</identifier><language>eng</language><publisher>Ithaca: Cornell University Library, arXiv.org</publisher><subject>Codec ; Color separations ; Complexity ; Data processing ; Image compression ; Neural networks ; Parallel processing ; Principles</subject><ispartof>arXiv.org, 2022-12</ispartof><rights>2022. This work is published under http://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><rights>http://creativecommons.org/licenses/by/4.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,776,780,881,27902</link.rule.ids><backlink>$$Uhttps://doi.org/10.48550/arXiv.2212.06241$$DView paper in arXiv$$Hfree_for_read</backlink><backlink>$$Uhttps://doi.org/10.1109/PCS56426.2022.10018070$$DView published paper (Access to full text may be restricted)$$Hfree_for_read</backlink></links><search><creatorcontrib>Jia, Panqi</creatorcontrib><creatorcontrib>Koyuncu, Ahmet Burakhan</creatorcontrib><creatorcontrib>Gaikov, Georgii</creatorcontrib><creatorcontrib>Karabutov, Alexander</creatorcontrib><creatorcontrib>Alshina, Elena</creatorcontrib><creatorcontrib>Kaup, Andre</creatorcontrib><title>Learning-Based Conditional Image Coder Using Color Separation</title><title>arXiv.org</title><description>Recently, image compression codecs based on Neural Networks(NN) outperformed the state-of-art classic ones such as BPG, an image format based on HEVC intra. However, the typical NN codec has high complexity, and it has limited options for parallel data processing. In this work, we propose a conditional separation principle that aims to improve parallelization and lower the computational requirements of an NN codec. We present a Conditional Color Separation (CCS) codec which follows this principle. The color components of an image are split into primary and non-primary ones. The processing of each component is done separately, by jointly trained networks. Our approach allows parallel processing of each component, flexibility to select different channel numbers, and an overall complexity reduction. The CCS codec uses over 40% less memory, has 2x faster encoding and 22% faster decoding speed, with only 4% BD-rate loss in RGB PSNR compared to our baseline model over BPG.</description><subject>Codec</subject><subject>Color separations</subject><subject>Complexity</subject><subject>Data processing</subject><subject>Image compression</subject><subject>Neural networks</subject><subject>Parallel processing</subject><subject>Principles</subject><issn>2331-8422</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><sourceid>BENPR</sourceid><sourceid>GOX</sourceid><recordid>eNotz01Lw0AQgOFFECy1P8CTAc-Js7O72c3BgwY_CgEP1nOYZjclJU3ibiv67922nmYYXgYexm44ZNIoBffkf7rvDJFjBjlKfsFmKARPjUS8YosQtgCAuUalxIw9VI780A2b9ImCs0k5Drbbd-NAfbLc0cbFi3U--QyxiXs_-uTDTeTpGF2zy5b64Bb_c85WL8-r8i2t3l-X5WOVUqF46iC3jXQkBW-k1i0XCIXgBbWoRWPaBmyRawcO0RgHUhdEVudo143Wa4Nizm7Pb0-2evLdjvxvfTTWJ2Ms7s7F5Mevgwv7ejsefESEGrWKcqFBiz8pIlLA</recordid><startdate>20221212</startdate><enddate>20221212</enddate><creator>Jia, Panqi</creator><creator>Koyuncu, Ahmet Burakhan</creator><creator>Gaikov, Georgii</creator><creator>Karabutov, Alexander</creator><creator>Alshina, Elena</creator><creator>Kaup, Andre</creator><general>Cornell University Library, arXiv.org</general><scope>8FE</scope><scope>8FG</scope><scope>ABJCF</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>HCIFZ</scope><scope>L6V</scope><scope>M7S</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>PTHSS</scope><scope>GOX</scope></search><sort><creationdate>20221212</creationdate><title>Learning-Based Conditional Image Coder Using Color Separation</title><author>Jia, Panqi ; Koyuncu, Ahmet Burakhan ; Gaikov, Georgii ; Karabutov, Alexander ; Alshina, Elena ; Kaup, Andre</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a951-e06dc4ea431c477f13209319af273c8fc0d967e0e2288e0479aad762dbc77b823</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>Codec</topic><topic>Color separations</topic><topic>Complexity</topic><topic>Data processing</topic><topic>Image compression</topic><topic>Neural networks</topic><topic>Parallel processing</topic><topic>Principles</topic><toplevel>online_resources</toplevel><creatorcontrib>Jia, Panqi</creatorcontrib><creatorcontrib>Koyuncu, Ahmet Burakhan</creatorcontrib><creatorcontrib>Gaikov, Georgii</creatorcontrib><creatorcontrib>Karabutov, Alexander</creatorcontrib><creatorcontrib>Alshina, Elena</creatorcontrib><creatorcontrib>Kaup, Andre</creatorcontrib><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>Materials Science &amp; Engineering Collection</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Engineering Collection</collection><collection>Engineering Database</collection><collection>Publicly Available Content Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>Engineering Collection</collection><collection>arXiv.org</collection><jtitle>arXiv.org</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Jia, Panqi</au><au>Koyuncu, Ahmet Burakhan</au><au>Gaikov, Georgii</au><au>Karabutov, Alexander</au><au>Alshina, Elena</au><au>Kaup, Andre</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Learning-Based Conditional Image Coder Using Color Separation</atitle><jtitle>arXiv.org</jtitle><date>2022-12-12</date><risdate>2022</risdate><eissn>2331-8422</eissn><abstract>Recently, image compression codecs based on Neural Networks(NN) outperformed the state-of-art classic ones such as BPG, an image format based on HEVC intra. However, the typical NN codec has high complexity, and it has limited options for parallel data processing. In this work, we propose a conditional separation principle that aims to improve parallelization and lower the computational requirements of an NN codec. We present a Conditional Color Separation (CCS) codec which follows this principle. The color components of an image are split into primary and non-primary ones. The processing of each component is done separately, by jointly trained networks. Our approach allows parallel processing of each component, flexibility to select different channel numbers, and an overall complexity reduction. The CCS codec uses over 40% less memory, has 2x faster encoding and 22% faster decoding speed, with only 4% BD-rate loss in RGB PSNR compared to our baseline model over BPG.</abstract><cop>Ithaca</cop><pub>Cornell University Library, arXiv.org</pub><doi>10.48550/arxiv.2212.06241</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier EISSN: 2331-8422
ispartof arXiv.org, 2022-12
issn 2331-8422
language eng
recordid cdi_arxiv_primary_2212_06241
source arXiv.org; Free E- Journals
subjects Codec
Color separations
Complexity
Data processing
Image compression
Neural networks
Parallel processing
Principles
title Learning-Based Conditional Image Coder Using Color Separation
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-08T01%3A39%3A00IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_arxiv&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Learning-Based%20Conditional%20Image%20Coder%20Using%20Color%20Separation&rft.jtitle=arXiv.org&rft.au=Jia,%20Panqi&rft.date=2022-12-12&rft.eissn=2331-8422&rft_id=info:doi/10.48550/arxiv.2212.06241&rft_dat=%3Cproquest_arxiv%3E2754223707%3C/proquest_arxiv%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2754223707&rft_id=info:pmid/&rfr_iscdi=true