Learning-Based Conditional Image Coder Using Color Separation
Recently, image compression codecs based on Neural Networks(NN) outperformed the state-of-art classic ones such as BPG, an image format based on HEVC intra. However, the typical NN codec has high complexity, and it has limited options for parallel data processing. In this work, we propose a conditio...
Gespeichert in:
Veröffentlicht in: | arXiv.org 2022-12 |
---|---|
Hauptverfasser: | , , , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | |
---|---|
container_issue | |
container_start_page | |
container_title | arXiv.org |
container_volume | |
creator | Jia, Panqi Koyuncu, Ahmet Burakhan Gaikov, Georgii Karabutov, Alexander Alshina, Elena Kaup, Andre |
description | Recently, image compression codecs based on Neural Networks(NN) outperformed the state-of-art classic ones such as BPG, an image format based on HEVC intra. However, the typical NN codec has high complexity, and it has limited options for parallel data processing. In this work, we propose a conditional separation principle that aims to improve parallelization and lower the computational requirements of an NN codec. We present a Conditional Color Separation (CCS) codec which follows this principle. The color components of an image are split into primary and non-primary ones. The processing of each component is done separately, by jointly trained networks. Our approach allows parallel processing of each component, flexibility to select different channel numbers, and an overall complexity reduction. The CCS codec uses over 40% less memory, has 2x faster encoding and 22% faster decoding speed, with only 4% BD-rate loss in RGB PSNR compared to our baseline model over BPG. |
doi_str_mv | 10.48550/arxiv.2212.06241 |
format | Article |
fullrecord | <record><control><sourceid>proquest_arxiv</sourceid><recordid>TN_cdi_arxiv_primary_2212_06241</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2754223707</sourcerecordid><originalsourceid>FETCH-LOGICAL-a951-e06dc4ea431c477f13209319af273c8fc0d967e0e2288e0479aad762dbc77b823</originalsourceid><addsrcrecordid>eNotz01Lw0AQgOFFECy1P8CTAc-Js7O72c3BgwY_CgEP1nOYZjclJU3ibiv67922nmYYXgYexm44ZNIoBffkf7rvDJFjBjlKfsFmKARPjUS8YosQtgCAuUalxIw9VI780A2b9ImCs0k5Drbbd-NAfbLc0cbFi3U--QyxiXs_-uTDTeTpGF2zy5b64Bb_c85WL8-r8i2t3l-X5WOVUqF46iC3jXQkBW-k1i0XCIXgBbWoRWPaBmyRawcO0RgHUhdEVudo143Wa4Nizm7Pb0-2evLdjvxvfTTWJ2Ms7s7F5Mevgwv7ejsefESEGrWKcqFBiz8pIlLA</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2754223707</pqid></control><display><type>article</type><title>Learning-Based Conditional Image Coder Using Color Separation</title><source>arXiv.org</source><source>Free E- Journals</source><creator>Jia, Panqi ; Koyuncu, Ahmet Burakhan ; Gaikov, Georgii ; Karabutov, Alexander ; Alshina, Elena ; Kaup, Andre</creator><creatorcontrib>Jia, Panqi ; Koyuncu, Ahmet Burakhan ; Gaikov, Georgii ; Karabutov, Alexander ; Alshina, Elena ; Kaup, Andre</creatorcontrib><description>Recently, image compression codecs based on Neural Networks(NN) outperformed the state-of-art classic ones such as BPG, an image format based on HEVC intra. However, the typical NN codec has high complexity, and it has limited options for parallel data processing. In this work, we propose a conditional separation principle that aims to improve parallelization and lower the computational requirements of an NN codec. We present a Conditional Color Separation (CCS) codec which follows this principle. The color components of an image are split into primary and non-primary ones. The processing of each component is done separately, by jointly trained networks. Our approach allows parallel processing of each component, flexibility to select different channel numbers, and an overall complexity reduction. The CCS codec uses over 40% less memory, has 2x faster encoding and 22% faster decoding speed, with only 4% BD-rate loss in RGB PSNR compared to our baseline model over BPG.</description><identifier>EISSN: 2331-8422</identifier><identifier>DOI: 10.48550/arxiv.2212.06241</identifier><language>eng</language><publisher>Ithaca: Cornell University Library, arXiv.org</publisher><subject>Codec ; Color separations ; Complexity ; Data processing ; Image compression ; Neural networks ; Parallel processing ; Principles</subject><ispartof>arXiv.org, 2022-12</ispartof><rights>2022. This work is published under http://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><rights>http://creativecommons.org/licenses/by/4.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,776,780,881,27902</link.rule.ids><backlink>$$Uhttps://doi.org/10.48550/arXiv.2212.06241$$DView paper in arXiv$$Hfree_for_read</backlink><backlink>$$Uhttps://doi.org/10.1109/PCS56426.2022.10018070$$DView published paper (Access to full text may be restricted)$$Hfree_for_read</backlink></links><search><creatorcontrib>Jia, Panqi</creatorcontrib><creatorcontrib>Koyuncu, Ahmet Burakhan</creatorcontrib><creatorcontrib>Gaikov, Georgii</creatorcontrib><creatorcontrib>Karabutov, Alexander</creatorcontrib><creatorcontrib>Alshina, Elena</creatorcontrib><creatorcontrib>Kaup, Andre</creatorcontrib><title>Learning-Based Conditional Image Coder Using Color Separation</title><title>arXiv.org</title><description>Recently, image compression codecs based on Neural Networks(NN) outperformed the state-of-art classic ones such as BPG, an image format based on HEVC intra. However, the typical NN codec has high complexity, and it has limited options for parallel data processing. In this work, we propose a conditional separation principle that aims to improve parallelization and lower the computational requirements of an NN codec. We present a Conditional Color Separation (CCS) codec which follows this principle. The color components of an image are split into primary and non-primary ones. The processing of each component is done separately, by jointly trained networks. Our approach allows parallel processing of each component, flexibility to select different channel numbers, and an overall complexity reduction. The CCS codec uses over 40% less memory, has 2x faster encoding and 22% faster decoding speed, with only 4% BD-rate loss in RGB PSNR compared to our baseline model over BPG.</description><subject>Codec</subject><subject>Color separations</subject><subject>Complexity</subject><subject>Data processing</subject><subject>Image compression</subject><subject>Neural networks</subject><subject>Parallel processing</subject><subject>Principles</subject><issn>2331-8422</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><sourceid>BENPR</sourceid><sourceid>GOX</sourceid><recordid>eNotz01Lw0AQgOFFECy1P8CTAc-Js7O72c3BgwY_CgEP1nOYZjclJU3ibiv67922nmYYXgYexm44ZNIoBffkf7rvDJFjBjlKfsFmKARPjUS8YosQtgCAuUalxIw9VI780A2b9ImCs0k5Drbbd-NAfbLc0cbFi3U--QyxiXs_-uTDTeTpGF2zy5b64Bb_c85WL8-r8i2t3l-X5WOVUqF46iC3jXQkBW-k1i0XCIXgBbWoRWPaBmyRawcO0RgHUhdEVudo143Wa4Nizm7Pb0-2evLdjvxvfTTWJ2Ms7s7F5Mevgwv7ejsefESEGrWKcqFBiz8pIlLA</recordid><startdate>20221212</startdate><enddate>20221212</enddate><creator>Jia, Panqi</creator><creator>Koyuncu, Ahmet Burakhan</creator><creator>Gaikov, Georgii</creator><creator>Karabutov, Alexander</creator><creator>Alshina, Elena</creator><creator>Kaup, Andre</creator><general>Cornell University Library, arXiv.org</general><scope>8FE</scope><scope>8FG</scope><scope>ABJCF</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>HCIFZ</scope><scope>L6V</scope><scope>M7S</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>PTHSS</scope><scope>GOX</scope></search><sort><creationdate>20221212</creationdate><title>Learning-Based Conditional Image Coder Using Color Separation</title><author>Jia, Panqi ; Koyuncu, Ahmet Burakhan ; Gaikov, Georgii ; Karabutov, Alexander ; Alshina, Elena ; Kaup, Andre</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a951-e06dc4ea431c477f13209319af273c8fc0d967e0e2288e0479aad762dbc77b823</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>Codec</topic><topic>Color separations</topic><topic>Complexity</topic><topic>Data processing</topic><topic>Image compression</topic><topic>Neural networks</topic><topic>Parallel processing</topic><topic>Principles</topic><toplevel>online_resources</toplevel><creatorcontrib>Jia, Panqi</creatorcontrib><creatorcontrib>Koyuncu, Ahmet Burakhan</creatorcontrib><creatorcontrib>Gaikov, Georgii</creatorcontrib><creatorcontrib>Karabutov, Alexander</creatorcontrib><creatorcontrib>Alshina, Elena</creatorcontrib><creatorcontrib>Kaup, Andre</creatorcontrib><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>Materials Science & Engineering Collection</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Engineering Collection</collection><collection>Engineering Database</collection><collection>Publicly Available Content Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>Engineering Collection</collection><collection>arXiv.org</collection><jtitle>arXiv.org</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Jia, Panqi</au><au>Koyuncu, Ahmet Burakhan</au><au>Gaikov, Georgii</au><au>Karabutov, Alexander</au><au>Alshina, Elena</au><au>Kaup, Andre</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Learning-Based Conditional Image Coder Using Color Separation</atitle><jtitle>arXiv.org</jtitle><date>2022-12-12</date><risdate>2022</risdate><eissn>2331-8422</eissn><abstract>Recently, image compression codecs based on Neural Networks(NN) outperformed the state-of-art classic ones such as BPG, an image format based on HEVC intra. However, the typical NN codec has high complexity, and it has limited options for parallel data processing. In this work, we propose a conditional separation principle that aims to improve parallelization and lower the computational requirements of an NN codec. We present a Conditional Color Separation (CCS) codec which follows this principle. The color components of an image are split into primary and non-primary ones. The processing of each component is done separately, by jointly trained networks. Our approach allows parallel processing of each component, flexibility to select different channel numbers, and an overall complexity reduction. The CCS codec uses over 40% less memory, has 2x faster encoding and 22% faster decoding speed, with only 4% BD-rate loss in RGB PSNR compared to our baseline model over BPG.</abstract><cop>Ithaca</cop><pub>Cornell University Library, arXiv.org</pub><doi>10.48550/arxiv.2212.06241</doi><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | EISSN: 2331-8422 |
ispartof | arXiv.org, 2022-12 |
issn | 2331-8422 |
language | eng |
recordid | cdi_arxiv_primary_2212_06241 |
source | arXiv.org; Free E- Journals |
subjects | Codec Color separations Complexity Data processing Image compression Neural networks Parallel processing Principles |
title | Learning-Based Conditional Image Coder Using Color Separation |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-08T01%3A39%3A00IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_arxiv&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Learning-Based%20Conditional%20Image%20Coder%20Using%20Color%20Separation&rft.jtitle=arXiv.org&rft.au=Jia,%20Panqi&rft.date=2022-12-12&rft.eissn=2331-8422&rft_id=info:doi/10.48550/arxiv.2212.06241&rft_dat=%3Cproquest_arxiv%3E2754223707%3C/proquest_arxiv%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2754223707&rft_id=info:pmid/&rfr_iscdi=true |