Focusing intermediate pixels loss for salient object segmentation

To improve the network performance of salient object segmentation, many researchers modified the loss functions and set weights to pixel losses. However, these loss functions paid less attention to intermediate pixels of which the predicted probabilities lie in the intermediate region between correc...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Multimedia tools and applications 2024-02, Vol.83 (7), p.19747-19766
Hauptverfasser: Chen, Lei, Cao, Tieyong, Zheng, Yunfei, Fang, Zheng, Wang, Yang, Fu, Bingyang, Wang, Yekui, Han, Tong
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 19766
container_issue 7
container_start_page 19747
container_title Multimedia tools and applications
container_volume 83
creator Chen, Lei
Cao, Tieyong
Zheng, Yunfei
Fang, Zheng
Wang, Yang
Fu, Bingyang
Wang, Yekui
Han, Tong
description To improve the network performance of salient object segmentation, many researchers modified the loss functions and set weights to pixel losses. However, these loss functions paid less attention to intermediate pixels of which the predicted probabilities lie in the intermediate region between correct and incorrect classification. To solve this problem, focusing intermediate pixels loss is proposed. Firstly, foreground and background are divided into correct and incorrect classified sets respectively to discover intermediate pixels which are difficult to determine the category. Secondly, the intermediate pixels are paid more attention according to the predicted probability. Finally, misclassified pixels are strengthened dynamically with the order of training epochs. The proposed method can 1) make the model focus on intermediate pixels that have more uncertainty; 2) solve the vanishing gradient problem of Focal Loss for well-classified pixels. Experiment results on six public datasets and two different type of network structures show that the proposed method performs better than other state-of-the-art weighted loss functions and the average F β is increased by about 2.7% compared with typical cross entropy.
doi_str_mv 10.1007/s11042-023-15873-1
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2927017354</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2927017354</sourcerecordid><originalsourceid>FETCH-LOGICAL-c270t-8bc5902ddea01136fbc384c8b4a23fb6081d05b7bfc6395dd0a40469cec46c303</originalsourceid><addsrcrecordid>eNp9UE1LxDAQDaLguvoHPAU8VydfTXtcFleFBS96DkmaLlm6zZqkoP_eaAU9eZl5A-9jeAhdE7glAPIuEQKcVkBZRUQjyzxBCyIKkJKS0z_4HF2ktAcgtaB8gVabYKfkxx32Y3bx4Dqvs8NH_-6GhIeQEu5DxEkP3o0ZB7N3NuPkdody6uzDeInOej0kd_Wzl-h1c_-yfqy2zw9P69W2slRCrhpjRQu065wGQljdG8sabhvDNWW9qaEhHQgjTW9r1oquA82B1611lteWAVuim9n3GMPb5FJW-zDFsUQq2pYIIpnghUVnlo3l9-h6dYz-oOOHIqC-qlJzVapUpb6rUqSI2CxKhTzuXPy1_kf1CT0IbDo</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2927017354</pqid></control><display><type>article</type><title>Focusing intermediate pixels loss for salient object segmentation</title><source>SpringerLink Journals</source><creator>Chen, Lei ; Cao, Tieyong ; Zheng, Yunfei ; Fang, Zheng ; Wang, Yang ; Fu, Bingyang ; Wang, Yekui ; Han, Tong</creator><creatorcontrib>Chen, Lei ; Cao, Tieyong ; Zheng, Yunfei ; Fang, Zheng ; Wang, Yang ; Fu, Bingyang ; Wang, Yekui ; Han, Tong</creatorcontrib><description>To improve the network performance of salient object segmentation, many researchers modified the loss functions and set weights to pixel losses. However, these loss functions paid less attention to intermediate pixels of which the predicted probabilities lie in the intermediate region between correct and incorrect classification. To solve this problem, focusing intermediate pixels loss is proposed. Firstly, foreground and background are divided into correct and incorrect classified sets respectively to discover intermediate pixels which are difficult to determine the category. Secondly, the intermediate pixels are paid more attention according to the predicted probability. Finally, misclassified pixels are strengthened dynamically with the order of training epochs. The proposed method can 1) make the model focus on intermediate pixels that have more uncertainty; 2) solve the vanishing gradient problem of Focal Loss for well-classified pixels. Experiment results on six public datasets and two different type of network structures show that the proposed method performs better than other state-of-the-art weighted loss functions and the average F β is increased by about 2.7% compared with typical cross entropy.</description><identifier>ISSN: 1573-7721</identifier><identifier>ISSN: 1380-7501</identifier><identifier>EISSN: 1573-7721</identifier><identifier>DOI: 10.1007/s11042-023-15873-1</identifier><language>eng</language><publisher>New York: Springer US</publisher><subject>Classification ; Computer Communication Networks ; Computer Science ; Data Structures and Information Theory ; Datasets ; Deep learning ; Entropy ; Entropy (Information theory) ; Multimedia ; Multimedia Information Systems ; Neural networks ; Pixels ; Probability ; Salience ; Segmentation ; Special Purpose and Application-Based Systems ; Teaching methods</subject><ispartof>Multimedia tools and applications, 2024-02, Vol.83 (7), p.19747-19766</ispartof><rights>The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature 2023. Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-c270t-8bc5902ddea01136fbc384c8b4a23fb6081d05b7bfc6395dd0a40469cec46c303</cites><orcidid>0000-0002-7843-8737</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://link.springer.com/content/pdf/10.1007/s11042-023-15873-1$$EPDF$$P50$$Gspringer$$H</linktopdf><linktohtml>$$Uhttps://link.springer.com/10.1007/s11042-023-15873-1$$EHTML$$P50$$Gspringer$$H</linktohtml><link.rule.ids>314,776,780,27901,27902,41464,42533,51294</link.rule.ids></links><search><creatorcontrib>Chen, Lei</creatorcontrib><creatorcontrib>Cao, Tieyong</creatorcontrib><creatorcontrib>Zheng, Yunfei</creatorcontrib><creatorcontrib>Fang, Zheng</creatorcontrib><creatorcontrib>Wang, Yang</creatorcontrib><creatorcontrib>Fu, Bingyang</creatorcontrib><creatorcontrib>Wang, Yekui</creatorcontrib><creatorcontrib>Han, Tong</creatorcontrib><title>Focusing intermediate pixels loss for salient object segmentation</title><title>Multimedia tools and applications</title><addtitle>Multimed Tools Appl</addtitle><description>To improve the network performance of salient object segmentation, many researchers modified the loss functions and set weights to pixel losses. However, these loss functions paid less attention to intermediate pixels of which the predicted probabilities lie in the intermediate region between correct and incorrect classification. To solve this problem, focusing intermediate pixels loss is proposed. Firstly, foreground and background are divided into correct and incorrect classified sets respectively to discover intermediate pixels which are difficult to determine the category. Secondly, the intermediate pixels are paid more attention according to the predicted probability. Finally, misclassified pixels are strengthened dynamically with the order of training epochs. The proposed method can 1) make the model focus on intermediate pixels that have more uncertainty; 2) solve the vanishing gradient problem of Focal Loss for well-classified pixels. Experiment results on six public datasets and two different type of network structures show that the proposed method performs better than other state-of-the-art weighted loss functions and the average F β is increased by about 2.7% compared with typical cross entropy.</description><subject>Classification</subject><subject>Computer Communication Networks</subject><subject>Computer Science</subject><subject>Data Structures and Information Theory</subject><subject>Datasets</subject><subject>Deep learning</subject><subject>Entropy</subject><subject>Entropy (Information theory)</subject><subject>Multimedia</subject><subject>Multimedia Information Systems</subject><subject>Neural networks</subject><subject>Pixels</subject><subject>Probability</subject><subject>Salience</subject><subject>Segmentation</subject><subject>Special Purpose and Application-Based Systems</subject><subject>Teaching methods</subject><issn>1573-7721</issn><issn>1380-7501</issn><issn>1573-7721</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><recordid>eNp9UE1LxDAQDaLguvoHPAU8VydfTXtcFleFBS96DkmaLlm6zZqkoP_eaAU9eZl5A-9jeAhdE7glAPIuEQKcVkBZRUQjyzxBCyIKkJKS0z_4HF2ktAcgtaB8gVabYKfkxx32Y3bx4Dqvs8NH_-6GhIeQEu5DxEkP3o0ZB7N3NuPkdody6uzDeInOej0kd_Wzl-h1c_-yfqy2zw9P69W2slRCrhpjRQu065wGQljdG8sabhvDNWW9qaEhHQgjTW9r1oquA82B1611lteWAVuim9n3GMPb5FJW-zDFsUQq2pYIIpnghUVnlo3l9-h6dYz-oOOHIqC-qlJzVapUpb6rUqSI2CxKhTzuXPy1_kf1CT0IbDo</recordid><startdate>20240201</startdate><enddate>20240201</enddate><creator>Chen, Lei</creator><creator>Cao, Tieyong</creator><creator>Zheng, Yunfei</creator><creator>Fang, Zheng</creator><creator>Wang, Yang</creator><creator>Fu, Bingyang</creator><creator>Wang, Yekui</creator><creator>Han, Tong</creator><general>Springer US</general><general>Springer Nature B.V</general><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><orcidid>https://orcid.org/0000-0002-7843-8737</orcidid></search><sort><creationdate>20240201</creationdate><title>Focusing intermediate pixels loss for salient object segmentation</title><author>Chen, Lei ; Cao, Tieyong ; Zheng, Yunfei ; Fang, Zheng ; Wang, Yang ; Fu, Bingyang ; Wang, Yekui ; Han, Tong</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c270t-8bc5902ddea01136fbc384c8b4a23fb6081d05b7bfc6395dd0a40469cec46c303</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Classification</topic><topic>Computer Communication Networks</topic><topic>Computer Science</topic><topic>Data Structures and Information Theory</topic><topic>Datasets</topic><topic>Deep learning</topic><topic>Entropy</topic><topic>Entropy (Information theory)</topic><topic>Multimedia</topic><topic>Multimedia Information Systems</topic><topic>Neural networks</topic><topic>Pixels</topic><topic>Probability</topic><topic>Salience</topic><topic>Segmentation</topic><topic>Special Purpose and Application-Based Systems</topic><topic>Teaching methods</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Chen, Lei</creatorcontrib><creatorcontrib>Cao, Tieyong</creatorcontrib><creatorcontrib>Zheng, Yunfei</creatorcontrib><creatorcontrib>Fang, Zheng</creatorcontrib><creatorcontrib>Wang, Yang</creatorcontrib><creatorcontrib>Fu, Bingyang</creatorcontrib><creatorcontrib>Wang, Yekui</creatorcontrib><creatorcontrib>Han, Tong</creatorcontrib><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>Multimedia tools and applications</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Chen, Lei</au><au>Cao, Tieyong</au><au>Zheng, Yunfei</au><au>Fang, Zheng</au><au>Wang, Yang</au><au>Fu, Bingyang</au><au>Wang, Yekui</au><au>Han, Tong</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Focusing intermediate pixels loss for salient object segmentation</atitle><jtitle>Multimedia tools and applications</jtitle><stitle>Multimed Tools Appl</stitle><date>2024-02-01</date><risdate>2024</risdate><volume>83</volume><issue>7</issue><spage>19747</spage><epage>19766</epage><pages>19747-19766</pages><issn>1573-7721</issn><issn>1380-7501</issn><eissn>1573-7721</eissn><abstract>To improve the network performance of salient object segmentation, many researchers modified the loss functions and set weights to pixel losses. However, these loss functions paid less attention to intermediate pixels of which the predicted probabilities lie in the intermediate region between correct and incorrect classification. To solve this problem, focusing intermediate pixels loss is proposed. Firstly, foreground and background are divided into correct and incorrect classified sets respectively to discover intermediate pixels which are difficult to determine the category. Secondly, the intermediate pixels are paid more attention according to the predicted probability. Finally, misclassified pixels are strengthened dynamically with the order of training epochs. The proposed method can 1) make the model focus on intermediate pixels that have more uncertainty; 2) solve the vanishing gradient problem of Focal Loss for well-classified pixels. Experiment results on six public datasets and two different type of network structures show that the proposed method performs better than other state-of-the-art weighted loss functions and the average F β is increased by about 2.7% compared with typical cross entropy.</abstract><cop>New York</cop><pub>Springer US</pub><doi>10.1007/s11042-023-15873-1</doi><tpages>20</tpages><orcidid>https://orcid.org/0000-0002-7843-8737</orcidid></addata></record>
fulltext fulltext
identifier ISSN: 1573-7721
ispartof Multimedia tools and applications, 2024-02, Vol.83 (7), p.19747-19766
issn 1573-7721
1380-7501
1573-7721
language eng
recordid cdi_proquest_journals_2927017354
source SpringerLink Journals
subjects Classification
Computer Communication Networks
Computer Science
Data Structures and Information Theory
Datasets
Deep learning
Entropy
Entropy (Information theory)
Multimedia
Multimedia Information Systems
Neural networks
Pixels
Probability
Salience
Segmentation
Special Purpose and Application-Based Systems
Teaching methods
title Focusing intermediate pixels loss for salient object segmentation
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-03T23%3A39%3A19IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Focusing%20intermediate%20pixels%20loss%20for%20salient%20object%20segmentation&rft.jtitle=Multimedia%20tools%20and%20applications&rft.au=Chen,%20Lei&rft.date=2024-02-01&rft.volume=83&rft.issue=7&rft.spage=19747&rft.epage=19766&rft.pages=19747-19766&rft.issn=1573-7721&rft.eissn=1573-7721&rft_id=info:doi/10.1007/s11042-023-15873-1&rft_dat=%3Cproquest_cross%3E2927017354%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2927017354&rft_id=info:pmid/&rfr_iscdi=true