Focusing intermediate pixels loss for salient object segmentation
To improve the network performance of salient object segmentation, many researchers modified the loss functions and set weights to pixel losses. However, these loss functions paid less attention to intermediate pixels of which the predicted probabilities lie in the intermediate region between correc...
Gespeichert in:
Veröffentlicht in: | Multimedia tools and applications 2024-02, Vol.83 (7), p.19747-19766 |
---|---|
Hauptverfasser: | , , , , , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 19766 |
---|---|
container_issue | 7 |
container_start_page | 19747 |
container_title | Multimedia tools and applications |
container_volume | 83 |
creator | Chen, Lei Cao, Tieyong Zheng, Yunfei Fang, Zheng Wang, Yang Fu, Bingyang Wang, Yekui Han, Tong |
description | To improve the network performance of salient object segmentation, many researchers modified the loss functions and set weights to pixel losses. However, these loss functions paid less attention to intermediate pixels of which the predicted probabilities lie in the intermediate region between correct and incorrect classification. To solve this problem, focusing intermediate pixels loss is proposed. Firstly, foreground and background are divided into correct and incorrect classified sets respectively to discover intermediate pixels which are difficult to determine the category. Secondly, the intermediate pixels are paid more attention according to the predicted probability. Finally, misclassified pixels are strengthened dynamically with the order of training epochs. The proposed method can 1) make the model focus on intermediate pixels that have more uncertainty; 2) solve the vanishing gradient problem of Focal Loss for well-classified pixels. Experiment results on six public datasets and two different type of network structures show that the proposed method performs better than other state-of-the-art weighted loss functions and the average
F
β
is increased by about 2.7% compared with typical cross entropy. |
doi_str_mv | 10.1007/s11042-023-15873-1 |
format | Article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2927017354</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2927017354</sourcerecordid><originalsourceid>FETCH-LOGICAL-c270t-8bc5902ddea01136fbc384c8b4a23fb6081d05b7bfc6395dd0a40469cec46c303</originalsourceid><addsrcrecordid>eNp9UE1LxDAQDaLguvoHPAU8VydfTXtcFleFBS96DkmaLlm6zZqkoP_eaAU9eZl5A-9jeAhdE7glAPIuEQKcVkBZRUQjyzxBCyIKkJKS0z_4HF2ktAcgtaB8gVabYKfkxx32Y3bx4Dqvs8NH_-6GhIeQEu5DxEkP3o0ZB7N3NuPkdody6uzDeInOej0kd_Wzl-h1c_-yfqy2zw9P69W2slRCrhpjRQu065wGQljdG8sabhvDNWW9qaEhHQgjTW9r1oquA82B1611lteWAVuim9n3GMPb5FJW-zDFsUQq2pYIIpnghUVnlo3l9-h6dYz-oOOHIqC-qlJzVapUpb6rUqSI2CxKhTzuXPy1_kf1CT0IbDo</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2927017354</pqid></control><display><type>article</type><title>Focusing intermediate pixels loss for salient object segmentation</title><source>SpringerLink Journals</source><creator>Chen, Lei ; Cao, Tieyong ; Zheng, Yunfei ; Fang, Zheng ; Wang, Yang ; Fu, Bingyang ; Wang, Yekui ; Han, Tong</creator><creatorcontrib>Chen, Lei ; Cao, Tieyong ; Zheng, Yunfei ; Fang, Zheng ; Wang, Yang ; Fu, Bingyang ; Wang, Yekui ; Han, Tong</creatorcontrib><description>To improve the network performance of salient object segmentation, many researchers modified the loss functions and set weights to pixel losses. However, these loss functions paid less attention to intermediate pixels of which the predicted probabilities lie in the intermediate region between correct and incorrect classification. To solve this problem, focusing intermediate pixels loss is proposed. Firstly, foreground and background are divided into correct and incorrect classified sets respectively to discover intermediate pixels which are difficult to determine the category. Secondly, the intermediate pixels are paid more attention according to the predicted probability. Finally, misclassified pixels are strengthened dynamically with the order of training epochs. The proposed method can 1) make the model focus on intermediate pixels that have more uncertainty; 2) solve the vanishing gradient problem of Focal Loss for well-classified pixels. Experiment results on six public datasets and two different type of network structures show that the proposed method performs better than other state-of-the-art weighted loss functions and the average
F
β
is increased by about 2.7% compared with typical cross entropy.</description><identifier>ISSN: 1573-7721</identifier><identifier>ISSN: 1380-7501</identifier><identifier>EISSN: 1573-7721</identifier><identifier>DOI: 10.1007/s11042-023-15873-1</identifier><language>eng</language><publisher>New York: Springer US</publisher><subject>Classification ; Computer Communication Networks ; Computer Science ; Data Structures and Information Theory ; Datasets ; Deep learning ; Entropy ; Entropy (Information theory) ; Multimedia ; Multimedia Information Systems ; Neural networks ; Pixels ; Probability ; Salience ; Segmentation ; Special Purpose and Application-Based Systems ; Teaching methods</subject><ispartof>Multimedia tools and applications, 2024-02, Vol.83 (7), p.19747-19766</ispartof><rights>The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature 2023. Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-c270t-8bc5902ddea01136fbc384c8b4a23fb6081d05b7bfc6395dd0a40469cec46c303</cites><orcidid>0000-0002-7843-8737</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://link.springer.com/content/pdf/10.1007/s11042-023-15873-1$$EPDF$$P50$$Gspringer$$H</linktopdf><linktohtml>$$Uhttps://link.springer.com/10.1007/s11042-023-15873-1$$EHTML$$P50$$Gspringer$$H</linktohtml><link.rule.ids>314,776,780,27901,27902,41464,42533,51294</link.rule.ids></links><search><creatorcontrib>Chen, Lei</creatorcontrib><creatorcontrib>Cao, Tieyong</creatorcontrib><creatorcontrib>Zheng, Yunfei</creatorcontrib><creatorcontrib>Fang, Zheng</creatorcontrib><creatorcontrib>Wang, Yang</creatorcontrib><creatorcontrib>Fu, Bingyang</creatorcontrib><creatorcontrib>Wang, Yekui</creatorcontrib><creatorcontrib>Han, Tong</creatorcontrib><title>Focusing intermediate pixels loss for salient object segmentation</title><title>Multimedia tools and applications</title><addtitle>Multimed Tools Appl</addtitle><description>To improve the network performance of salient object segmentation, many researchers modified the loss functions and set weights to pixel losses. However, these loss functions paid less attention to intermediate pixels of which the predicted probabilities lie in the intermediate region between correct and incorrect classification. To solve this problem, focusing intermediate pixels loss is proposed. Firstly, foreground and background are divided into correct and incorrect classified sets respectively to discover intermediate pixels which are difficult to determine the category. Secondly, the intermediate pixels are paid more attention according to the predicted probability. Finally, misclassified pixels are strengthened dynamically with the order of training epochs. The proposed method can 1) make the model focus on intermediate pixels that have more uncertainty; 2) solve the vanishing gradient problem of Focal Loss for well-classified pixels. Experiment results on six public datasets and two different type of network structures show that the proposed method performs better than other state-of-the-art weighted loss functions and the average
F
β
is increased by about 2.7% compared with typical cross entropy.</description><subject>Classification</subject><subject>Computer Communication Networks</subject><subject>Computer Science</subject><subject>Data Structures and Information Theory</subject><subject>Datasets</subject><subject>Deep learning</subject><subject>Entropy</subject><subject>Entropy (Information theory)</subject><subject>Multimedia</subject><subject>Multimedia Information Systems</subject><subject>Neural networks</subject><subject>Pixels</subject><subject>Probability</subject><subject>Salience</subject><subject>Segmentation</subject><subject>Special Purpose and Application-Based Systems</subject><subject>Teaching methods</subject><issn>1573-7721</issn><issn>1380-7501</issn><issn>1573-7721</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><recordid>eNp9UE1LxDAQDaLguvoHPAU8VydfTXtcFleFBS96DkmaLlm6zZqkoP_eaAU9eZl5A-9jeAhdE7glAPIuEQKcVkBZRUQjyzxBCyIKkJKS0z_4HF2ktAcgtaB8gVabYKfkxx32Y3bx4Dqvs8NH_-6GhIeQEu5DxEkP3o0ZB7N3NuPkdody6uzDeInOej0kd_Wzl-h1c_-yfqy2zw9P69W2slRCrhpjRQu065wGQljdG8sabhvDNWW9qaEhHQgjTW9r1oquA82B1611lteWAVuim9n3GMPb5FJW-zDFsUQq2pYIIpnghUVnlo3l9-h6dYz-oOOHIqC-qlJzVapUpb6rUqSI2CxKhTzuXPy1_kf1CT0IbDo</recordid><startdate>20240201</startdate><enddate>20240201</enddate><creator>Chen, Lei</creator><creator>Cao, Tieyong</creator><creator>Zheng, Yunfei</creator><creator>Fang, Zheng</creator><creator>Wang, Yang</creator><creator>Fu, Bingyang</creator><creator>Wang, Yekui</creator><creator>Han, Tong</creator><general>Springer US</general><general>Springer Nature B.V</general><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><orcidid>https://orcid.org/0000-0002-7843-8737</orcidid></search><sort><creationdate>20240201</creationdate><title>Focusing intermediate pixels loss for salient object segmentation</title><author>Chen, Lei ; Cao, Tieyong ; Zheng, Yunfei ; Fang, Zheng ; Wang, Yang ; Fu, Bingyang ; Wang, Yekui ; Han, Tong</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c270t-8bc5902ddea01136fbc384c8b4a23fb6081d05b7bfc6395dd0a40469cec46c303</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Classification</topic><topic>Computer Communication Networks</topic><topic>Computer Science</topic><topic>Data Structures and Information Theory</topic><topic>Datasets</topic><topic>Deep learning</topic><topic>Entropy</topic><topic>Entropy (Information theory)</topic><topic>Multimedia</topic><topic>Multimedia Information Systems</topic><topic>Neural networks</topic><topic>Pixels</topic><topic>Probability</topic><topic>Salience</topic><topic>Segmentation</topic><topic>Special Purpose and Application-Based Systems</topic><topic>Teaching methods</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Chen, Lei</creatorcontrib><creatorcontrib>Cao, Tieyong</creatorcontrib><creatorcontrib>Zheng, Yunfei</creatorcontrib><creatorcontrib>Fang, Zheng</creatorcontrib><creatorcontrib>Wang, Yang</creatorcontrib><creatorcontrib>Fu, Bingyang</creatorcontrib><creatorcontrib>Wang, Yekui</creatorcontrib><creatorcontrib>Han, Tong</creatorcontrib><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>Multimedia tools and applications</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Chen, Lei</au><au>Cao, Tieyong</au><au>Zheng, Yunfei</au><au>Fang, Zheng</au><au>Wang, Yang</au><au>Fu, Bingyang</au><au>Wang, Yekui</au><au>Han, Tong</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Focusing intermediate pixels loss for salient object segmentation</atitle><jtitle>Multimedia tools and applications</jtitle><stitle>Multimed Tools Appl</stitle><date>2024-02-01</date><risdate>2024</risdate><volume>83</volume><issue>7</issue><spage>19747</spage><epage>19766</epage><pages>19747-19766</pages><issn>1573-7721</issn><issn>1380-7501</issn><eissn>1573-7721</eissn><abstract>To improve the network performance of salient object segmentation, many researchers modified the loss functions and set weights to pixel losses. However, these loss functions paid less attention to intermediate pixels of which the predicted probabilities lie in the intermediate region between correct and incorrect classification. To solve this problem, focusing intermediate pixels loss is proposed. Firstly, foreground and background are divided into correct and incorrect classified sets respectively to discover intermediate pixels which are difficult to determine the category. Secondly, the intermediate pixels are paid more attention according to the predicted probability. Finally, misclassified pixels are strengthened dynamically with the order of training epochs. The proposed method can 1) make the model focus on intermediate pixels that have more uncertainty; 2) solve the vanishing gradient problem of Focal Loss for well-classified pixels. Experiment results on six public datasets and two different type of network structures show that the proposed method performs better than other state-of-the-art weighted loss functions and the average
F
β
is increased by about 2.7% compared with typical cross entropy.</abstract><cop>New York</cop><pub>Springer US</pub><doi>10.1007/s11042-023-15873-1</doi><tpages>20</tpages><orcidid>https://orcid.org/0000-0002-7843-8737</orcidid></addata></record> |
fulltext | fulltext |
identifier | ISSN: 1573-7721 |
ispartof | Multimedia tools and applications, 2024-02, Vol.83 (7), p.19747-19766 |
issn | 1573-7721 1380-7501 1573-7721 |
language | eng |
recordid | cdi_proquest_journals_2927017354 |
source | SpringerLink Journals |
subjects | Classification Computer Communication Networks Computer Science Data Structures and Information Theory Datasets Deep learning Entropy Entropy (Information theory) Multimedia Multimedia Information Systems Neural networks Pixels Probability Salience Segmentation Special Purpose and Application-Based Systems Teaching methods |
title | Focusing intermediate pixels loss for salient object segmentation |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-03T23%3A39%3A19IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Focusing%20intermediate%20pixels%20loss%20for%20salient%20object%20segmentation&rft.jtitle=Multimedia%20tools%20and%20applications&rft.au=Chen,%20Lei&rft.date=2024-02-01&rft.volume=83&rft.issue=7&rft.spage=19747&rft.epage=19766&rft.pages=19747-19766&rft.issn=1573-7721&rft.eissn=1573-7721&rft_id=info:doi/10.1007/s11042-023-15873-1&rft_dat=%3Cproquest_cross%3E2927017354%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2927017354&rft_id=info:pmid/&rfr_iscdi=true |