Dual Structure-Aware Image Filterings for Semi-supervised Medical Image Segmentation

Semi-supervised image segmentation has attracted great attention recently. The key is how to leverage unlabeled images in the training process. Most methods maintain consistent predictions of the unlabeled images under variations (e.g., adding noise/perturbations, or creating alternative versions) i...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Gu, Yuliang, Sun, Zhichao, Chen, Tian, Xiao, Xin, Liu, Yepeng, Xu, Yongchao, Najman, Laurent
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator Gu, Yuliang
Sun, Zhichao
Chen, Tian
Xiao, Xin
Liu, Yepeng
Xu, Yongchao
Najman, Laurent
description Semi-supervised image segmentation has attracted great attention recently. The key is how to leverage unlabeled images in the training process. Most methods maintain consistent predictions of the unlabeled images under variations (e.g., adding noise/perturbations, or creating alternative versions) in the image and/or model level. In most image-level variation, medical images often have prior structure information, which has not been well explored. In this paper, we propose novel dual structure-aware image filterings (DSAIF) as the image-level variations for semi-supervised medical image segmentation. Motivated by connected filtering that simplifies image via filtering in structure-aware tree-based image representation, we resort to the dual contrast invariant Max-tree and Min-tree representation. Specifically, we propose a novel connected filtering that removes topologically equivalent nodes (i.e. connected components) having no siblings in the Max/Min-tree. This results in two filtered images preserving topologically critical structure. Applying the proposed DSAIF to mutually supervised networks decreases the consensus of their erroneous predictions on unlabeled images. This helps to alleviate the confirmation bias issue of overfitting to noisy pseudo labels of unlabeled images, and thus effectively improves the segmentation performance. Extensive experimental results on three benchmark datasets demonstrate that the proposed method significantly/consistently outperforms some state-of-the-art methods. The source codes will be publicly available.
doi_str_mv 10.48550/arxiv.2312.07264
format Article
fullrecord <record><control><sourceid>arxiv_GOX</sourceid><recordid>TN_cdi_arxiv_primary_2312_07264</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2312_07264</sourcerecordid><originalsourceid>FETCH-arxiv_primary_2312_072643</originalsourceid><addsrcrecordid>eNqFjrsOgkAQRbexMOoHWLE_APJUW6MSLaygJxMYyCQskNld1L9X0d7qNufmHCHWge_F-yTxN8APGr0wCkLP34XbeC7yk4VWZoZtaSyje7gDo7wqaFCm1Bpk6hot655lhopcbQfkkTRW8oYVle_zF86wUdgZMNR3SzGrodW4-u1COOk5P17cyV8MTAr4WXw6iqkj-k-8AAVuPhM</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Dual Structure-Aware Image Filterings for Semi-supervised Medical Image Segmentation</title><source>arXiv.org</source><creator>Gu, Yuliang ; Sun, Zhichao ; Chen, Tian ; Xiao, Xin ; Liu, Yepeng ; Xu, Yongchao ; Najman, Laurent</creator><creatorcontrib>Gu, Yuliang ; Sun, Zhichao ; Chen, Tian ; Xiao, Xin ; Liu, Yepeng ; Xu, Yongchao ; Najman, Laurent</creatorcontrib><description>Semi-supervised image segmentation has attracted great attention recently. The key is how to leverage unlabeled images in the training process. Most methods maintain consistent predictions of the unlabeled images under variations (e.g., adding noise/perturbations, or creating alternative versions) in the image and/or model level. In most image-level variation, medical images often have prior structure information, which has not been well explored. In this paper, we propose novel dual structure-aware image filterings (DSAIF) as the image-level variations for semi-supervised medical image segmentation. Motivated by connected filtering that simplifies image via filtering in structure-aware tree-based image representation, we resort to the dual contrast invariant Max-tree and Min-tree representation. Specifically, we propose a novel connected filtering that removes topologically equivalent nodes (i.e. connected components) having no siblings in the Max/Min-tree. This results in two filtered images preserving topologically critical structure. Applying the proposed DSAIF to mutually supervised networks decreases the consensus of their erroneous predictions on unlabeled images. This helps to alleviate the confirmation bias issue of overfitting to noisy pseudo labels of unlabeled images, and thus effectively improves the segmentation performance. Extensive experimental results on three benchmark datasets demonstrate that the proposed method significantly/consistently outperforms some state-of-the-art methods. The source codes will be publicly available.</description><identifier>DOI: 10.48550/arxiv.2312.07264</identifier><language>eng</language><subject>Computer Science - Computer Vision and Pattern Recognition</subject><creationdate>2023-12</creationdate><rights>http://arxiv.org/licenses/nonexclusive-distrib/1.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,781,886</link.rule.ids><linktorsrc>$$Uhttps://arxiv.org/abs/2312.07264$$EView_record_in_Cornell_University$$FView_record_in_$$GCornell_University$$Hfree_for_read</linktorsrc><backlink>$$Uhttps://doi.org/10.48550/arXiv.2312.07264$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Gu, Yuliang</creatorcontrib><creatorcontrib>Sun, Zhichao</creatorcontrib><creatorcontrib>Chen, Tian</creatorcontrib><creatorcontrib>Xiao, Xin</creatorcontrib><creatorcontrib>Liu, Yepeng</creatorcontrib><creatorcontrib>Xu, Yongchao</creatorcontrib><creatorcontrib>Najman, Laurent</creatorcontrib><title>Dual Structure-Aware Image Filterings for Semi-supervised Medical Image Segmentation</title><description>Semi-supervised image segmentation has attracted great attention recently. The key is how to leverage unlabeled images in the training process. Most methods maintain consistent predictions of the unlabeled images under variations (e.g., adding noise/perturbations, or creating alternative versions) in the image and/or model level. In most image-level variation, medical images often have prior structure information, which has not been well explored. In this paper, we propose novel dual structure-aware image filterings (DSAIF) as the image-level variations for semi-supervised medical image segmentation. Motivated by connected filtering that simplifies image via filtering in structure-aware tree-based image representation, we resort to the dual contrast invariant Max-tree and Min-tree representation. Specifically, we propose a novel connected filtering that removes topologically equivalent nodes (i.e. connected components) having no siblings in the Max/Min-tree. This results in two filtered images preserving topologically critical structure. Applying the proposed DSAIF to mutually supervised networks decreases the consensus of their erroneous predictions on unlabeled images. This helps to alleviate the confirmation bias issue of overfitting to noisy pseudo labels of unlabeled images, and thus effectively improves the segmentation performance. Extensive experimental results on three benchmark datasets demonstrate that the proposed method significantly/consistently outperforms some state-of-the-art methods. The source codes will be publicly available.</description><subject>Computer Science - Computer Vision and Pattern Recognition</subject><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><sourceid>GOX</sourceid><recordid>eNqFjrsOgkAQRbexMOoHWLE_APJUW6MSLaygJxMYyCQskNld1L9X0d7qNufmHCHWge_F-yTxN8APGr0wCkLP34XbeC7yk4VWZoZtaSyje7gDo7wqaFCm1Bpk6hot655lhopcbQfkkTRW8oYVle_zF86wUdgZMNR3SzGrodW4-u1COOk5P17cyV8MTAr4WXw6iqkj-k-8AAVuPhM</recordid><startdate>20231212</startdate><enddate>20231212</enddate><creator>Gu, Yuliang</creator><creator>Sun, Zhichao</creator><creator>Chen, Tian</creator><creator>Xiao, Xin</creator><creator>Liu, Yepeng</creator><creator>Xu, Yongchao</creator><creator>Najman, Laurent</creator><scope>AKY</scope><scope>GOX</scope></search><sort><creationdate>20231212</creationdate><title>Dual Structure-Aware Image Filterings for Semi-supervised Medical Image Segmentation</title><author>Gu, Yuliang ; Sun, Zhichao ; Chen, Tian ; Xiao, Xin ; Liu, Yepeng ; Xu, Yongchao ; Najman, Laurent</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-arxiv_primary_2312_072643</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Computer Science - Computer Vision and Pattern Recognition</topic><toplevel>online_resources</toplevel><creatorcontrib>Gu, Yuliang</creatorcontrib><creatorcontrib>Sun, Zhichao</creatorcontrib><creatorcontrib>Chen, Tian</creatorcontrib><creatorcontrib>Xiao, Xin</creatorcontrib><creatorcontrib>Liu, Yepeng</creatorcontrib><creatorcontrib>Xu, Yongchao</creatorcontrib><creatorcontrib>Najman, Laurent</creatorcontrib><collection>arXiv Computer Science</collection><collection>arXiv.org</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Gu, Yuliang</au><au>Sun, Zhichao</au><au>Chen, Tian</au><au>Xiao, Xin</au><au>Liu, Yepeng</au><au>Xu, Yongchao</au><au>Najman, Laurent</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Dual Structure-Aware Image Filterings for Semi-supervised Medical Image Segmentation</atitle><date>2023-12-12</date><risdate>2023</risdate><abstract>Semi-supervised image segmentation has attracted great attention recently. The key is how to leverage unlabeled images in the training process. Most methods maintain consistent predictions of the unlabeled images under variations (e.g., adding noise/perturbations, or creating alternative versions) in the image and/or model level. In most image-level variation, medical images often have prior structure information, which has not been well explored. In this paper, we propose novel dual structure-aware image filterings (DSAIF) as the image-level variations for semi-supervised medical image segmentation. Motivated by connected filtering that simplifies image via filtering in structure-aware tree-based image representation, we resort to the dual contrast invariant Max-tree and Min-tree representation. Specifically, we propose a novel connected filtering that removes topologically equivalent nodes (i.e. connected components) having no siblings in the Max/Min-tree. This results in two filtered images preserving topologically critical structure. Applying the proposed DSAIF to mutually supervised networks decreases the consensus of their erroneous predictions on unlabeled images. This helps to alleviate the confirmation bias issue of overfitting to noisy pseudo labels of unlabeled images, and thus effectively improves the segmentation performance. Extensive experimental results on three benchmark datasets demonstrate that the proposed method significantly/consistently outperforms some state-of-the-art methods. The source codes will be publicly available.</abstract><doi>10.48550/arxiv.2312.07264</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier DOI: 10.48550/arxiv.2312.07264
ispartof
issn
language eng
recordid cdi_arxiv_primary_2312_07264
source arXiv.org
subjects Computer Science - Computer Vision and Pattern Recognition
title Dual Structure-Aware Image Filterings for Semi-supervised Medical Image Segmentation
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-14T22%3A23%3A36IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-arxiv_GOX&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Dual%20Structure-Aware%20Image%20Filterings%20for%20Semi-supervised%20Medical%20Image%20Segmentation&rft.au=Gu,%20Yuliang&rft.date=2023-12-12&rft_id=info:doi/10.48550/arxiv.2312.07264&rft_dat=%3Carxiv_GOX%3E2312_07264%3C/arxiv_GOX%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true