Specific Instance and Cross-Prompt-Based Robust 3-D Semi-Supervised Medical Image Segmentation

In clinical applications, accurate segmentation of lesions or organs is crucial to the subsequent disease diagnosis. Due to the expensive and labor-intensive nature of annotations, semi-supervised learning (SSL) becomes a practical solution to the shortage of labeled images. Among the various SSL mo...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on instrumentation and measurement 2024, Vol.73, p.1-14
Hauptverfasser: Zhou, Quan, Feng, Yewei, Huang, Zhiwen, Ding, Mingyue, Zhang, Xuming
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 14
container_issue
container_start_page 1
container_title IEEE transactions on instrumentation and measurement
container_volume 73
creator Zhou, Quan
Feng, Yewei
Huang, Zhiwen
Ding, Mingyue
Zhang, Xuming
description In clinical applications, accurate segmentation of lesions or organs is crucial to the subsequent disease diagnosis. Due to the expensive and labor-intensive nature of annotations, semi-supervised learning (SSL) becomes a practical solution to the shortage of labeled images. Among the various SSL models, mean teacher (MT) has demonstrated encouraging performance in the segmentation of 3-D medical images. Nevertheless, the unlabeled data is treated equally and its discrepancy is generally ignored in the model, which significantly affects the segmentation performance. Besides, the scarcity of 3-D medical samples and lack of guidance in the image segmentation further aggravate the degradation of performance. In order to tackle the above issues, a specific instance and cross-prompt-based model is presented for 3-D medical image segmentation. Specifically, we design an instance-specific adaptive module including different image filters to adaptively enhance each instance upon the propensity score. In such a way, the model gradually absorbs the external instructive knowledge from each specific instance according to the gap between the student and teacher models, which will improve the model's ability for generalization. Moreover, the inevitable conflicts between the prediction of the teacher model and ground truth (GT) will limit the effectiveness of the student model, the cross-prompt strategy combined with a guided filter network is introduced to enhance the segmentation performance by refining the segmentation map for preserving the image edge and details while alleviating the coupling between student and teacher. Three public datasets and one in-house dataset are adopted to validate the superiority and robustness of our algorithm. The proposed approach can not only achieve remarkable segmentation results but also outperforms other mainstream SSL segmentation algorithms in both qualitative and quantitative evaluations. The code will be accessed at http://github.com/Fyw1988/MUL_SICP .
doi_str_mv 10.1109/TIM.2024.3436124
format Article
fullrecord <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_ieee_primary_10621707</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>10621707</ieee_id><sourcerecordid>3096078295</sourcerecordid><originalsourceid>FETCH-LOGICAL-c175t-6e4bc0c2d40a1495f94ae27fc19f0f1a06a2fcfe8c6bc21887bd788ac3ef04a43</originalsourceid><addsrcrecordid>eNpNkD1PwzAQhi0EEqWwMzBEYnY5O44dj1C-KrUC0bISOc65ctV8ECdI_HsStQPTDe_z3ukeQq4ZzBgDfbdZrGYcuJjFIpaMixMyYUmiqJaSn5IJAEupFok8Jxch7ABASaEm5GvdoPXO22hRhc5UFiNTFdG8rUOg721dNh19MAGL6KPO-9BFMX2M1lh6uu4bbH_8GK2w8Nbso0Vptjik2xKrznS-ri7JmTP7gFfHOSWfz0-b-Stdvr0s5vdLaplKOipR5BYsLwQYJnTitDDIlbNMO3DMgDTcWYeplbnlLE1VXqg0NTZGB8KIeEpuD3ubtv7uMXTZru7bajiZxaAlqJTrZKDgQNnxvRZd1rS-NO1vxiAbLWaDxWy0mB0tDpWbQ8Uj4j9ccqZAxX8slW4i</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>3096078295</pqid></control><display><type>article</type><title>Specific Instance and Cross-Prompt-Based Robust 3-D Semi-Supervised Medical Image Segmentation</title><source>IEEE Electronic Library (IEL)</source><creator>Zhou, Quan ; Feng, Yewei ; Huang, Zhiwen ; Ding, Mingyue ; Zhang, Xuming</creator><creatorcontrib>Zhou, Quan ; Feng, Yewei ; Huang, Zhiwen ; Ding, Mingyue ; Zhang, Xuming</creatorcontrib><description>In clinical applications, accurate segmentation of lesions or organs is crucial to the subsequent disease diagnosis. Due to the expensive and labor-intensive nature of annotations, semi-supervised learning (SSL) becomes a practical solution to the shortage of labeled images. Among the various SSL models, mean teacher (MT) has demonstrated encouraging performance in the segmentation of 3-D medical images. Nevertheless, the unlabeled data is treated equally and its discrepancy is generally ignored in the model, which significantly affects the segmentation performance. Besides, the scarcity of 3-D medical samples and lack of guidance in the image segmentation further aggravate the degradation of performance. In order to tackle the above issues, a specific instance and cross-prompt-based model is presented for 3-D medical image segmentation. Specifically, we design an instance-specific adaptive module including different image filters to adaptively enhance each instance upon the propensity score. In such a way, the model gradually absorbs the external instructive knowledge from each specific instance according to the gap between the student and teacher models, which will improve the model's ability for generalization. Moreover, the inevitable conflicts between the prediction of the teacher model and ground truth (GT) will limit the effectiveness of the student model, the cross-prompt strategy combined with a guided filter network is introduced to enhance the segmentation performance by refining the segmentation map for preserving the image edge and details while alleviating the coupling between student and teacher. Three public datasets and one in-house dataset are adopted to validate the superiority and robustness of our algorithm. The proposed approach can not only achieve remarkable segmentation results but also outperforms other mainstream SSL segmentation algorithms in both qualitative and quantitative evaluations. The code will be accessed at http://github.com/Fyw1988/MUL_SICP .</description><identifier>ISSN: 0018-9456</identifier><identifier>EISSN: 1557-9662</identifier><identifier>DOI: 10.1109/TIM.2024.3436124</identifier><identifier>CODEN: IEIMAO</identifier><language>eng</language><publisher>New York: IEEE</publisher><subject>3-D medical image segmentation ; Adaptation models ; Adaptive filters ; Algorithms ; cross-prompt ; Data models ; Datasets ; Image degradation ; Image enhancement ; Image filters ; Image segmentation ; instance-specific adaptive module ; Machine learning ; Medical diagnostic imaging ; Medical imaging ; Performance degradation ; Performance evaluation ; Predictive models ; Semi-supervised learning ; semi-supervised learning (SSL) ; Teachers ; Three-dimensional displays ; Training</subject><ispartof>IEEE transactions on instrumentation and measurement, 2024, Vol.73, p.1-14</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2024</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-c175t-6e4bc0c2d40a1495f94ae27fc19f0f1a06a2fcfe8c6bc21887bd788ac3ef04a43</cites><orcidid>0000-0003-3021-5662 ; 0000-0003-4332-071X ; 0000-0003-3933-1205 ; 0009-0001-3401-5601 ; 0000-0002-7017-8192</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/10621707$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,778,782,794,4012,27910,27911,27912,54745</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/10621707$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Zhou, Quan</creatorcontrib><creatorcontrib>Feng, Yewei</creatorcontrib><creatorcontrib>Huang, Zhiwen</creatorcontrib><creatorcontrib>Ding, Mingyue</creatorcontrib><creatorcontrib>Zhang, Xuming</creatorcontrib><title>Specific Instance and Cross-Prompt-Based Robust 3-D Semi-Supervised Medical Image Segmentation</title><title>IEEE transactions on instrumentation and measurement</title><addtitle>TIM</addtitle><description>In clinical applications, accurate segmentation of lesions or organs is crucial to the subsequent disease diagnosis. Due to the expensive and labor-intensive nature of annotations, semi-supervised learning (SSL) becomes a practical solution to the shortage of labeled images. Among the various SSL models, mean teacher (MT) has demonstrated encouraging performance in the segmentation of 3-D medical images. Nevertheless, the unlabeled data is treated equally and its discrepancy is generally ignored in the model, which significantly affects the segmentation performance. Besides, the scarcity of 3-D medical samples and lack of guidance in the image segmentation further aggravate the degradation of performance. In order to tackle the above issues, a specific instance and cross-prompt-based model is presented for 3-D medical image segmentation. Specifically, we design an instance-specific adaptive module including different image filters to adaptively enhance each instance upon the propensity score. In such a way, the model gradually absorbs the external instructive knowledge from each specific instance according to the gap between the student and teacher models, which will improve the model's ability for generalization. Moreover, the inevitable conflicts between the prediction of the teacher model and ground truth (GT) will limit the effectiveness of the student model, the cross-prompt strategy combined with a guided filter network is introduced to enhance the segmentation performance by refining the segmentation map for preserving the image edge and details while alleviating the coupling between student and teacher. Three public datasets and one in-house dataset are adopted to validate the superiority and robustness of our algorithm. The proposed approach can not only achieve remarkable segmentation results but also outperforms other mainstream SSL segmentation algorithms in both qualitative and quantitative evaluations. The code will be accessed at http://github.com/Fyw1988/MUL_SICP .</description><subject>3-D medical image segmentation</subject><subject>Adaptation models</subject><subject>Adaptive filters</subject><subject>Algorithms</subject><subject>cross-prompt</subject><subject>Data models</subject><subject>Datasets</subject><subject>Image degradation</subject><subject>Image enhancement</subject><subject>Image filters</subject><subject>Image segmentation</subject><subject>instance-specific adaptive module</subject><subject>Machine learning</subject><subject>Medical diagnostic imaging</subject><subject>Medical imaging</subject><subject>Performance degradation</subject><subject>Performance evaluation</subject><subject>Predictive models</subject><subject>Semi-supervised learning</subject><subject>semi-supervised learning (SSL)</subject><subject>Teachers</subject><subject>Three-dimensional displays</subject><subject>Training</subject><issn>0018-9456</issn><issn>1557-9662</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNpNkD1PwzAQhi0EEqWwMzBEYnY5O44dj1C-KrUC0bISOc65ctV8ECdI_HsStQPTDe_z3ukeQq4ZzBgDfbdZrGYcuJjFIpaMixMyYUmiqJaSn5IJAEupFok8Jxch7ABASaEm5GvdoPXO22hRhc5UFiNTFdG8rUOg721dNh19MAGL6KPO-9BFMX2M1lh6uu4bbH_8GK2w8Nbso0Vptjik2xKrznS-ri7JmTP7gFfHOSWfz0-b-Stdvr0s5vdLaplKOipR5BYsLwQYJnTitDDIlbNMO3DMgDTcWYeplbnlLE1VXqg0NTZGB8KIeEpuD3ubtv7uMXTZru7bajiZxaAlqJTrZKDgQNnxvRZd1rS-NO1vxiAbLWaDxWy0mB0tDpWbQ8Uj4j9ccqZAxX8slW4i</recordid><startdate>2024</startdate><enddate>2024</enddate><creator>Zhou, Quan</creator><creator>Feng, Yewei</creator><creator>Huang, Zhiwen</creator><creator>Ding, Mingyue</creator><creator>Zhang, Xuming</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SP</scope><scope>7U5</scope><scope>8FD</scope><scope>L7M</scope><orcidid>https://orcid.org/0000-0003-3021-5662</orcidid><orcidid>https://orcid.org/0000-0003-4332-071X</orcidid><orcidid>https://orcid.org/0000-0003-3933-1205</orcidid><orcidid>https://orcid.org/0009-0001-3401-5601</orcidid><orcidid>https://orcid.org/0000-0002-7017-8192</orcidid></search><sort><creationdate>2024</creationdate><title>Specific Instance and Cross-Prompt-Based Robust 3-D Semi-Supervised Medical Image Segmentation</title><author>Zhou, Quan ; Feng, Yewei ; Huang, Zhiwen ; Ding, Mingyue ; Zhang, Xuming</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c175t-6e4bc0c2d40a1495f94ae27fc19f0f1a06a2fcfe8c6bc21887bd788ac3ef04a43</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>3-D medical image segmentation</topic><topic>Adaptation models</topic><topic>Adaptive filters</topic><topic>Algorithms</topic><topic>cross-prompt</topic><topic>Data models</topic><topic>Datasets</topic><topic>Image degradation</topic><topic>Image enhancement</topic><topic>Image filters</topic><topic>Image segmentation</topic><topic>instance-specific adaptive module</topic><topic>Machine learning</topic><topic>Medical diagnostic imaging</topic><topic>Medical imaging</topic><topic>Performance degradation</topic><topic>Performance evaluation</topic><topic>Predictive models</topic><topic>Semi-supervised learning</topic><topic>semi-supervised learning (SSL)</topic><topic>Teachers</topic><topic>Three-dimensional displays</topic><topic>Training</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Zhou, Quan</creatorcontrib><creatorcontrib>Feng, Yewei</creatorcontrib><creatorcontrib>Huang, Zhiwen</creatorcontrib><creatorcontrib>Ding, Mingyue</creatorcontrib><creatorcontrib>Zhang, Xuming</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Electronics &amp; Communications Abstracts</collection><collection>Solid State and Superconductivity Abstracts</collection><collection>Technology Research Database</collection><collection>Advanced Technologies Database with Aerospace</collection><jtitle>IEEE transactions on instrumentation and measurement</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Zhou, Quan</au><au>Feng, Yewei</au><au>Huang, Zhiwen</au><au>Ding, Mingyue</au><au>Zhang, Xuming</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Specific Instance and Cross-Prompt-Based Robust 3-D Semi-Supervised Medical Image Segmentation</atitle><jtitle>IEEE transactions on instrumentation and measurement</jtitle><stitle>TIM</stitle><date>2024</date><risdate>2024</risdate><volume>73</volume><spage>1</spage><epage>14</epage><pages>1-14</pages><issn>0018-9456</issn><eissn>1557-9662</eissn><coden>IEIMAO</coden><abstract>In clinical applications, accurate segmentation of lesions or organs is crucial to the subsequent disease diagnosis. Due to the expensive and labor-intensive nature of annotations, semi-supervised learning (SSL) becomes a practical solution to the shortage of labeled images. Among the various SSL models, mean teacher (MT) has demonstrated encouraging performance in the segmentation of 3-D medical images. Nevertheless, the unlabeled data is treated equally and its discrepancy is generally ignored in the model, which significantly affects the segmentation performance. Besides, the scarcity of 3-D medical samples and lack of guidance in the image segmentation further aggravate the degradation of performance. In order to tackle the above issues, a specific instance and cross-prompt-based model is presented for 3-D medical image segmentation. Specifically, we design an instance-specific adaptive module including different image filters to adaptively enhance each instance upon the propensity score. In such a way, the model gradually absorbs the external instructive knowledge from each specific instance according to the gap between the student and teacher models, which will improve the model's ability for generalization. Moreover, the inevitable conflicts between the prediction of the teacher model and ground truth (GT) will limit the effectiveness of the student model, the cross-prompt strategy combined with a guided filter network is introduced to enhance the segmentation performance by refining the segmentation map for preserving the image edge and details while alleviating the coupling between student and teacher. Three public datasets and one in-house dataset are adopted to validate the superiority and robustness of our algorithm. The proposed approach can not only achieve remarkable segmentation results but also outperforms other mainstream SSL segmentation algorithms in both qualitative and quantitative evaluations. The code will be accessed at http://github.com/Fyw1988/MUL_SICP .</abstract><cop>New York</cop><pub>IEEE</pub><doi>10.1109/TIM.2024.3436124</doi><tpages>14</tpages><orcidid>https://orcid.org/0000-0003-3021-5662</orcidid><orcidid>https://orcid.org/0000-0003-4332-071X</orcidid><orcidid>https://orcid.org/0000-0003-3933-1205</orcidid><orcidid>https://orcid.org/0009-0001-3401-5601</orcidid><orcidid>https://orcid.org/0000-0002-7017-8192</orcidid></addata></record>
fulltext fulltext_linktorsrc
identifier ISSN: 0018-9456
ispartof IEEE transactions on instrumentation and measurement, 2024, Vol.73, p.1-14
issn 0018-9456
1557-9662
language eng
recordid cdi_ieee_primary_10621707
source IEEE Electronic Library (IEL)
subjects 3-D medical image segmentation
Adaptation models
Adaptive filters
Algorithms
cross-prompt
Data models
Datasets
Image degradation
Image enhancement
Image filters
Image segmentation
instance-specific adaptive module
Machine learning
Medical diagnostic imaging
Medical imaging
Performance degradation
Performance evaluation
Predictive models
Semi-supervised learning
semi-supervised learning (SSL)
Teachers
Three-dimensional displays
Training
title Specific Instance and Cross-Prompt-Based Robust 3-D Semi-Supervised Medical Image Segmentation
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-15T15%3A19%3A16IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Specific%20Instance%20and%20Cross-Prompt-Based%20Robust%203-D%20Semi-Supervised%20Medical%20Image%20Segmentation&rft.jtitle=IEEE%20transactions%20on%20instrumentation%20and%20measurement&rft.au=Zhou,%20Quan&rft.date=2024&rft.volume=73&rft.spage=1&rft.epage=14&rft.pages=1-14&rft.issn=0018-9456&rft.eissn=1557-9662&rft.coden=IEIMAO&rft_id=info:doi/10.1109/TIM.2024.3436124&rft_dat=%3Cproquest_RIE%3E3096078295%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=3096078295&rft_id=info:pmid/&rft_ieee_id=10621707&rfr_iscdi=true