Specific Instance and Cross-Prompt-Based Robust 3-D Semi-Supervised Medical Image Segmentation
In clinical applications, accurate segmentation of lesions or organs is crucial to the subsequent disease diagnosis. Due to the expensive and labor-intensive nature of annotations, semi-supervised learning (SSL) becomes a practical solution to the shortage of labeled images. Among the various SSL mo...
Gespeichert in:
Veröffentlicht in: | IEEE transactions on instrumentation and measurement 2024, Vol.73, p.1-14 |
---|---|
Hauptverfasser: | , , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 14 |
---|---|
container_issue | |
container_start_page | 1 |
container_title | IEEE transactions on instrumentation and measurement |
container_volume | 73 |
creator | Zhou, Quan Feng, Yewei Huang, Zhiwen Ding, Mingyue Zhang, Xuming |
description | In clinical applications, accurate segmentation of lesions or organs is crucial to the subsequent disease diagnosis. Due to the expensive and labor-intensive nature of annotations, semi-supervised learning (SSL) becomes a practical solution to the shortage of labeled images. Among the various SSL models, mean teacher (MT) has demonstrated encouraging performance in the segmentation of 3-D medical images. Nevertheless, the unlabeled data is treated equally and its discrepancy is generally ignored in the model, which significantly affects the segmentation performance. Besides, the scarcity of 3-D medical samples and lack of guidance in the image segmentation further aggravate the degradation of performance. In order to tackle the above issues, a specific instance and cross-prompt-based model is presented for 3-D medical image segmentation. Specifically, we design an instance-specific adaptive module including different image filters to adaptively enhance each instance upon the propensity score. In such a way, the model gradually absorbs the external instructive knowledge from each specific instance according to the gap between the student and teacher models, which will improve the model's ability for generalization. Moreover, the inevitable conflicts between the prediction of the teacher model and ground truth (GT) will limit the effectiveness of the student model, the cross-prompt strategy combined with a guided filter network is introduced to enhance the segmentation performance by refining the segmentation map for preserving the image edge and details while alleviating the coupling between student and teacher. Three public datasets and one in-house dataset are adopted to validate the superiority and robustness of our algorithm. The proposed approach can not only achieve remarkable segmentation results but also outperforms other mainstream SSL segmentation algorithms in both qualitative and quantitative evaluations. The code will be accessed at http://github.com/Fyw1988/MUL_SICP . |
doi_str_mv | 10.1109/TIM.2024.3436124 |
format | Article |
fullrecord | <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_ieee_primary_10621707</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>10621707</ieee_id><sourcerecordid>3096078295</sourcerecordid><originalsourceid>FETCH-LOGICAL-c175t-6e4bc0c2d40a1495f94ae27fc19f0f1a06a2fcfe8c6bc21887bd788ac3ef04a43</originalsourceid><addsrcrecordid>eNpNkD1PwzAQhi0EEqWwMzBEYnY5O44dj1C-KrUC0bISOc65ctV8ECdI_HsStQPTDe_z3ukeQq4ZzBgDfbdZrGYcuJjFIpaMixMyYUmiqJaSn5IJAEupFok8Jxch7ABASaEm5GvdoPXO22hRhc5UFiNTFdG8rUOg721dNh19MAGL6KPO-9BFMX2M1lh6uu4bbH_8GK2w8Nbso0Vptjik2xKrznS-ri7JmTP7gFfHOSWfz0-b-Stdvr0s5vdLaplKOipR5BYsLwQYJnTitDDIlbNMO3DMgDTcWYeplbnlLE1VXqg0NTZGB8KIeEpuD3ubtv7uMXTZru7bajiZxaAlqJTrZKDgQNnxvRZd1rS-NO1vxiAbLWaDxWy0mB0tDpWbQ8Uj4j9ccqZAxX8slW4i</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>3096078295</pqid></control><display><type>article</type><title>Specific Instance and Cross-Prompt-Based Robust 3-D Semi-Supervised Medical Image Segmentation</title><source>IEEE Electronic Library (IEL)</source><creator>Zhou, Quan ; Feng, Yewei ; Huang, Zhiwen ; Ding, Mingyue ; Zhang, Xuming</creator><creatorcontrib>Zhou, Quan ; Feng, Yewei ; Huang, Zhiwen ; Ding, Mingyue ; Zhang, Xuming</creatorcontrib><description>In clinical applications, accurate segmentation of lesions or organs is crucial to the subsequent disease diagnosis. Due to the expensive and labor-intensive nature of annotations, semi-supervised learning (SSL) becomes a practical solution to the shortage of labeled images. Among the various SSL models, mean teacher (MT) has demonstrated encouraging performance in the segmentation of 3-D medical images. Nevertheless, the unlabeled data is treated equally and its discrepancy is generally ignored in the model, which significantly affects the segmentation performance. Besides, the scarcity of 3-D medical samples and lack of guidance in the image segmentation further aggravate the degradation of performance. In order to tackle the above issues, a specific instance and cross-prompt-based model is presented for 3-D medical image segmentation. Specifically, we design an instance-specific adaptive module including different image filters to adaptively enhance each instance upon the propensity score. In such a way, the model gradually absorbs the external instructive knowledge from each specific instance according to the gap between the student and teacher models, which will improve the model's ability for generalization. Moreover, the inevitable conflicts between the prediction of the teacher model and ground truth (GT) will limit the effectiveness of the student model, the cross-prompt strategy combined with a guided filter network is introduced to enhance the segmentation performance by refining the segmentation map for preserving the image edge and details while alleviating the coupling between student and teacher. Three public datasets and one in-house dataset are adopted to validate the superiority and robustness of our algorithm. The proposed approach can not only achieve remarkable segmentation results but also outperforms other mainstream SSL segmentation algorithms in both qualitative and quantitative evaluations. The code will be accessed at http://github.com/Fyw1988/MUL_SICP .</description><identifier>ISSN: 0018-9456</identifier><identifier>EISSN: 1557-9662</identifier><identifier>DOI: 10.1109/TIM.2024.3436124</identifier><identifier>CODEN: IEIMAO</identifier><language>eng</language><publisher>New York: IEEE</publisher><subject>3-D medical image segmentation ; Adaptation models ; Adaptive filters ; Algorithms ; cross-prompt ; Data models ; Datasets ; Image degradation ; Image enhancement ; Image filters ; Image segmentation ; instance-specific adaptive module ; Machine learning ; Medical diagnostic imaging ; Medical imaging ; Performance degradation ; Performance evaluation ; Predictive models ; Semi-supervised learning ; semi-supervised learning (SSL) ; Teachers ; Three-dimensional displays ; Training</subject><ispartof>IEEE transactions on instrumentation and measurement, 2024, Vol.73, p.1-14</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2024</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-c175t-6e4bc0c2d40a1495f94ae27fc19f0f1a06a2fcfe8c6bc21887bd788ac3ef04a43</cites><orcidid>0000-0003-3021-5662 ; 0000-0003-4332-071X ; 0000-0003-3933-1205 ; 0009-0001-3401-5601 ; 0000-0002-7017-8192</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/10621707$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,778,782,794,4012,27910,27911,27912,54745</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/10621707$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Zhou, Quan</creatorcontrib><creatorcontrib>Feng, Yewei</creatorcontrib><creatorcontrib>Huang, Zhiwen</creatorcontrib><creatorcontrib>Ding, Mingyue</creatorcontrib><creatorcontrib>Zhang, Xuming</creatorcontrib><title>Specific Instance and Cross-Prompt-Based Robust 3-D Semi-Supervised Medical Image Segmentation</title><title>IEEE transactions on instrumentation and measurement</title><addtitle>TIM</addtitle><description>In clinical applications, accurate segmentation of lesions or organs is crucial to the subsequent disease diagnosis. Due to the expensive and labor-intensive nature of annotations, semi-supervised learning (SSL) becomes a practical solution to the shortage of labeled images. Among the various SSL models, mean teacher (MT) has demonstrated encouraging performance in the segmentation of 3-D medical images. Nevertheless, the unlabeled data is treated equally and its discrepancy is generally ignored in the model, which significantly affects the segmentation performance. Besides, the scarcity of 3-D medical samples and lack of guidance in the image segmentation further aggravate the degradation of performance. In order to tackle the above issues, a specific instance and cross-prompt-based model is presented for 3-D medical image segmentation. Specifically, we design an instance-specific adaptive module including different image filters to adaptively enhance each instance upon the propensity score. In such a way, the model gradually absorbs the external instructive knowledge from each specific instance according to the gap between the student and teacher models, which will improve the model's ability for generalization. Moreover, the inevitable conflicts between the prediction of the teacher model and ground truth (GT) will limit the effectiveness of the student model, the cross-prompt strategy combined with a guided filter network is introduced to enhance the segmentation performance by refining the segmentation map for preserving the image edge and details while alleviating the coupling between student and teacher. Three public datasets and one in-house dataset are adopted to validate the superiority and robustness of our algorithm. The proposed approach can not only achieve remarkable segmentation results but also outperforms other mainstream SSL segmentation algorithms in both qualitative and quantitative evaluations. The code will be accessed at http://github.com/Fyw1988/MUL_SICP .</description><subject>3-D medical image segmentation</subject><subject>Adaptation models</subject><subject>Adaptive filters</subject><subject>Algorithms</subject><subject>cross-prompt</subject><subject>Data models</subject><subject>Datasets</subject><subject>Image degradation</subject><subject>Image enhancement</subject><subject>Image filters</subject><subject>Image segmentation</subject><subject>instance-specific adaptive module</subject><subject>Machine learning</subject><subject>Medical diagnostic imaging</subject><subject>Medical imaging</subject><subject>Performance degradation</subject><subject>Performance evaluation</subject><subject>Predictive models</subject><subject>Semi-supervised learning</subject><subject>semi-supervised learning (SSL)</subject><subject>Teachers</subject><subject>Three-dimensional displays</subject><subject>Training</subject><issn>0018-9456</issn><issn>1557-9662</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNpNkD1PwzAQhi0EEqWwMzBEYnY5O44dj1C-KrUC0bISOc65ctV8ECdI_HsStQPTDe_z3ukeQq4ZzBgDfbdZrGYcuJjFIpaMixMyYUmiqJaSn5IJAEupFok8Jxch7ABASaEm5GvdoPXO22hRhc5UFiNTFdG8rUOg721dNh19MAGL6KPO-9BFMX2M1lh6uu4bbH_8GK2w8Nbso0Vptjik2xKrznS-ri7JmTP7gFfHOSWfz0-b-Stdvr0s5vdLaplKOipR5BYsLwQYJnTitDDIlbNMO3DMgDTcWYeplbnlLE1VXqg0NTZGB8KIeEpuD3ubtv7uMXTZru7bajiZxaAlqJTrZKDgQNnxvRZd1rS-NO1vxiAbLWaDxWy0mB0tDpWbQ8Uj4j9ccqZAxX8slW4i</recordid><startdate>2024</startdate><enddate>2024</enddate><creator>Zhou, Quan</creator><creator>Feng, Yewei</creator><creator>Huang, Zhiwen</creator><creator>Ding, Mingyue</creator><creator>Zhang, Xuming</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SP</scope><scope>7U5</scope><scope>8FD</scope><scope>L7M</scope><orcidid>https://orcid.org/0000-0003-3021-5662</orcidid><orcidid>https://orcid.org/0000-0003-4332-071X</orcidid><orcidid>https://orcid.org/0000-0003-3933-1205</orcidid><orcidid>https://orcid.org/0009-0001-3401-5601</orcidid><orcidid>https://orcid.org/0000-0002-7017-8192</orcidid></search><sort><creationdate>2024</creationdate><title>Specific Instance and Cross-Prompt-Based Robust 3-D Semi-Supervised Medical Image Segmentation</title><author>Zhou, Quan ; Feng, Yewei ; Huang, Zhiwen ; Ding, Mingyue ; Zhang, Xuming</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c175t-6e4bc0c2d40a1495f94ae27fc19f0f1a06a2fcfe8c6bc21887bd788ac3ef04a43</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>3-D medical image segmentation</topic><topic>Adaptation models</topic><topic>Adaptive filters</topic><topic>Algorithms</topic><topic>cross-prompt</topic><topic>Data models</topic><topic>Datasets</topic><topic>Image degradation</topic><topic>Image enhancement</topic><topic>Image filters</topic><topic>Image segmentation</topic><topic>instance-specific adaptive module</topic><topic>Machine learning</topic><topic>Medical diagnostic imaging</topic><topic>Medical imaging</topic><topic>Performance degradation</topic><topic>Performance evaluation</topic><topic>Predictive models</topic><topic>Semi-supervised learning</topic><topic>semi-supervised learning (SSL)</topic><topic>Teachers</topic><topic>Three-dimensional displays</topic><topic>Training</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Zhou, Quan</creatorcontrib><creatorcontrib>Feng, Yewei</creatorcontrib><creatorcontrib>Huang, Zhiwen</creatorcontrib><creatorcontrib>Ding, Mingyue</creatorcontrib><creatorcontrib>Zhang, Xuming</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Electronics & Communications Abstracts</collection><collection>Solid State and Superconductivity Abstracts</collection><collection>Technology Research Database</collection><collection>Advanced Technologies Database with Aerospace</collection><jtitle>IEEE transactions on instrumentation and measurement</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Zhou, Quan</au><au>Feng, Yewei</au><au>Huang, Zhiwen</au><au>Ding, Mingyue</au><au>Zhang, Xuming</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Specific Instance and Cross-Prompt-Based Robust 3-D Semi-Supervised Medical Image Segmentation</atitle><jtitle>IEEE transactions on instrumentation and measurement</jtitle><stitle>TIM</stitle><date>2024</date><risdate>2024</risdate><volume>73</volume><spage>1</spage><epage>14</epage><pages>1-14</pages><issn>0018-9456</issn><eissn>1557-9662</eissn><coden>IEIMAO</coden><abstract>In clinical applications, accurate segmentation of lesions or organs is crucial to the subsequent disease diagnosis. Due to the expensive and labor-intensive nature of annotations, semi-supervised learning (SSL) becomes a practical solution to the shortage of labeled images. Among the various SSL models, mean teacher (MT) has demonstrated encouraging performance in the segmentation of 3-D medical images. Nevertheless, the unlabeled data is treated equally and its discrepancy is generally ignored in the model, which significantly affects the segmentation performance. Besides, the scarcity of 3-D medical samples and lack of guidance in the image segmentation further aggravate the degradation of performance. In order to tackle the above issues, a specific instance and cross-prompt-based model is presented for 3-D medical image segmentation. Specifically, we design an instance-specific adaptive module including different image filters to adaptively enhance each instance upon the propensity score. In such a way, the model gradually absorbs the external instructive knowledge from each specific instance according to the gap between the student and teacher models, which will improve the model's ability for generalization. Moreover, the inevitable conflicts between the prediction of the teacher model and ground truth (GT) will limit the effectiveness of the student model, the cross-prompt strategy combined with a guided filter network is introduced to enhance the segmentation performance by refining the segmentation map for preserving the image edge and details while alleviating the coupling between student and teacher. Three public datasets and one in-house dataset are adopted to validate the superiority and robustness of our algorithm. The proposed approach can not only achieve remarkable segmentation results but also outperforms other mainstream SSL segmentation algorithms in both qualitative and quantitative evaluations. The code will be accessed at http://github.com/Fyw1988/MUL_SICP .</abstract><cop>New York</cop><pub>IEEE</pub><doi>10.1109/TIM.2024.3436124</doi><tpages>14</tpages><orcidid>https://orcid.org/0000-0003-3021-5662</orcidid><orcidid>https://orcid.org/0000-0003-4332-071X</orcidid><orcidid>https://orcid.org/0000-0003-3933-1205</orcidid><orcidid>https://orcid.org/0009-0001-3401-5601</orcidid><orcidid>https://orcid.org/0000-0002-7017-8192</orcidid></addata></record> |
fulltext | fulltext_linktorsrc |
identifier | ISSN: 0018-9456 |
ispartof | IEEE transactions on instrumentation and measurement, 2024, Vol.73, p.1-14 |
issn | 0018-9456 1557-9662 |
language | eng |
recordid | cdi_ieee_primary_10621707 |
source | IEEE Electronic Library (IEL) |
subjects | 3-D medical image segmentation Adaptation models Adaptive filters Algorithms cross-prompt Data models Datasets Image degradation Image enhancement Image filters Image segmentation instance-specific adaptive module Machine learning Medical diagnostic imaging Medical imaging Performance degradation Performance evaluation Predictive models Semi-supervised learning semi-supervised learning (SSL) Teachers Three-dimensional displays Training |
title | Specific Instance and Cross-Prompt-Based Robust 3-D Semi-Supervised Medical Image Segmentation |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-15T15%3A19%3A16IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Specific%20Instance%20and%20Cross-Prompt-Based%20Robust%203-D%20Semi-Supervised%20Medical%20Image%20Segmentation&rft.jtitle=IEEE%20transactions%20on%20instrumentation%20and%20measurement&rft.au=Zhou,%20Quan&rft.date=2024&rft.volume=73&rft.spage=1&rft.epage=14&rft.pages=1-14&rft.issn=0018-9456&rft.eissn=1557-9662&rft.coden=IEIMAO&rft_id=info:doi/10.1109/TIM.2024.3436124&rft_dat=%3Cproquest_RIE%3E3096078295%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=3096078295&rft_id=info:pmid/&rft_ieee_id=10621707&rfr_iscdi=true |