Robust Prototypical Few-Shot Organ Segmentation with Regularized Neural-ODEs

Despite the tremendous progress made by deep learning models in image semantic segmentation, they typically require large annotated examples, and increasing attention is being diverted to problem settings like Few-Shot Learning (FSL) where only a small amount of annotation is needed for generalisati...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on medical imaging 2023-09, Vol.PP (9), p.1-1
Hauptverfasser: Pandey, Prashant, Chasmai, Mustafa, Sur, Tanuj, Lall, Brejesh
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 1
container_issue 9
container_start_page 1
container_title IEEE transactions on medical imaging
container_volume PP
creator Pandey, Prashant
Chasmai, Mustafa
Sur, Tanuj
Lall, Brejesh
description Despite the tremendous progress made by deep learning models in image semantic segmentation, they typically require large annotated examples, and increasing attention is being diverted to problem settings like Few-Shot Learning (FSL) where only a small amount of annotation is needed for generalisation to novel classes. This is especially seen in medical domains where dense pixel-level annotations are expensive to obtain. In this paper, we propose Regularized Prototypical Neural Ordinary Differential Equation (R-PNODE), a method that leverages intrinsic properties of Neural-ODEs, assisted and enhanced by additional cluster and consistency losses to perform Few-Shot Segmentation (FSS) of organs. R-PNODE constrains support and query features from the same classes to lie closer in the representation space thereby improving the performance over the existing Convolutional Neural Network (CNN) based FSS methods. We further demonstrate that while many existing Deep CNN-based methods tend to be extremely vulnerable to adversarial attacks, R-PNODE exhibits increased adversarial robustness for a wide array of these attacks. We experiment with three publicly available multi-organ segmentation datasets in both in-domain and cross-domain FSS settings to demonstrate the efficacy of our method. In addition, we perform experiments with seven commonly used adversarial attacks in various settings to demonstrate R-PNODE's robustness. R-PNODE outperforms the baselines for FSS by significant margins and also shows superior performance for a wide array of attacks varying in intensity and design.
doi_str_mv 10.1109/TMI.2023.3258069
format Article
fullrecord <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_pubmed_primary_37030728</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>10073652</ieee_id><sourcerecordid>2798714192</sourcerecordid><originalsourceid>FETCH-LOGICAL-c348t-eb86452af3225f119553dba096e4cb36ba5b6f1d6727872137828002b1933f1f3</originalsourceid><addsrcrecordid>eNpdkEtrFEEUhQtRzBizdyHS4MZNT27d6notJSYxMGYkD3BXVPfcnnTo6ZpUVROSX2-HGUVcnc13DoePsQ8c5pyDPb75cTFHQDEXKA0o-4rNuJSmRFn9es1mgNqUAAoP2LuU7gF4JcG-ZQdCgwCNZsYWV6EeUy5-xpBDftp2je-LM3osr-9CLpZx7YfimtYbGrLPXRiKxy7fFVe0Hnsfu2daFZc0Rt-Xy2-n6T170_o-0dE-D9nt2enNyfdysTy_OPm6KBtRmVxSbVQl0bcCUbacWynFqvZgFVVNLVTtZa1avlJ6-q-RC23QAGDNrRAtb8Uh-7Lb3cbwMFLKbtOlhvreDxTG5FBbo3nFLU7o5__Q-zDGYXrn0EiruaqUnSjYUU0MKUVq3TZ2Gx-fHAf3YtpNpt2Labc3PVU-7YfHekOrv4U_aifg4w7oiOifPdBCSRS_ARZDf_c</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2859716469</pqid></control><display><type>article</type><title>Robust Prototypical Few-Shot Organ Segmentation with Regularized Neural-ODEs</title><source>IEEE Electronic Library (IEL)</source><creator>Pandey, Prashant ; Chasmai, Mustafa ; Sur, Tanuj ; Lall, Brejesh</creator><creatorcontrib>Pandey, Prashant ; Chasmai, Mustafa ; Sur, Tanuj ; Lall, Brejesh</creatorcontrib><description>Despite the tremendous progress made by deep learning models in image semantic segmentation, they typically require large annotated examples, and increasing attention is being diverted to problem settings like Few-Shot Learning (FSL) where only a small amount of annotation is needed for generalisation to novel classes. This is especially seen in medical domains where dense pixel-level annotations are expensive to obtain. In this paper, we propose Regularized Prototypical Neural Ordinary Differential Equation (R-PNODE), a method that leverages intrinsic properties of Neural-ODEs, assisted and enhanced by additional cluster and consistency losses to perform Few-Shot Segmentation (FSS) of organs. R-PNODE constrains support and query features from the same classes to lie closer in the representation space thereby improving the performance over the existing Convolutional Neural Network (CNN) based FSS methods. We further demonstrate that while many existing Deep CNN-based methods tend to be extremely vulnerable to adversarial attacks, R-PNODE exhibits increased adversarial robustness for a wide array of these attacks. We experiment with three publicly available multi-organ segmentation datasets in both in-domain and cross-domain FSS settings to demonstrate the efficacy of our method. In addition, we perform experiments with seven commonly used adversarial attacks in various settings to demonstrate R-PNODE's robustness. R-PNODE outperforms the baselines for FSS by significant margins and also shows superior performance for a wide array of attacks varying in intensity and design.</description><identifier>ISSN: 0278-0062</identifier><identifier>EISSN: 1558-254X</identifier><identifier>DOI: 10.1109/TMI.2023.3258069</identifier><identifier>PMID: 37030728</identifier><identifier>CODEN: ITMID4</identifier><language>eng</language><publisher>United States: IEEE</publisher><subject>Adversarial Robustness ; Annotations ; Arrays ; Artificial neural networks ; Deep learning ; Differential equations ; Feature extraction ; Few-shot Segmentation ; Image annotation ; Image processing ; Image segmentation ; Machine learning ; Medical diagnosis ; Medical diagnostic imaging ; Medical Image Segmentation ; Neural networks ; Neural-ODEs ; Ordinary differential equations ; Perturbation methods ; Robustness ; Semantic segmentation ; Training</subject><ispartof>IEEE transactions on medical imaging, 2023-09, Vol.PP (9), p.1-1</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2023</rights><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c348t-eb86452af3225f119553dba096e4cb36ba5b6f1d6727872137828002b1933f1f3</citedby><cites>FETCH-LOGICAL-c348t-eb86452af3225f119553dba096e4cb36ba5b6f1d6727872137828002b1933f1f3</cites><orcidid>0000-0002-6594-9685 ; 0000-0003-2677-3071 ; 0000-0001-5298-5241 ; 0000-0001-8694-3453</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/10073652$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,780,784,796,27924,27925,54758</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/10073652$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/37030728$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Pandey, Prashant</creatorcontrib><creatorcontrib>Chasmai, Mustafa</creatorcontrib><creatorcontrib>Sur, Tanuj</creatorcontrib><creatorcontrib>Lall, Brejesh</creatorcontrib><title>Robust Prototypical Few-Shot Organ Segmentation with Regularized Neural-ODEs</title><title>IEEE transactions on medical imaging</title><addtitle>TMI</addtitle><addtitle>IEEE Trans Med Imaging</addtitle><description>Despite the tremendous progress made by deep learning models in image semantic segmentation, they typically require large annotated examples, and increasing attention is being diverted to problem settings like Few-Shot Learning (FSL) where only a small amount of annotation is needed for generalisation to novel classes. This is especially seen in medical domains where dense pixel-level annotations are expensive to obtain. In this paper, we propose Regularized Prototypical Neural Ordinary Differential Equation (R-PNODE), a method that leverages intrinsic properties of Neural-ODEs, assisted and enhanced by additional cluster and consistency losses to perform Few-Shot Segmentation (FSS) of organs. R-PNODE constrains support and query features from the same classes to lie closer in the representation space thereby improving the performance over the existing Convolutional Neural Network (CNN) based FSS methods. We further demonstrate that while many existing Deep CNN-based methods tend to be extremely vulnerable to adversarial attacks, R-PNODE exhibits increased adversarial robustness for a wide array of these attacks. We experiment with three publicly available multi-organ segmentation datasets in both in-domain and cross-domain FSS settings to demonstrate the efficacy of our method. In addition, we perform experiments with seven commonly used adversarial attacks in various settings to demonstrate R-PNODE's robustness. R-PNODE outperforms the baselines for FSS by significant margins and also shows superior performance for a wide array of attacks varying in intensity and design.</description><subject>Adversarial Robustness</subject><subject>Annotations</subject><subject>Arrays</subject><subject>Artificial neural networks</subject><subject>Deep learning</subject><subject>Differential equations</subject><subject>Feature extraction</subject><subject>Few-shot Segmentation</subject><subject>Image annotation</subject><subject>Image processing</subject><subject>Image segmentation</subject><subject>Machine learning</subject><subject>Medical diagnosis</subject><subject>Medical diagnostic imaging</subject><subject>Medical Image Segmentation</subject><subject>Neural networks</subject><subject>Neural-ODEs</subject><subject>Ordinary differential equations</subject><subject>Perturbation methods</subject><subject>Robustness</subject><subject>Semantic segmentation</subject><subject>Training</subject><issn>0278-0062</issn><issn>1558-254X</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNpdkEtrFEEUhQtRzBizdyHS4MZNT27d6notJSYxMGYkD3BXVPfcnnTo6ZpUVROSX2-HGUVcnc13DoePsQ8c5pyDPb75cTFHQDEXKA0o-4rNuJSmRFn9es1mgNqUAAoP2LuU7gF4JcG-ZQdCgwCNZsYWV6EeUy5-xpBDftp2je-LM3osr-9CLpZx7YfimtYbGrLPXRiKxy7fFVe0Hnsfu2daFZc0Rt-Xy2-n6T170_o-0dE-D9nt2enNyfdysTy_OPm6KBtRmVxSbVQl0bcCUbacWynFqvZgFVVNLVTtZa1avlJ6-q-RC23QAGDNrRAtb8Uh-7Lb3cbwMFLKbtOlhvreDxTG5FBbo3nFLU7o5__Q-zDGYXrn0EiruaqUnSjYUU0MKUVq3TZ2Gx-fHAf3YtpNpt2Labc3PVU-7YfHekOrv4U_aifg4w7oiOifPdBCSRS_ARZDf_c</recordid><startdate>20230901</startdate><enddate>20230901</enddate><creator>Pandey, Prashant</creator><creator>Chasmai, Mustafa</creator><creator>Sur, Tanuj</creator><creator>Lall, Brejesh</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7QF</scope><scope>7QO</scope><scope>7QQ</scope><scope>7SC</scope><scope>7SE</scope><scope>7SP</scope><scope>7SR</scope><scope>7TA</scope><scope>7TB</scope><scope>7U5</scope><scope>8BQ</scope><scope>8FD</scope><scope>F28</scope><scope>FR3</scope><scope>H8D</scope><scope>JG9</scope><scope>JQ2</scope><scope>KR7</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>NAPCQ</scope><scope>P64</scope><scope>7X8</scope><orcidid>https://orcid.org/0000-0002-6594-9685</orcidid><orcidid>https://orcid.org/0000-0003-2677-3071</orcidid><orcidid>https://orcid.org/0000-0001-5298-5241</orcidid><orcidid>https://orcid.org/0000-0001-8694-3453</orcidid></search><sort><creationdate>20230901</creationdate><title>Robust Prototypical Few-Shot Organ Segmentation with Regularized Neural-ODEs</title><author>Pandey, Prashant ; Chasmai, Mustafa ; Sur, Tanuj ; Lall, Brejesh</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c348t-eb86452af3225f119553dba096e4cb36ba5b6f1d6727872137828002b1933f1f3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Adversarial Robustness</topic><topic>Annotations</topic><topic>Arrays</topic><topic>Artificial neural networks</topic><topic>Deep learning</topic><topic>Differential equations</topic><topic>Feature extraction</topic><topic>Few-shot Segmentation</topic><topic>Image annotation</topic><topic>Image processing</topic><topic>Image segmentation</topic><topic>Machine learning</topic><topic>Medical diagnosis</topic><topic>Medical diagnostic imaging</topic><topic>Medical Image Segmentation</topic><topic>Neural networks</topic><topic>Neural-ODEs</topic><topic>Ordinary differential equations</topic><topic>Perturbation methods</topic><topic>Robustness</topic><topic>Semantic segmentation</topic><topic>Training</topic><toplevel>online_resources</toplevel><creatorcontrib>Pandey, Prashant</creatorcontrib><creatorcontrib>Chasmai, Mustafa</creatorcontrib><creatorcontrib>Sur, Tanuj</creatorcontrib><creatorcontrib>Lall, Brejesh</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>Aluminium Industry Abstracts</collection><collection>Biotechnology Research Abstracts</collection><collection>Ceramic Abstracts</collection><collection>Computer and Information Systems Abstracts</collection><collection>Corrosion Abstracts</collection><collection>Electronics &amp; Communications Abstracts</collection><collection>Engineered Materials Abstracts</collection><collection>Materials Business File</collection><collection>Mechanical &amp; Transportation Engineering Abstracts</collection><collection>Solid State and Superconductivity Abstracts</collection><collection>METADEX</collection><collection>Technology Research Database</collection><collection>ANTE: Abstracts in New Technology &amp; Engineering</collection><collection>Engineering Research Database</collection><collection>Aerospace Database</collection><collection>Materials Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Civil Engineering Abstracts</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>Nursing &amp; Allied Health Premium</collection><collection>Biotechnology and BioEngineering Abstracts</collection><collection>MEDLINE - Academic</collection><jtitle>IEEE transactions on medical imaging</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Pandey, Prashant</au><au>Chasmai, Mustafa</au><au>Sur, Tanuj</au><au>Lall, Brejesh</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Robust Prototypical Few-Shot Organ Segmentation with Regularized Neural-ODEs</atitle><jtitle>IEEE transactions on medical imaging</jtitle><stitle>TMI</stitle><addtitle>IEEE Trans Med Imaging</addtitle><date>2023-09-01</date><risdate>2023</risdate><volume>PP</volume><issue>9</issue><spage>1</spage><epage>1</epage><pages>1-1</pages><issn>0278-0062</issn><eissn>1558-254X</eissn><coden>ITMID4</coden><abstract>Despite the tremendous progress made by deep learning models in image semantic segmentation, they typically require large annotated examples, and increasing attention is being diverted to problem settings like Few-Shot Learning (FSL) where only a small amount of annotation is needed for generalisation to novel classes. This is especially seen in medical domains where dense pixel-level annotations are expensive to obtain. In this paper, we propose Regularized Prototypical Neural Ordinary Differential Equation (R-PNODE), a method that leverages intrinsic properties of Neural-ODEs, assisted and enhanced by additional cluster and consistency losses to perform Few-Shot Segmentation (FSS) of organs. R-PNODE constrains support and query features from the same classes to lie closer in the representation space thereby improving the performance over the existing Convolutional Neural Network (CNN) based FSS methods. We further demonstrate that while many existing Deep CNN-based methods tend to be extremely vulnerable to adversarial attacks, R-PNODE exhibits increased adversarial robustness for a wide array of these attacks. We experiment with three publicly available multi-organ segmentation datasets in both in-domain and cross-domain FSS settings to demonstrate the efficacy of our method. In addition, we perform experiments with seven commonly used adversarial attacks in various settings to demonstrate R-PNODE's robustness. R-PNODE outperforms the baselines for FSS by significant margins and also shows superior performance for a wide array of attacks varying in intensity and design.</abstract><cop>United States</cop><pub>IEEE</pub><pmid>37030728</pmid><doi>10.1109/TMI.2023.3258069</doi><tpages>1</tpages><orcidid>https://orcid.org/0000-0002-6594-9685</orcidid><orcidid>https://orcid.org/0000-0003-2677-3071</orcidid><orcidid>https://orcid.org/0000-0001-5298-5241</orcidid><orcidid>https://orcid.org/0000-0001-8694-3453</orcidid></addata></record>
fulltext fulltext_linktorsrc
identifier ISSN: 0278-0062
ispartof IEEE transactions on medical imaging, 2023-09, Vol.PP (9), p.1-1
issn 0278-0062
1558-254X
language eng
recordid cdi_pubmed_primary_37030728
source IEEE Electronic Library (IEL)
subjects Adversarial Robustness
Annotations
Arrays
Artificial neural networks
Deep learning
Differential equations
Feature extraction
Few-shot Segmentation
Image annotation
Image processing
Image segmentation
Machine learning
Medical diagnosis
Medical diagnostic imaging
Medical Image Segmentation
Neural networks
Neural-ODEs
Ordinary differential equations
Perturbation methods
Robustness
Semantic segmentation
Training
title Robust Prototypical Few-Shot Organ Segmentation with Regularized Neural-ODEs
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-29T05%3A10%3A22IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Robust%20Prototypical%20Few-Shot%20Organ%20Segmentation%20with%20Regularized%20Neural-ODEs&rft.jtitle=IEEE%20transactions%20on%20medical%20imaging&rft.au=Pandey,%20Prashant&rft.date=2023-09-01&rft.volume=PP&rft.issue=9&rft.spage=1&rft.epage=1&rft.pages=1-1&rft.issn=0278-0062&rft.eissn=1558-254X&rft.coden=ITMID4&rft_id=info:doi/10.1109/TMI.2023.3258069&rft_dat=%3Cproquest_RIE%3E2798714192%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2859716469&rft_id=info:pmid/37030728&rft_ieee_id=10073652&rfr_iscdi=true