Robust Prototypical Few-Shot Organ Segmentation with Regularized Neural-ODEs
Despite the tremendous progress made by deep learning models in image semantic segmentation, they typically require large annotated examples, and increasing attention is being diverted to problem settings like Few-Shot Learning (FSL) where only a small amount of annotation is needed for generalisati...
Gespeichert in:
Veröffentlicht in: | IEEE transactions on medical imaging 2023-09, Vol.PP (9), p.1-1 |
---|---|
Hauptverfasser: | , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 1 |
---|---|
container_issue | 9 |
container_start_page | 1 |
container_title | IEEE transactions on medical imaging |
container_volume | PP |
creator | Pandey, Prashant Chasmai, Mustafa Sur, Tanuj Lall, Brejesh |
description | Despite the tremendous progress made by deep learning models in image semantic segmentation, they typically require large annotated examples, and increasing attention is being diverted to problem settings like Few-Shot Learning (FSL) where only a small amount of annotation is needed for generalisation to novel classes. This is especially seen in medical domains where dense pixel-level annotations are expensive to obtain. In this paper, we propose Regularized Prototypical Neural Ordinary Differential Equation (R-PNODE), a method that leverages intrinsic properties of Neural-ODEs, assisted and enhanced by additional cluster and consistency losses to perform Few-Shot Segmentation (FSS) of organs. R-PNODE constrains support and query features from the same classes to lie closer in the representation space thereby improving the performance over the existing Convolutional Neural Network (CNN) based FSS methods. We further demonstrate that while many existing Deep CNN-based methods tend to be extremely vulnerable to adversarial attacks, R-PNODE exhibits increased adversarial robustness for a wide array of these attacks. We experiment with three publicly available multi-organ segmentation datasets in both in-domain and cross-domain FSS settings to demonstrate the efficacy of our method. In addition, we perform experiments with seven commonly used adversarial attacks in various settings to demonstrate R-PNODE's robustness. R-PNODE outperforms the baselines for FSS by significant margins and also shows superior performance for a wide array of attacks varying in intensity and design. |
doi_str_mv | 10.1109/TMI.2023.3258069 |
format | Article |
fullrecord | <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_pubmed_primary_37030728</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>10073652</ieee_id><sourcerecordid>2798714192</sourcerecordid><originalsourceid>FETCH-LOGICAL-c348t-eb86452af3225f119553dba096e4cb36ba5b6f1d6727872137828002b1933f1f3</originalsourceid><addsrcrecordid>eNpdkEtrFEEUhQtRzBizdyHS4MZNT27d6notJSYxMGYkD3BXVPfcnnTo6ZpUVROSX2-HGUVcnc13DoePsQ8c5pyDPb75cTFHQDEXKA0o-4rNuJSmRFn9es1mgNqUAAoP2LuU7gF4JcG-ZQdCgwCNZsYWV6EeUy5-xpBDftp2je-LM3osr-9CLpZx7YfimtYbGrLPXRiKxy7fFVe0Hnsfu2daFZc0Rt-Xy2-n6T170_o-0dE-D9nt2enNyfdysTy_OPm6KBtRmVxSbVQl0bcCUbacWynFqvZgFVVNLVTtZa1avlJ6-q-RC23QAGDNrRAtb8Uh-7Lb3cbwMFLKbtOlhvreDxTG5FBbo3nFLU7o5__Q-zDGYXrn0EiruaqUnSjYUU0MKUVq3TZ2Gx-fHAf3YtpNpt2Labc3PVU-7YfHekOrv4U_aifg4w7oiOifPdBCSRS_ARZDf_c</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2859716469</pqid></control><display><type>article</type><title>Robust Prototypical Few-Shot Organ Segmentation with Regularized Neural-ODEs</title><source>IEEE Electronic Library (IEL)</source><creator>Pandey, Prashant ; Chasmai, Mustafa ; Sur, Tanuj ; Lall, Brejesh</creator><creatorcontrib>Pandey, Prashant ; Chasmai, Mustafa ; Sur, Tanuj ; Lall, Brejesh</creatorcontrib><description>Despite the tremendous progress made by deep learning models in image semantic segmentation, they typically require large annotated examples, and increasing attention is being diverted to problem settings like Few-Shot Learning (FSL) where only a small amount of annotation is needed for generalisation to novel classes. This is especially seen in medical domains where dense pixel-level annotations are expensive to obtain. In this paper, we propose Regularized Prototypical Neural Ordinary Differential Equation (R-PNODE), a method that leverages intrinsic properties of Neural-ODEs, assisted and enhanced by additional cluster and consistency losses to perform Few-Shot Segmentation (FSS) of organs. R-PNODE constrains support and query features from the same classes to lie closer in the representation space thereby improving the performance over the existing Convolutional Neural Network (CNN) based FSS methods. We further demonstrate that while many existing Deep CNN-based methods tend to be extremely vulnerable to adversarial attacks, R-PNODE exhibits increased adversarial robustness for a wide array of these attacks. We experiment with three publicly available multi-organ segmentation datasets in both in-domain and cross-domain FSS settings to demonstrate the efficacy of our method. In addition, we perform experiments with seven commonly used adversarial attacks in various settings to demonstrate R-PNODE's robustness. R-PNODE outperforms the baselines for FSS by significant margins and also shows superior performance for a wide array of attacks varying in intensity and design.</description><identifier>ISSN: 0278-0062</identifier><identifier>EISSN: 1558-254X</identifier><identifier>DOI: 10.1109/TMI.2023.3258069</identifier><identifier>PMID: 37030728</identifier><identifier>CODEN: ITMID4</identifier><language>eng</language><publisher>United States: IEEE</publisher><subject>Adversarial Robustness ; Annotations ; Arrays ; Artificial neural networks ; Deep learning ; Differential equations ; Feature extraction ; Few-shot Segmentation ; Image annotation ; Image processing ; Image segmentation ; Machine learning ; Medical diagnosis ; Medical diagnostic imaging ; Medical Image Segmentation ; Neural networks ; Neural-ODEs ; Ordinary differential equations ; Perturbation methods ; Robustness ; Semantic segmentation ; Training</subject><ispartof>IEEE transactions on medical imaging, 2023-09, Vol.PP (9), p.1-1</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2023</rights><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c348t-eb86452af3225f119553dba096e4cb36ba5b6f1d6727872137828002b1933f1f3</citedby><cites>FETCH-LOGICAL-c348t-eb86452af3225f119553dba096e4cb36ba5b6f1d6727872137828002b1933f1f3</cites><orcidid>0000-0002-6594-9685 ; 0000-0003-2677-3071 ; 0000-0001-5298-5241 ; 0000-0001-8694-3453</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/10073652$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,780,784,796,27924,27925,54758</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/10073652$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/37030728$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Pandey, Prashant</creatorcontrib><creatorcontrib>Chasmai, Mustafa</creatorcontrib><creatorcontrib>Sur, Tanuj</creatorcontrib><creatorcontrib>Lall, Brejesh</creatorcontrib><title>Robust Prototypical Few-Shot Organ Segmentation with Regularized Neural-ODEs</title><title>IEEE transactions on medical imaging</title><addtitle>TMI</addtitle><addtitle>IEEE Trans Med Imaging</addtitle><description>Despite the tremendous progress made by deep learning models in image semantic segmentation, they typically require large annotated examples, and increasing attention is being diverted to problem settings like Few-Shot Learning (FSL) where only a small amount of annotation is needed for generalisation to novel classes. This is especially seen in medical domains where dense pixel-level annotations are expensive to obtain. In this paper, we propose Regularized Prototypical Neural Ordinary Differential Equation (R-PNODE), a method that leverages intrinsic properties of Neural-ODEs, assisted and enhanced by additional cluster and consistency losses to perform Few-Shot Segmentation (FSS) of organs. R-PNODE constrains support and query features from the same classes to lie closer in the representation space thereby improving the performance over the existing Convolutional Neural Network (CNN) based FSS methods. We further demonstrate that while many existing Deep CNN-based methods tend to be extremely vulnerable to adversarial attacks, R-PNODE exhibits increased adversarial robustness for a wide array of these attacks. We experiment with three publicly available multi-organ segmentation datasets in both in-domain and cross-domain FSS settings to demonstrate the efficacy of our method. In addition, we perform experiments with seven commonly used adversarial attacks in various settings to demonstrate R-PNODE's robustness. R-PNODE outperforms the baselines for FSS by significant margins and also shows superior performance for a wide array of attacks varying in intensity and design.</description><subject>Adversarial Robustness</subject><subject>Annotations</subject><subject>Arrays</subject><subject>Artificial neural networks</subject><subject>Deep learning</subject><subject>Differential equations</subject><subject>Feature extraction</subject><subject>Few-shot Segmentation</subject><subject>Image annotation</subject><subject>Image processing</subject><subject>Image segmentation</subject><subject>Machine learning</subject><subject>Medical diagnosis</subject><subject>Medical diagnostic imaging</subject><subject>Medical Image Segmentation</subject><subject>Neural networks</subject><subject>Neural-ODEs</subject><subject>Ordinary differential equations</subject><subject>Perturbation methods</subject><subject>Robustness</subject><subject>Semantic segmentation</subject><subject>Training</subject><issn>0278-0062</issn><issn>1558-254X</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNpdkEtrFEEUhQtRzBizdyHS4MZNT27d6notJSYxMGYkD3BXVPfcnnTo6ZpUVROSX2-HGUVcnc13DoePsQ8c5pyDPb75cTFHQDEXKA0o-4rNuJSmRFn9es1mgNqUAAoP2LuU7gF4JcG-ZQdCgwCNZsYWV6EeUy5-xpBDftp2je-LM3osr-9CLpZx7YfimtYbGrLPXRiKxy7fFVe0Hnsfu2daFZc0Rt-Xy2-n6T170_o-0dE-D9nt2enNyfdysTy_OPm6KBtRmVxSbVQl0bcCUbacWynFqvZgFVVNLVTtZa1avlJ6-q-RC23QAGDNrRAtb8Uh-7Lb3cbwMFLKbtOlhvreDxTG5FBbo3nFLU7o5__Q-zDGYXrn0EiruaqUnSjYUU0MKUVq3TZ2Gx-fHAf3YtpNpt2Labc3PVU-7YfHekOrv4U_aifg4w7oiOifPdBCSRS_ARZDf_c</recordid><startdate>20230901</startdate><enddate>20230901</enddate><creator>Pandey, Prashant</creator><creator>Chasmai, Mustafa</creator><creator>Sur, Tanuj</creator><creator>Lall, Brejesh</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7QF</scope><scope>7QO</scope><scope>7QQ</scope><scope>7SC</scope><scope>7SE</scope><scope>7SP</scope><scope>7SR</scope><scope>7TA</scope><scope>7TB</scope><scope>7U5</scope><scope>8BQ</scope><scope>8FD</scope><scope>F28</scope><scope>FR3</scope><scope>H8D</scope><scope>JG9</scope><scope>JQ2</scope><scope>KR7</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>NAPCQ</scope><scope>P64</scope><scope>7X8</scope><orcidid>https://orcid.org/0000-0002-6594-9685</orcidid><orcidid>https://orcid.org/0000-0003-2677-3071</orcidid><orcidid>https://orcid.org/0000-0001-5298-5241</orcidid><orcidid>https://orcid.org/0000-0001-8694-3453</orcidid></search><sort><creationdate>20230901</creationdate><title>Robust Prototypical Few-Shot Organ Segmentation with Regularized Neural-ODEs</title><author>Pandey, Prashant ; Chasmai, Mustafa ; Sur, Tanuj ; Lall, Brejesh</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c348t-eb86452af3225f119553dba096e4cb36ba5b6f1d6727872137828002b1933f1f3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Adversarial Robustness</topic><topic>Annotations</topic><topic>Arrays</topic><topic>Artificial neural networks</topic><topic>Deep learning</topic><topic>Differential equations</topic><topic>Feature extraction</topic><topic>Few-shot Segmentation</topic><topic>Image annotation</topic><topic>Image processing</topic><topic>Image segmentation</topic><topic>Machine learning</topic><topic>Medical diagnosis</topic><topic>Medical diagnostic imaging</topic><topic>Medical Image Segmentation</topic><topic>Neural networks</topic><topic>Neural-ODEs</topic><topic>Ordinary differential equations</topic><topic>Perturbation methods</topic><topic>Robustness</topic><topic>Semantic segmentation</topic><topic>Training</topic><toplevel>online_resources</toplevel><creatorcontrib>Pandey, Prashant</creatorcontrib><creatorcontrib>Chasmai, Mustafa</creatorcontrib><creatorcontrib>Sur, Tanuj</creatorcontrib><creatorcontrib>Lall, Brejesh</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>Aluminium Industry Abstracts</collection><collection>Biotechnology Research Abstracts</collection><collection>Ceramic Abstracts</collection><collection>Computer and Information Systems Abstracts</collection><collection>Corrosion Abstracts</collection><collection>Electronics & Communications Abstracts</collection><collection>Engineered Materials Abstracts</collection><collection>Materials Business File</collection><collection>Mechanical & Transportation Engineering Abstracts</collection><collection>Solid State and Superconductivity Abstracts</collection><collection>METADEX</collection><collection>Technology Research Database</collection><collection>ANTE: Abstracts in New Technology & Engineering</collection><collection>Engineering Research Database</collection><collection>Aerospace Database</collection><collection>Materials Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Civil Engineering Abstracts</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>Nursing & Allied Health Premium</collection><collection>Biotechnology and BioEngineering Abstracts</collection><collection>MEDLINE - Academic</collection><jtitle>IEEE transactions on medical imaging</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Pandey, Prashant</au><au>Chasmai, Mustafa</au><au>Sur, Tanuj</au><au>Lall, Brejesh</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Robust Prototypical Few-Shot Organ Segmentation with Regularized Neural-ODEs</atitle><jtitle>IEEE transactions on medical imaging</jtitle><stitle>TMI</stitle><addtitle>IEEE Trans Med Imaging</addtitle><date>2023-09-01</date><risdate>2023</risdate><volume>PP</volume><issue>9</issue><spage>1</spage><epage>1</epage><pages>1-1</pages><issn>0278-0062</issn><eissn>1558-254X</eissn><coden>ITMID4</coden><abstract>Despite the tremendous progress made by deep learning models in image semantic segmentation, they typically require large annotated examples, and increasing attention is being diverted to problem settings like Few-Shot Learning (FSL) where only a small amount of annotation is needed for generalisation to novel classes. This is especially seen in medical domains where dense pixel-level annotations are expensive to obtain. In this paper, we propose Regularized Prototypical Neural Ordinary Differential Equation (R-PNODE), a method that leverages intrinsic properties of Neural-ODEs, assisted and enhanced by additional cluster and consistency losses to perform Few-Shot Segmentation (FSS) of organs. R-PNODE constrains support and query features from the same classes to lie closer in the representation space thereby improving the performance over the existing Convolutional Neural Network (CNN) based FSS methods. We further demonstrate that while many existing Deep CNN-based methods tend to be extremely vulnerable to adversarial attacks, R-PNODE exhibits increased adversarial robustness for a wide array of these attacks. We experiment with three publicly available multi-organ segmentation datasets in both in-domain and cross-domain FSS settings to demonstrate the efficacy of our method. In addition, we perform experiments with seven commonly used adversarial attacks in various settings to demonstrate R-PNODE's robustness. R-PNODE outperforms the baselines for FSS by significant margins and also shows superior performance for a wide array of attacks varying in intensity and design.</abstract><cop>United States</cop><pub>IEEE</pub><pmid>37030728</pmid><doi>10.1109/TMI.2023.3258069</doi><tpages>1</tpages><orcidid>https://orcid.org/0000-0002-6594-9685</orcidid><orcidid>https://orcid.org/0000-0003-2677-3071</orcidid><orcidid>https://orcid.org/0000-0001-5298-5241</orcidid><orcidid>https://orcid.org/0000-0001-8694-3453</orcidid></addata></record> |
fulltext | fulltext_linktorsrc |
identifier | ISSN: 0278-0062 |
ispartof | IEEE transactions on medical imaging, 2023-09, Vol.PP (9), p.1-1 |
issn | 0278-0062 1558-254X |
language | eng |
recordid | cdi_pubmed_primary_37030728 |
source | IEEE Electronic Library (IEL) |
subjects | Adversarial Robustness Annotations Arrays Artificial neural networks Deep learning Differential equations Feature extraction Few-shot Segmentation Image annotation Image processing Image segmentation Machine learning Medical diagnosis Medical diagnostic imaging Medical Image Segmentation Neural networks Neural-ODEs Ordinary differential equations Perturbation methods Robustness Semantic segmentation Training |
title | Robust Prototypical Few-Shot Organ Segmentation with Regularized Neural-ODEs |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-29T05%3A10%3A22IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Robust%20Prototypical%20Few-Shot%20Organ%20Segmentation%20with%20Regularized%20Neural-ODEs&rft.jtitle=IEEE%20transactions%20on%20medical%20imaging&rft.au=Pandey,%20Prashant&rft.date=2023-09-01&rft.volume=PP&rft.issue=9&rft.spage=1&rft.epage=1&rft.pages=1-1&rft.issn=0278-0062&rft.eissn=1558-254X&rft.coden=ITMID4&rft_id=info:doi/10.1109/TMI.2023.3258069&rft_dat=%3Cproquest_RIE%3E2798714192%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2859716469&rft_id=info:pmid/37030728&rft_ieee_id=10073652&rfr_iscdi=true |