Model-Driven Deep Learning Method for Pancreatic Cancer Segmentation Based on Spiral-Transformation

Pancreatic cancer is a lethal malignant tumor with one of the worst prognoses. Accurate segmentation of pancreatic cancer is vital in clinical diagnosis and treatment. Due to the unclear boundary and small size of cancers, it is challenging to both manually annotate and automatically segment cancers...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on medical imaging 2022-01, Vol.41 (1), p.75-87
Hauptverfasser: Chen, Xiahan, Chen, Zihao, Li, Jun, Zhang, Yu-Dong, Lin, Xiaozhu, Qian, Xiaohua
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 87
container_issue 1
container_start_page 75
container_title IEEE transactions on medical imaging
container_volume 41
creator Chen, Xiahan
Chen, Zihao
Li, Jun
Zhang, Yu-Dong
Lin, Xiaozhu
Qian, Xiaohua
description Pancreatic cancer is a lethal malignant tumor with one of the worst prognoses. Accurate segmentation of pancreatic cancer is vital in clinical diagnosis and treatment. Due to the unclear boundary and small size of cancers, it is challenging to both manually annotate and automatically segment cancers. Considering 3D information utilization and small sample sizes, we propose a model-driven deep learning method for pancreatic cancer segmentation based on spiral transformation. Specifically, a spiral-transformation algorithm with uniform sampling was developed to map 3D images onto 2D planes while preserving the spatial relationship between textures, thus addressing the challenge in effectively applying 3D contextual information in a 2D model. This study is the first to introduce spiral transformation in a segmentation task to provide effective data augmentation, alleviating the issue of small sample size. Moreover, a transformation-weight-corrected module was embedded into the deep learning model to unify the entire framework. It can achieve 2D segmentation and corresponding 3D rebuilding constraint to overcome non-unique 3D rebuilding results due to the uniform and dense sampling. A smooth regularization based on rebuilding prior knowledge was also designed to optimize segmentation results. The extensive experiments showed that the proposed method achieved a promising segmentation performance on multi-parametric MRIs, where T2, T1, ADC, DWI images obtained the DSC of 65.6%, 64.0%, 64.5%, 65.3%, respectively. This method can provide a novel paradigm to efficiently apply 3D information and augment sample sizes in the development of artificial intelligence for cancer segmentation. Our source codes will be released at https://github.com/SJTUBME-QianLab/ Spiral-Segmentation.
doi_str_mv 10.1109/TMI.2021.3104460
format Article
fullrecord <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_proquest_journals_2615511027</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>9512056</ieee_id><sourcerecordid>2561491928</sourcerecordid><originalsourceid>FETCH-LOGICAL-c347t-9368e05f9837ba78587bf777a82488b11d161b8c01d14076eb2eebdd07a02f0a3</originalsourceid><addsrcrecordid>eNpdkc1LHEEQxZuQEFfjXRBCgxcvs6n-7jnG1STCLgpuwFvTM1NjRmZ61u5ZIf-9bXbjwVM_un6vKN4j5ITBnDEov61X13MOnM0FAyk1fCAzppQtuJL3H8kMuLEFgOYH5DClRwAmFZSfyYGQwgot9YzUq7HBvriM3TMGeom4oUv0MXThga5w-jM2tB0jvfWhjuinrqaLLDHSO3wYMEz5awz0widsaBZ3my76vlhHH1L2Df_GX8in1vcJj_fvEfn942q9-FUsb35eL74vi1pIMxWl0BZBtaUVpvLGKmuq1hjjLZfWVow1TLPK1pCFBKOx4ohV04DxwFvw4oic7_Zu4vi0xTS5oUs19r0POG6T40ozWbKS24yevUMfx20M-TrHdY4wp8tNpmBH1XFMKWLrNrEbfPzrGLjXAlwuwL0W4PYFZMvX_eJtNWDzZvifeAZOd0CHiG_jUjEOSosXbOWIcA</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2615511027</pqid></control><display><type>article</type><title>Model-Driven Deep Learning Method for Pancreatic Cancer Segmentation Based on Spiral-Transformation</title><source>IEEE Electronic Library (IEL)</source><creator>Chen, Xiahan ; Chen, Zihao ; Li, Jun ; Zhang, Yu-Dong ; Lin, Xiaozhu ; Qian, Xiaohua</creator><creatorcontrib>Chen, Xiahan ; Chen, Zihao ; Li, Jun ; Zhang, Yu-Dong ; Lin, Xiaozhu ; Qian, Xiaohua</creatorcontrib><description>Pancreatic cancer is a lethal malignant tumor with one of the worst prognoses. Accurate segmentation of pancreatic cancer is vital in clinical diagnosis and treatment. Due to the unclear boundary and small size of cancers, it is challenging to both manually annotate and automatically segment cancers. Considering 3D information utilization and small sample sizes, we propose a model-driven deep learning method for pancreatic cancer segmentation based on spiral transformation. Specifically, a spiral-transformation algorithm with uniform sampling was developed to map 3D images onto 2D planes while preserving the spatial relationship between textures, thus addressing the challenge in effectively applying 3D contextual information in a 2D model. This study is the first to introduce spiral transformation in a segmentation task to provide effective data augmentation, alleviating the issue of small sample size. Moreover, a transformation-weight-corrected module was embedded into the deep learning model to unify the entire framework. It can achieve 2D segmentation and corresponding 3D rebuilding constraint to overcome non-unique 3D rebuilding results due to the uniform and dense sampling. A smooth regularization based on rebuilding prior knowledge was also designed to optimize segmentation results. The extensive experiments showed that the proposed method achieved a promising segmentation performance on multi-parametric MRIs, where T2, T1, ADC, DWI images obtained the DSC of 65.6%, 64.0%, 64.5%, 65.3%, respectively. This method can provide a novel paradigm to efficiently apply 3D information and augment sample sizes in the development of artificial intelligence for cancer segmentation. Our source codes will be released at https://github.com/SJTUBME-QianLab/ Spiral-Segmentation.</description><identifier>ISSN: 0278-0062</identifier><identifier>EISSN: 1558-254X</identifier><identifier>DOI: 10.1109/TMI.2021.3104460</identifier><identifier>PMID: 34383646</identifier><identifier>CODEN: ITMID4</identifier><language>eng</language><publisher>United States: IEEE</publisher><subject>Algorithms ; Artificial Intelligence ; Cancer ; data augmentation ; Deep Learning ; Humans ; Image Processing, Computer-Assisted ; Image segmentation ; Imaging, Three-Dimensional ; Information processing ; Machine learning ; Medical imaging ; model-driven deep learning ; Pancreatic cancer ; pancreatic cancer segmentation ; Pancreatic Neoplasms - diagnostic imaging ; Rebuilding ; Regularization ; Sampling ; Solid modeling ; Spiral transformation ; Spirals ; Teaching methods ; Three-dimensional displays ; Transformations ; Tumors ; Two dimensional models</subject><ispartof>IEEE transactions on medical imaging, 2022-01, Vol.41 (1), p.75-87</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2022</rights><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c347t-9368e05f9837ba78587bf777a82488b11d161b8c01d14076eb2eebdd07a02f0a3</citedby><cites>FETCH-LOGICAL-c347t-9368e05f9837ba78587bf777a82488b11d161b8c01d14076eb2eebdd07a02f0a3</cites><orcidid>0000-0002-9270-689X ; 0000-0003-4566-9536 ; 0000-0002-9349-0349 ; 0000-0002-6548-6801 ; 0000-0002-8195-3932 ; 0000-0002-2811-7513</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/9512056$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,776,780,792,27903,27904,54737</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/9512056$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/34383646$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Chen, Xiahan</creatorcontrib><creatorcontrib>Chen, Zihao</creatorcontrib><creatorcontrib>Li, Jun</creatorcontrib><creatorcontrib>Zhang, Yu-Dong</creatorcontrib><creatorcontrib>Lin, Xiaozhu</creatorcontrib><creatorcontrib>Qian, Xiaohua</creatorcontrib><title>Model-Driven Deep Learning Method for Pancreatic Cancer Segmentation Based on Spiral-Transformation</title><title>IEEE transactions on medical imaging</title><addtitle>TMI</addtitle><addtitle>IEEE Trans Med Imaging</addtitle><description>Pancreatic cancer is a lethal malignant tumor with one of the worst prognoses. Accurate segmentation of pancreatic cancer is vital in clinical diagnosis and treatment. Due to the unclear boundary and small size of cancers, it is challenging to both manually annotate and automatically segment cancers. Considering 3D information utilization and small sample sizes, we propose a model-driven deep learning method for pancreatic cancer segmentation based on spiral transformation. Specifically, a spiral-transformation algorithm with uniform sampling was developed to map 3D images onto 2D planes while preserving the spatial relationship between textures, thus addressing the challenge in effectively applying 3D contextual information in a 2D model. This study is the first to introduce spiral transformation in a segmentation task to provide effective data augmentation, alleviating the issue of small sample size. Moreover, a transformation-weight-corrected module was embedded into the deep learning model to unify the entire framework. It can achieve 2D segmentation and corresponding 3D rebuilding constraint to overcome non-unique 3D rebuilding results due to the uniform and dense sampling. A smooth regularization based on rebuilding prior knowledge was also designed to optimize segmentation results. The extensive experiments showed that the proposed method achieved a promising segmentation performance on multi-parametric MRIs, where T2, T1, ADC, DWI images obtained the DSC of 65.6%, 64.0%, 64.5%, 65.3%, respectively. This method can provide a novel paradigm to efficiently apply 3D information and augment sample sizes in the development of artificial intelligence for cancer segmentation. Our source codes will be released at https://github.com/SJTUBME-QianLab/ Spiral-Segmentation.</description><subject>Algorithms</subject><subject>Artificial Intelligence</subject><subject>Cancer</subject><subject>data augmentation</subject><subject>Deep Learning</subject><subject>Humans</subject><subject>Image Processing, Computer-Assisted</subject><subject>Image segmentation</subject><subject>Imaging, Three-Dimensional</subject><subject>Information processing</subject><subject>Machine learning</subject><subject>Medical imaging</subject><subject>model-driven deep learning</subject><subject>Pancreatic cancer</subject><subject>pancreatic cancer segmentation</subject><subject>Pancreatic Neoplasms - diagnostic imaging</subject><subject>Rebuilding</subject><subject>Regularization</subject><subject>Sampling</subject><subject>Solid modeling</subject><subject>Spiral transformation</subject><subject>Spirals</subject><subject>Teaching methods</subject><subject>Three-dimensional displays</subject><subject>Transformations</subject><subject>Tumors</subject><subject>Two dimensional models</subject><issn>0278-0062</issn><issn>1558-254X</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><sourceid>EIF</sourceid><recordid>eNpdkc1LHEEQxZuQEFfjXRBCgxcvs6n-7jnG1STCLgpuwFvTM1NjRmZ61u5ZIf-9bXbjwVM_un6vKN4j5ITBnDEov61X13MOnM0FAyk1fCAzppQtuJL3H8kMuLEFgOYH5DClRwAmFZSfyYGQwgot9YzUq7HBvriM3TMGeom4oUv0MXThga5w-jM2tB0jvfWhjuinrqaLLDHSO3wYMEz5awz0widsaBZ3my76vlhHH1L2Df_GX8in1vcJj_fvEfn942q9-FUsb35eL74vi1pIMxWl0BZBtaUVpvLGKmuq1hjjLZfWVow1TLPK1pCFBKOx4ohV04DxwFvw4oic7_Zu4vi0xTS5oUs19r0POG6T40ozWbKS24yevUMfx20M-TrHdY4wp8tNpmBH1XFMKWLrNrEbfPzrGLjXAlwuwL0W4PYFZMvX_eJtNWDzZvifeAZOd0CHiG_jUjEOSosXbOWIcA</recordid><startdate>202201</startdate><enddate>202201</enddate><creator>Chen, Xiahan</creator><creator>Chen, Zihao</creator><creator>Li, Jun</creator><creator>Zhang, Yu-Dong</creator><creator>Lin, Xiaozhu</creator><creator>Qian, Xiaohua</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7QF</scope><scope>7QO</scope><scope>7QQ</scope><scope>7SC</scope><scope>7SE</scope><scope>7SP</scope><scope>7SR</scope><scope>7TA</scope><scope>7TB</scope><scope>7U5</scope><scope>8BQ</scope><scope>8FD</scope><scope>F28</scope><scope>FR3</scope><scope>H8D</scope><scope>JG9</scope><scope>JQ2</scope><scope>KR7</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>NAPCQ</scope><scope>P64</scope><scope>7X8</scope><orcidid>https://orcid.org/0000-0002-9270-689X</orcidid><orcidid>https://orcid.org/0000-0003-4566-9536</orcidid><orcidid>https://orcid.org/0000-0002-9349-0349</orcidid><orcidid>https://orcid.org/0000-0002-6548-6801</orcidid><orcidid>https://orcid.org/0000-0002-8195-3932</orcidid><orcidid>https://orcid.org/0000-0002-2811-7513</orcidid></search><sort><creationdate>202201</creationdate><title>Model-Driven Deep Learning Method for Pancreatic Cancer Segmentation Based on Spiral-Transformation</title><author>Chen, Xiahan ; Chen, Zihao ; Li, Jun ; Zhang, Yu-Dong ; Lin, Xiaozhu ; Qian, Xiaohua</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c347t-9368e05f9837ba78587bf777a82488b11d161b8c01d14076eb2eebdd07a02f0a3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>Algorithms</topic><topic>Artificial Intelligence</topic><topic>Cancer</topic><topic>data augmentation</topic><topic>Deep Learning</topic><topic>Humans</topic><topic>Image Processing, Computer-Assisted</topic><topic>Image segmentation</topic><topic>Imaging, Three-Dimensional</topic><topic>Information processing</topic><topic>Machine learning</topic><topic>Medical imaging</topic><topic>model-driven deep learning</topic><topic>Pancreatic cancer</topic><topic>pancreatic cancer segmentation</topic><topic>Pancreatic Neoplasms - diagnostic imaging</topic><topic>Rebuilding</topic><topic>Regularization</topic><topic>Sampling</topic><topic>Solid modeling</topic><topic>Spiral transformation</topic><topic>Spirals</topic><topic>Teaching methods</topic><topic>Three-dimensional displays</topic><topic>Transformations</topic><topic>Tumors</topic><topic>Two dimensional models</topic><toplevel>online_resources</toplevel><creatorcontrib>Chen, Xiahan</creatorcontrib><creatorcontrib>Chen, Zihao</creatorcontrib><creatorcontrib>Li, Jun</creatorcontrib><creatorcontrib>Zhang, Yu-Dong</creatorcontrib><creatorcontrib>Lin, Xiaozhu</creatorcontrib><creatorcontrib>Qian, Xiaohua</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>Aluminium Industry Abstracts</collection><collection>Biotechnology Research Abstracts</collection><collection>Ceramic Abstracts</collection><collection>Computer and Information Systems Abstracts</collection><collection>Corrosion Abstracts</collection><collection>Electronics &amp; Communications Abstracts</collection><collection>Engineered Materials Abstracts</collection><collection>Materials Business File</collection><collection>Mechanical &amp; Transportation Engineering Abstracts</collection><collection>Solid State and Superconductivity Abstracts</collection><collection>METADEX</collection><collection>Technology Research Database</collection><collection>ANTE: Abstracts in New Technology &amp; Engineering</collection><collection>Engineering Research Database</collection><collection>Aerospace Database</collection><collection>Materials Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Civil Engineering Abstracts</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>Nursing &amp; Allied Health Premium</collection><collection>Biotechnology and BioEngineering Abstracts</collection><collection>MEDLINE - Academic</collection><jtitle>IEEE transactions on medical imaging</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Chen, Xiahan</au><au>Chen, Zihao</au><au>Li, Jun</au><au>Zhang, Yu-Dong</au><au>Lin, Xiaozhu</au><au>Qian, Xiaohua</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Model-Driven Deep Learning Method for Pancreatic Cancer Segmentation Based on Spiral-Transformation</atitle><jtitle>IEEE transactions on medical imaging</jtitle><stitle>TMI</stitle><addtitle>IEEE Trans Med Imaging</addtitle><date>2022-01</date><risdate>2022</risdate><volume>41</volume><issue>1</issue><spage>75</spage><epage>87</epage><pages>75-87</pages><issn>0278-0062</issn><eissn>1558-254X</eissn><coden>ITMID4</coden><abstract>Pancreatic cancer is a lethal malignant tumor with one of the worst prognoses. Accurate segmentation of pancreatic cancer is vital in clinical diagnosis and treatment. Due to the unclear boundary and small size of cancers, it is challenging to both manually annotate and automatically segment cancers. Considering 3D information utilization and small sample sizes, we propose a model-driven deep learning method for pancreatic cancer segmentation based on spiral transformation. Specifically, a spiral-transformation algorithm with uniform sampling was developed to map 3D images onto 2D planes while preserving the spatial relationship between textures, thus addressing the challenge in effectively applying 3D contextual information in a 2D model. This study is the first to introduce spiral transformation in a segmentation task to provide effective data augmentation, alleviating the issue of small sample size. Moreover, a transformation-weight-corrected module was embedded into the deep learning model to unify the entire framework. It can achieve 2D segmentation and corresponding 3D rebuilding constraint to overcome non-unique 3D rebuilding results due to the uniform and dense sampling. A smooth regularization based on rebuilding prior knowledge was also designed to optimize segmentation results. The extensive experiments showed that the proposed method achieved a promising segmentation performance on multi-parametric MRIs, where T2, T1, ADC, DWI images obtained the DSC of 65.6%, 64.0%, 64.5%, 65.3%, respectively. This method can provide a novel paradigm to efficiently apply 3D information and augment sample sizes in the development of artificial intelligence for cancer segmentation. Our source codes will be released at https://github.com/SJTUBME-QianLab/ Spiral-Segmentation.</abstract><cop>United States</cop><pub>IEEE</pub><pmid>34383646</pmid><doi>10.1109/TMI.2021.3104460</doi><tpages>13</tpages><orcidid>https://orcid.org/0000-0002-9270-689X</orcidid><orcidid>https://orcid.org/0000-0003-4566-9536</orcidid><orcidid>https://orcid.org/0000-0002-9349-0349</orcidid><orcidid>https://orcid.org/0000-0002-6548-6801</orcidid><orcidid>https://orcid.org/0000-0002-8195-3932</orcidid><orcidid>https://orcid.org/0000-0002-2811-7513</orcidid></addata></record>
fulltext fulltext_linktorsrc
identifier ISSN: 0278-0062
ispartof IEEE transactions on medical imaging, 2022-01, Vol.41 (1), p.75-87
issn 0278-0062
1558-254X
language eng
recordid cdi_proquest_journals_2615511027
source IEEE Electronic Library (IEL)
subjects Algorithms
Artificial Intelligence
Cancer
data augmentation
Deep Learning
Humans
Image Processing, Computer-Assisted
Image segmentation
Imaging, Three-Dimensional
Information processing
Machine learning
Medical imaging
model-driven deep learning
Pancreatic cancer
pancreatic cancer segmentation
Pancreatic Neoplasms - diagnostic imaging
Rebuilding
Regularization
Sampling
Solid modeling
Spiral transformation
Spirals
Teaching methods
Three-dimensional displays
Transformations
Tumors
Two dimensional models
title Model-Driven Deep Learning Method for Pancreatic Cancer Segmentation Based on Spiral-Transformation
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-21T11%3A19%3A30IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Model-Driven%20Deep%20Learning%20Method%20for%20Pancreatic%20Cancer%20Segmentation%20Based%20on%20Spiral-Transformation&rft.jtitle=IEEE%20transactions%20on%20medical%20imaging&rft.au=Chen,%20Xiahan&rft.date=2022-01&rft.volume=41&rft.issue=1&rft.spage=75&rft.epage=87&rft.pages=75-87&rft.issn=0278-0062&rft.eissn=1558-254X&rft.coden=ITMID4&rft_id=info:doi/10.1109/TMI.2021.3104460&rft_dat=%3Cproquest_RIE%3E2561491928%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2615511027&rft_id=info:pmid/34383646&rft_ieee_id=9512056&rfr_iscdi=true