Model-Driven Deep Learning Method for Pancreatic Cancer Segmentation Based on Spiral-Transformation
Pancreatic cancer is a lethal malignant tumor with one of the worst prognoses. Accurate segmentation of pancreatic cancer is vital in clinical diagnosis and treatment. Due to the unclear boundary and small size of cancers, it is challenging to both manually annotate and automatically segment cancers...
Gespeichert in:
Veröffentlicht in: | IEEE transactions on medical imaging 2022-01, Vol.41 (1), p.75-87 |
---|---|
Hauptverfasser: | , , , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 87 |
---|---|
container_issue | 1 |
container_start_page | 75 |
container_title | IEEE transactions on medical imaging |
container_volume | 41 |
creator | Chen, Xiahan Chen, Zihao Li, Jun Zhang, Yu-Dong Lin, Xiaozhu Qian, Xiaohua |
description | Pancreatic cancer is a lethal malignant tumor with one of the worst prognoses. Accurate segmentation of pancreatic cancer is vital in clinical diagnosis and treatment. Due to the unclear boundary and small size of cancers, it is challenging to both manually annotate and automatically segment cancers. Considering 3D information utilization and small sample sizes, we propose a model-driven deep learning method for pancreatic cancer segmentation based on spiral transformation. Specifically, a spiral-transformation algorithm with uniform sampling was developed to map 3D images onto 2D planes while preserving the spatial relationship between textures, thus addressing the challenge in effectively applying 3D contextual information in a 2D model. This study is the first to introduce spiral transformation in a segmentation task to provide effective data augmentation, alleviating the issue of small sample size. Moreover, a transformation-weight-corrected module was embedded into the deep learning model to unify the entire framework. It can achieve 2D segmentation and corresponding 3D rebuilding constraint to overcome non-unique 3D rebuilding results due to the uniform and dense sampling. A smooth regularization based on rebuilding prior knowledge was also designed to optimize segmentation results. The extensive experiments showed that the proposed method achieved a promising segmentation performance on multi-parametric MRIs, where T2, T1, ADC, DWI images obtained the DSC of 65.6%, 64.0%, 64.5%, 65.3%, respectively. This method can provide a novel paradigm to efficiently apply 3D information and augment sample sizes in the development of artificial intelligence for cancer segmentation. Our source codes will be released at https://github.com/SJTUBME-QianLab/ Spiral-Segmentation. |
doi_str_mv | 10.1109/TMI.2021.3104460 |
format | Article |
fullrecord | <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_proquest_journals_2615511027</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>9512056</ieee_id><sourcerecordid>2561491928</sourcerecordid><originalsourceid>FETCH-LOGICAL-c347t-9368e05f9837ba78587bf777a82488b11d161b8c01d14076eb2eebdd07a02f0a3</originalsourceid><addsrcrecordid>eNpdkc1LHEEQxZuQEFfjXRBCgxcvs6n-7jnG1STCLgpuwFvTM1NjRmZ61u5ZIf-9bXbjwVM_un6vKN4j5ITBnDEov61X13MOnM0FAyk1fCAzppQtuJL3H8kMuLEFgOYH5DClRwAmFZSfyYGQwgot9YzUq7HBvriM3TMGeom4oUv0MXThga5w-jM2tB0jvfWhjuinrqaLLDHSO3wYMEz5awz0widsaBZ3my76vlhHH1L2Df_GX8in1vcJj_fvEfn942q9-FUsb35eL74vi1pIMxWl0BZBtaUVpvLGKmuq1hjjLZfWVow1TLPK1pCFBKOx4ohV04DxwFvw4oic7_Zu4vi0xTS5oUs19r0POG6T40ozWbKS24yevUMfx20M-TrHdY4wp8tNpmBH1XFMKWLrNrEbfPzrGLjXAlwuwL0W4PYFZMvX_eJtNWDzZvifeAZOd0CHiG_jUjEOSosXbOWIcA</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2615511027</pqid></control><display><type>article</type><title>Model-Driven Deep Learning Method for Pancreatic Cancer Segmentation Based on Spiral-Transformation</title><source>IEEE Electronic Library (IEL)</source><creator>Chen, Xiahan ; Chen, Zihao ; Li, Jun ; Zhang, Yu-Dong ; Lin, Xiaozhu ; Qian, Xiaohua</creator><creatorcontrib>Chen, Xiahan ; Chen, Zihao ; Li, Jun ; Zhang, Yu-Dong ; Lin, Xiaozhu ; Qian, Xiaohua</creatorcontrib><description>Pancreatic cancer is a lethal malignant tumor with one of the worst prognoses. Accurate segmentation of pancreatic cancer is vital in clinical diagnosis and treatment. Due to the unclear boundary and small size of cancers, it is challenging to both manually annotate and automatically segment cancers. Considering 3D information utilization and small sample sizes, we propose a model-driven deep learning method for pancreatic cancer segmentation based on spiral transformation. Specifically, a spiral-transformation algorithm with uniform sampling was developed to map 3D images onto 2D planes while preserving the spatial relationship between textures, thus addressing the challenge in effectively applying 3D contextual information in a 2D model. This study is the first to introduce spiral transformation in a segmentation task to provide effective data augmentation, alleviating the issue of small sample size. Moreover, a transformation-weight-corrected module was embedded into the deep learning model to unify the entire framework. It can achieve 2D segmentation and corresponding 3D rebuilding constraint to overcome non-unique 3D rebuilding results due to the uniform and dense sampling. A smooth regularization based on rebuilding prior knowledge was also designed to optimize segmentation results. The extensive experiments showed that the proposed method achieved a promising segmentation performance on multi-parametric MRIs, where T2, T1, ADC, DWI images obtained the DSC of 65.6%, 64.0%, 64.5%, 65.3%, respectively. This method can provide a novel paradigm to efficiently apply 3D information and augment sample sizes in the development of artificial intelligence for cancer segmentation. Our source codes will be released at https://github.com/SJTUBME-QianLab/ Spiral-Segmentation.</description><identifier>ISSN: 0278-0062</identifier><identifier>EISSN: 1558-254X</identifier><identifier>DOI: 10.1109/TMI.2021.3104460</identifier><identifier>PMID: 34383646</identifier><identifier>CODEN: ITMID4</identifier><language>eng</language><publisher>United States: IEEE</publisher><subject>Algorithms ; Artificial Intelligence ; Cancer ; data augmentation ; Deep Learning ; Humans ; Image Processing, Computer-Assisted ; Image segmentation ; Imaging, Three-Dimensional ; Information processing ; Machine learning ; Medical imaging ; model-driven deep learning ; Pancreatic cancer ; pancreatic cancer segmentation ; Pancreatic Neoplasms - diagnostic imaging ; Rebuilding ; Regularization ; Sampling ; Solid modeling ; Spiral transformation ; Spirals ; Teaching methods ; Three-dimensional displays ; Transformations ; Tumors ; Two dimensional models</subject><ispartof>IEEE transactions on medical imaging, 2022-01, Vol.41 (1), p.75-87</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2022</rights><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c347t-9368e05f9837ba78587bf777a82488b11d161b8c01d14076eb2eebdd07a02f0a3</citedby><cites>FETCH-LOGICAL-c347t-9368e05f9837ba78587bf777a82488b11d161b8c01d14076eb2eebdd07a02f0a3</cites><orcidid>0000-0002-9270-689X ; 0000-0003-4566-9536 ; 0000-0002-9349-0349 ; 0000-0002-6548-6801 ; 0000-0002-8195-3932 ; 0000-0002-2811-7513</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/9512056$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,776,780,792,27903,27904,54737</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/9512056$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/34383646$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Chen, Xiahan</creatorcontrib><creatorcontrib>Chen, Zihao</creatorcontrib><creatorcontrib>Li, Jun</creatorcontrib><creatorcontrib>Zhang, Yu-Dong</creatorcontrib><creatorcontrib>Lin, Xiaozhu</creatorcontrib><creatorcontrib>Qian, Xiaohua</creatorcontrib><title>Model-Driven Deep Learning Method for Pancreatic Cancer Segmentation Based on Spiral-Transformation</title><title>IEEE transactions on medical imaging</title><addtitle>TMI</addtitle><addtitle>IEEE Trans Med Imaging</addtitle><description>Pancreatic cancer is a lethal malignant tumor with one of the worst prognoses. Accurate segmentation of pancreatic cancer is vital in clinical diagnosis and treatment. Due to the unclear boundary and small size of cancers, it is challenging to both manually annotate and automatically segment cancers. Considering 3D information utilization and small sample sizes, we propose a model-driven deep learning method for pancreatic cancer segmentation based on spiral transformation. Specifically, a spiral-transformation algorithm with uniform sampling was developed to map 3D images onto 2D planes while preserving the spatial relationship between textures, thus addressing the challenge in effectively applying 3D contextual information in a 2D model. This study is the first to introduce spiral transformation in a segmentation task to provide effective data augmentation, alleviating the issue of small sample size. Moreover, a transformation-weight-corrected module was embedded into the deep learning model to unify the entire framework. It can achieve 2D segmentation and corresponding 3D rebuilding constraint to overcome non-unique 3D rebuilding results due to the uniform and dense sampling. A smooth regularization based on rebuilding prior knowledge was also designed to optimize segmentation results. The extensive experiments showed that the proposed method achieved a promising segmentation performance on multi-parametric MRIs, where T2, T1, ADC, DWI images obtained the DSC of 65.6%, 64.0%, 64.5%, 65.3%, respectively. This method can provide a novel paradigm to efficiently apply 3D information and augment sample sizes in the development of artificial intelligence for cancer segmentation. Our source codes will be released at https://github.com/SJTUBME-QianLab/ Spiral-Segmentation.</description><subject>Algorithms</subject><subject>Artificial Intelligence</subject><subject>Cancer</subject><subject>data augmentation</subject><subject>Deep Learning</subject><subject>Humans</subject><subject>Image Processing, Computer-Assisted</subject><subject>Image segmentation</subject><subject>Imaging, Three-Dimensional</subject><subject>Information processing</subject><subject>Machine learning</subject><subject>Medical imaging</subject><subject>model-driven deep learning</subject><subject>Pancreatic cancer</subject><subject>pancreatic cancer segmentation</subject><subject>Pancreatic Neoplasms - diagnostic imaging</subject><subject>Rebuilding</subject><subject>Regularization</subject><subject>Sampling</subject><subject>Solid modeling</subject><subject>Spiral transformation</subject><subject>Spirals</subject><subject>Teaching methods</subject><subject>Three-dimensional displays</subject><subject>Transformations</subject><subject>Tumors</subject><subject>Two dimensional models</subject><issn>0278-0062</issn><issn>1558-254X</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><sourceid>EIF</sourceid><recordid>eNpdkc1LHEEQxZuQEFfjXRBCgxcvs6n-7jnG1STCLgpuwFvTM1NjRmZ61u5ZIf-9bXbjwVM_un6vKN4j5ITBnDEov61X13MOnM0FAyk1fCAzppQtuJL3H8kMuLEFgOYH5DClRwAmFZSfyYGQwgot9YzUq7HBvriM3TMGeom4oUv0MXThga5w-jM2tB0jvfWhjuinrqaLLDHSO3wYMEz5awz0widsaBZ3my76vlhHH1L2Df_GX8in1vcJj_fvEfn942q9-FUsb35eL74vi1pIMxWl0BZBtaUVpvLGKmuq1hjjLZfWVow1TLPK1pCFBKOx4ohV04DxwFvw4oic7_Zu4vi0xTS5oUs19r0POG6T40ozWbKS24yevUMfx20M-TrHdY4wp8tNpmBH1XFMKWLrNrEbfPzrGLjXAlwuwL0W4PYFZMvX_eJtNWDzZvifeAZOd0CHiG_jUjEOSosXbOWIcA</recordid><startdate>202201</startdate><enddate>202201</enddate><creator>Chen, Xiahan</creator><creator>Chen, Zihao</creator><creator>Li, Jun</creator><creator>Zhang, Yu-Dong</creator><creator>Lin, Xiaozhu</creator><creator>Qian, Xiaohua</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7QF</scope><scope>7QO</scope><scope>7QQ</scope><scope>7SC</scope><scope>7SE</scope><scope>7SP</scope><scope>7SR</scope><scope>7TA</scope><scope>7TB</scope><scope>7U5</scope><scope>8BQ</scope><scope>8FD</scope><scope>F28</scope><scope>FR3</scope><scope>H8D</scope><scope>JG9</scope><scope>JQ2</scope><scope>KR7</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>NAPCQ</scope><scope>P64</scope><scope>7X8</scope><orcidid>https://orcid.org/0000-0002-9270-689X</orcidid><orcidid>https://orcid.org/0000-0003-4566-9536</orcidid><orcidid>https://orcid.org/0000-0002-9349-0349</orcidid><orcidid>https://orcid.org/0000-0002-6548-6801</orcidid><orcidid>https://orcid.org/0000-0002-8195-3932</orcidid><orcidid>https://orcid.org/0000-0002-2811-7513</orcidid></search><sort><creationdate>202201</creationdate><title>Model-Driven Deep Learning Method for Pancreatic Cancer Segmentation Based on Spiral-Transformation</title><author>Chen, Xiahan ; Chen, Zihao ; Li, Jun ; Zhang, Yu-Dong ; Lin, Xiaozhu ; Qian, Xiaohua</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c347t-9368e05f9837ba78587bf777a82488b11d161b8c01d14076eb2eebdd07a02f0a3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>Algorithms</topic><topic>Artificial Intelligence</topic><topic>Cancer</topic><topic>data augmentation</topic><topic>Deep Learning</topic><topic>Humans</topic><topic>Image Processing, Computer-Assisted</topic><topic>Image segmentation</topic><topic>Imaging, Three-Dimensional</topic><topic>Information processing</topic><topic>Machine learning</topic><topic>Medical imaging</topic><topic>model-driven deep learning</topic><topic>Pancreatic cancer</topic><topic>pancreatic cancer segmentation</topic><topic>Pancreatic Neoplasms - diagnostic imaging</topic><topic>Rebuilding</topic><topic>Regularization</topic><topic>Sampling</topic><topic>Solid modeling</topic><topic>Spiral transformation</topic><topic>Spirals</topic><topic>Teaching methods</topic><topic>Three-dimensional displays</topic><topic>Transformations</topic><topic>Tumors</topic><topic>Two dimensional models</topic><toplevel>online_resources</toplevel><creatorcontrib>Chen, Xiahan</creatorcontrib><creatorcontrib>Chen, Zihao</creatorcontrib><creatorcontrib>Li, Jun</creatorcontrib><creatorcontrib>Zhang, Yu-Dong</creatorcontrib><creatorcontrib>Lin, Xiaozhu</creatorcontrib><creatorcontrib>Qian, Xiaohua</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>Aluminium Industry Abstracts</collection><collection>Biotechnology Research Abstracts</collection><collection>Ceramic Abstracts</collection><collection>Computer and Information Systems Abstracts</collection><collection>Corrosion Abstracts</collection><collection>Electronics & Communications Abstracts</collection><collection>Engineered Materials Abstracts</collection><collection>Materials Business File</collection><collection>Mechanical & Transportation Engineering Abstracts</collection><collection>Solid State and Superconductivity Abstracts</collection><collection>METADEX</collection><collection>Technology Research Database</collection><collection>ANTE: Abstracts in New Technology & Engineering</collection><collection>Engineering Research Database</collection><collection>Aerospace Database</collection><collection>Materials Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Civil Engineering Abstracts</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>Nursing & Allied Health Premium</collection><collection>Biotechnology and BioEngineering Abstracts</collection><collection>MEDLINE - Academic</collection><jtitle>IEEE transactions on medical imaging</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Chen, Xiahan</au><au>Chen, Zihao</au><au>Li, Jun</au><au>Zhang, Yu-Dong</au><au>Lin, Xiaozhu</au><au>Qian, Xiaohua</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Model-Driven Deep Learning Method for Pancreatic Cancer Segmentation Based on Spiral-Transformation</atitle><jtitle>IEEE transactions on medical imaging</jtitle><stitle>TMI</stitle><addtitle>IEEE Trans Med Imaging</addtitle><date>2022-01</date><risdate>2022</risdate><volume>41</volume><issue>1</issue><spage>75</spage><epage>87</epage><pages>75-87</pages><issn>0278-0062</issn><eissn>1558-254X</eissn><coden>ITMID4</coden><abstract>Pancreatic cancer is a lethal malignant tumor with one of the worst prognoses. Accurate segmentation of pancreatic cancer is vital in clinical diagnosis and treatment. Due to the unclear boundary and small size of cancers, it is challenging to both manually annotate and automatically segment cancers. Considering 3D information utilization and small sample sizes, we propose a model-driven deep learning method for pancreatic cancer segmentation based on spiral transformation. Specifically, a spiral-transformation algorithm with uniform sampling was developed to map 3D images onto 2D planes while preserving the spatial relationship between textures, thus addressing the challenge in effectively applying 3D contextual information in a 2D model. This study is the first to introduce spiral transformation in a segmentation task to provide effective data augmentation, alleviating the issue of small sample size. Moreover, a transformation-weight-corrected module was embedded into the deep learning model to unify the entire framework. It can achieve 2D segmentation and corresponding 3D rebuilding constraint to overcome non-unique 3D rebuilding results due to the uniform and dense sampling. A smooth regularization based on rebuilding prior knowledge was also designed to optimize segmentation results. The extensive experiments showed that the proposed method achieved a promising segmentation performance on multi-parametric MRIs, where T2, T1, ADC, DWI images obtained the DSC of 65.6%, 64.0%, 64.5%, 65.3%, respectively. This method can provide a novel paradigm to efficiently apply 3D information and augment sample sizes in the development of artificial intelligence for cancer segmentation. Our source codes will be released at https://github.com/SJTUBME-QianLab/ Spiral-Segmentation.</abstract><cop>United States</cop><pub>IEEE</pub><pmid>34383646</pmid><doi>10.1109/TMI.2021.3104460</doi><tpages>13</tpages><orcidid>https://orcid.org/0000-0002-9270-689X</orcidid><orcidid>https://orcid.org/0000-0003-4566-9536</orcidid><orcidid>https://orcid.org/0000-0002-9349-0349</orcidid><orcidid>https://orcid.org/0000-0002-6548-6801</orcidid><orcidid>https://orcid.org/0000-0002-8195-3932</orcidid><orcidid>https://orcid.org/0000-0002-2811-7513</orcidid></addata></record> |
fulltext | fulltext_linktorsrc |
identifier | ISSN: 0278-0062 |
ispartof | IEEE transactions on medical imaging, 2022-01, Vol.41 (1), p.75-87 |
issn | 0278-0062 1558-254X |
language | eng |
recordid | cdi_proquest_journals_2615511027 |
source | IEEE Electronic Library (IEL) |
subjects | Algorithms Artificial Intelligence Cancer data augmentation Deep Learning Humans Image Processing, Computer-Assisted Image segmentation Imaging, Three-Dimensional Information processing Machine learning Medical imaging model-driven deep learning Pancreatic cancer pancreatic cancer segmentation Pancreatic Neoplasms - diagnostic imaging Rebuilding Regularization Sampling Solid modeling Spiral transformation Spirals Teaching methods Three-dimensional displays Transformations Tumors Two dimensional models |
title | Model-Driven Deep Learning Method for Pancreatic Cancer Segmentation Based on Spiral-Transformation |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-21T11%3A19%3A30IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Model-Driven%20Deep%20Learning%20Method%20for%20Pancreatic%20Cancer%20Segmentation%20Based%20on%20Spiral-Transformation&rft.jtitle=IEEE%20transactions%20on%20medical%20imaging&rft.au=Chen,%20Xiahan&rft.date=2022-01&rft.volume=41&rft.issue=1&rft.spage=75&rft.epage=87&rft.pages=75-87&rft.issn=0278-0062&rft.eissn=1558-254X&rft.coden=ITMID4&rft_id=info:doi/10.1109/TMI.2021.3104460&rft_dat=%3Cproquest_RIE%3E2561491928%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2615511027&rft_id=info:pmid/34383646&rft_ieee_id=9512056&rfr_iscdi=true |