Deep learning-based cardiac cine segmentation: Transfer learning application to 7T ultrahigh-field MRI

Purpose: Artificial neural networks show promising performance in automatic segmentation of cardiac MRI. However, training requires large amounts of annotated data and generalization to different vendors, field strengths, sequence parameters, and pathologies is limited. Transfer learning addresses t...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Magnetic resonance in medicine 2021-10, Vol.86 (4), p.2179-2191
Hauptverfasser: Ankenbrand, Markus Johannes, Lohr, David, Schloetelburg, Wiebke, Reiter, Theresa, Wech, Tobias, Schreiber, Laura Maria
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 2191
container_issue 4
container_start_page 2179
container_title Magnetic resonance in medicine
container_volume 86
creator Ankenbrand, Markus Johannes
Lohr, David
Schloetelburg, Wiebke
Reiter, Theresa
Wech, Tobias
Schreiber, Laura Maria
description Purpose: Artificial neural networks show promising performance in automatic segmentation of cardiac MRI. However, training requires large amounts of annotated data and generalization to different vendors, field strengths, sequence parameters, and pathologies is limited. Transfer learning addresses this challenge, but specific recommendations regarding type and amount of data required is lacking. In this study, we assess data requirements for transfer learning to experimental cardiac MRI at 7T where the segmentation task can be challenging. In addition, we provide guidelines, tools, and annotated data to enable transfer learning approaches by other researchers and clinicians. Methods: A publicly available segmentation model was used to annotate a publicly available data set. This labeled data set was subsequently used to train a neural network for segmentation of left ventricle and myocardium in cardiac cine MRI. The network is used as starting point for transfer learning to 7T cine data of healthy volunteers (n = 22; 7873 images) by updating the pre-trained weights. Structured and random data subsets of different sizes were used to systematically assess data requirements for successful transfer learning. Results: Inconsistencies in the publically available data set were corrected, labels created, and a neural network trained. On 7T cardiac cine images the model pre-trained on public imaging data, acquired at 1.5T and 3T, achieved DICELV = 0.835 and DICEMY = 0.670. Transfer learning using 7T cine data and ImageNet weight initialization improved model performance to DICELV = 0.900 and DICEMY = 0.791. Using only end-systolic and end-diastolic images reduced training data by 90%, with no negative impact on segmentation performance (DICELV = 0.908, DICEMY = 0.805). Conclusions: This work demonstrates and quantifies the benefits of transfer learning for cardiac cine image segmentation. We provide practical guidelines for researchers planning transfer learning projects in cardiac MRI and make data, models, and code publicly available.
doi_str_mv 10.1002/mrm.28822
format Article
fullrecord <record><control><sourceid>webofscience</sourceid><recordid>TN_cdi_webofscience_primary_000755259300030</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>000755259300030</sourcerecordid><originalsourceid>FETCH-webofscience_primary_0007552593000303</originalsourceid><addsrcrecordid>eNqVj01Lw0AYhBdRbFo99B-8d9m6XyFNr37QHnqR3MvbzbvpymYTdiPivzeIePc0AzMPzDC2lmIjhVCPfeo3artV6ooVslSKq7I216wQlRFcy9os2DLndyFEXVfmli20mTEjVcHcM9EIgTBFHzt-xkwtWEytRwvWR4JMXU9xwskPcQdNwpgdpT8EcByDtz8xTANUDXyEKeHFdxfuPIUWjm-HO3bjMGS6_9UVe3h9aZ72_JPOg8vWU7R0GpPvMX2d5qFVWc4n9Oy00P9rfwND41Gh</addsrcrecordid><sourcetype>Index Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Deep learning-based cardiac cine segmentation: Transfer learning application to 7T ultrahigh-field MRI</title><source>Wiley Online Library - AutoHoldings Journals</source><source>Web of Science - Science Citation Index Expanded - 2021&lt;img src="https://exlibris-pub.s3.amazonaws.com/fromwos-v2.jpg" /&gt;</source><creator>Ankenbrand, Markus Johannes ; Lohr, David ; Schloetelburg, Wiebke ; Reiter, Theresa ; Wech, Tobias ; Schreiber, Laura Maria</creator><creatorcontrib>Ankenbrand, Markus Johannes ; Lohr, David ; Schloetelburg, Wiebke ; Reiter, Theresa ; Wech, Tobias ; Schreiber, Laura Maria</creatorcontrib><description>Purpose: Artificial neural networks show promising performance in automatic segmentation of cardiac MRI. However, training requires large amounts of annotated data and generalization to different vendors, field strengths, sequence parameters, and pathologies is limited. Transfer learning addresses this challenge, but specific recommendations regarding type and amount of data required is lacking. In this study, we assess data requirements for transfer learning to experimental cardiac MRI at 7T where the segmentation task can be challenging. In addition, we provide guidelines, tools, and annotated data to enable transfer learning approaches by other researchers and clinicians. Methods: A publicly available segmentation model was used to annotate a publicly available data set. This labeled data set was subsequently used to train a neural network for segmentation of left ventricle and myocardium in cardiac cine MRI. The network is used as starting point for transfer learning to 7T cine data of healthy volunteers (n = 22; 7873 images) by updating the pre-trained weights. Structured and random data subsets of different sizes were used to systematically assess data requirements for successful transfer learning. Results: Inconsistencies in the publically available data set were corrected, labels created, and a neural network trained. On 7T cardiac cine images the model pre-trained on public imaging data, acquired at 1.5T and 3T, achieved DICELV = 0.835 and DICEMY = 0.670. Transfer learning using 7T cine data and ImageNet weight initialization improved model performance to DICELV = 0.900 and DICEMY = 0.791. Using only end-systolic and end-diastolic images reduced training data by 90%, with no negative impact on segmentation performance (DICELV = 0.908, DICEMY = 0.805). Conclusions: This work demonstrates and quantifies the benefits of transfer learning for cardiac cine image segmentation. We provide practical guidelines for researchers planning transfer learning projects in cardiac MRI and make data, models, and code publicly available.</description><identifier>ISSN: 0740-3194</identifier><identifier>EISSN: 1522-2594</identifier><identifier>DOI: 10.1002/mrm.28822</identifier><identifier>PMID: 34002412</identifier><language>eng</language><publisher>HOBOKEN: Wiley</publisher><subject>Life Sciences &amp; Biomedicine ; Radiology, Nuclear Medicine &amp; Medical Imaging ; Science &amp; Technology</subject><ispartof>Magnetic resonance in medicine, 2021-10, Vol.86 (4), p.2179-2191</ispartof><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>true</woscitedreferencessubscribed><cites>FETCH-webofscience_primary_0007552593000303</cites><orcidid>0000-0002-6509-3776 ; 0000-0002-6620-807X ; 0000-0002-8827-1838 ; 0000-0001-8324-1560 ; 0000-0002-2813-7100</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>315,781,785,27929,27930,39263</link.rule.ids></links><search><creatorcontrib>Ankenbrand, Markus Johannes</creatorcontrib><creatorcontrib>Lohr, David</creatorcontrib><creatorcontrib>Schloetelburg, Wiebke</creatorcontrib><creatorcontrib>Reiter, Theresa</creatorcontrib><creatorcontrib>Wech, Tobias</creatorcontrib><creatorcontrib>Schreiber, Laura Maria</creatorcontrib><title>Deep learning-based cardiac cine segmentation: Transfer learning application to 7T ultrahigh-field MRI</title><title>Magnetic resonance in medicine</title><addtitle>MAGN RESON MED</addtitle><description>Purpose: Artificial neural networks show promising performance in automatic segmentation of cardiac MRI. However, training requires large amounts of annotated data and generalization to different vendors, field strengths, sequence parameters, and pathologies is limited. Transfer learning addresses this challenge, but specific recommendations regarding type and amount of data required is lacking. In this study, we assess data requirements for transfer learning to experimental cardiac MRI at 7T where the segmentation task can be challenging. In addition, we provide guidelines, tools, and annotated data to enable transfer learning approaches by other researchers and clinicians. Methods: A publicly available segmentation model was used to annotate a publicly available data set. This labeled data set was subsequently used to train a neural network for segmentation of left ventricle and myocardium in cardiac cine MRI. The network is used as starting point for transfer learning to 7T cine data of healthy volunteers (n = 22; 7873 images) by updating the pre-trained weights. Structured and random data subsets of different sizes were used to systematically assess data requirements for successful transfer learning. Results: Inconsistencies in the publically available data set were corrected, labels created, and a neural network trained. On 7T cardiac cine images the model pre-trained on public imaging data, acquired at 1.5T and 3T, achieved DICELV = 0.835 and DICEMY = 0.670. Transfer learning using 7T cine data and ImageNet weight initialization improved model performance to DICELV = 0.900 and DICEMY = 0.791. Using only end-systolic and end-diastolic images reduced training data by 90%, with no negative impact on segmentation performance (DICELV = 0.908, DICEMY = 0.805). Conclusions: This work demonstrates and quantifies the benefits of transfer learning for cardiac cine image segmentation. We provide practical guidelines for researchers planning transfer learning projects in cardiac MRI and make data, models, and code publicly available.</description><subject>Life Sciences &amp; Biomedicine</subject><subject>Radiology, Nuclear Medicine &amp; Medical Imaging</subject><subject>Science &amp; Technology</subject><issn>0740-3194</issn><issn>1522-2594</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2021</creationdate><recordtype>article</recordtype><sourceid>HGBXW</sourceid><recordid>eNqVj01Lw0AYhBdRbFo99B-8d9m6XyFNr37QHnqR3MvbzbvpymYTdiPivzeIePc0AzMPzDC2lmIjhVCPfeo3artV6ooVslSKq7I216wQlRFcy9os2DLndyFEXVfmli20mTEjVcHcM9EIgTBFHzt-xkwtWEytRwvWR4JMXU9xwskPcQdNwpgdpT8EcByDtz8xTANUDXyEKeHFdxfuPIUWjm-HO3bjMGS6_9UVe3h9aZ72_JPOg8vWU7R0GpPvMX2d5qFVWc4n9Oy00P9rfwND41Gh</recordid><startdate>20211001</startdate><enddate>20211001</enddate><creator>Ankenbrand, Markus Johannes</creator><creator>Lohr, David</creator><creator>Schloetelburg, Wiebke</creator><creator>Reiter, Theresa</creator><creator>Wech, Tobias</creator><creator>Schreiber, Laura Maria</creator><general>Wiley</general><scope>BLEPL</scope><scope>DTL</scope><scope>HGBXW</scope><orcidid>https://orcid.org/0000-0002-6509-3776</orcidid><orcidid>https://orcid.org/0000-0002-6620-807X</orcidid><orcidid>https://orcid.org/0000-0002-8827-1838</orcidid><orcidid>https://orcid.org/0000-0001-8324-1560</orcidid><orcidid>https://orcid.org/0000-0002-2813-7100</orcidid></search><sort><creationdate>20211001</creationdate><title>Deep learning-based cardiac cine segmentation: Transfer learning application to 7T ultrahigh-field MRI</title><author>Ankenbrand, Markus Johannes ; Lohr, David ; Schloetelburg, Wiebke ; Reiter, Theresa ; Wech, Tobias ; Schreiber, Laura Maria</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-webofscience_primary_0007552593000303</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2021</creationdate><topic>Life Sciences &amp; Biomedicine</topic><topic>Radiology, Nuclear Medicine &amp; Medical Imaging</topic><topic>Science &amp; Technology</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Ankenbrand, Markus Johannes</creatorcontrib><creatorcontrib>Lohr, David</creatorcontrib><creatorcontrib>Schloetelburg, Wiebke</creatorcontrib><creatorcontrib>Reiter, Theresa</creatorcontrib><creatorcontrib>Wech, Tobias</creatorcontrib><creatorcontrib>Schreiber, Laura Maria</creatorcontrib><collection>Web of Science Core Collection</collection><collection>Science Citation Index Expanded</collection><collection>Web of Science - Science Citation Index Expanded - 2021</collection><jtitle>Magnetic resonance in medicine</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Ankenbrand, Markus Johannes</au><au>Lohr, David</au><au>Schloetelburg, Wiebke</au><au>Reiter, Theresa</au><au>Wech, Tobias</au><au>Schreiber, Laura Maria</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Deep learning-based cardiac cine segmentation: Transfer learning application to 7T ultrahigh-field MRI</atitle><jtitle>Magnetic resonance in medicine</jtitle><stitle>MAGN RESON MED</stitle><date>2021-10-01</date><risdate>2021</risdate><volume>86</volume><issue>4</issue><spage>2179</spage><epage>2191</epage><pages>2179-2191</pages><issn>0740-3194</issn><eissn>1522-2594</eissn><abstract>Purpose: Artificial neural networks show promising performance in automatic segmentation of cardiac MRI. However, training requires large amounts of annotated data and generalization to different vendors, field strengths, sequence parameters, and pathologies is limited. Transfer learning addresses this challenge, but specific recommendations regarding type and amount of data required is lacking. In this study, we assess data requirements for transfer learning to experimental cardiac MRI at 7T where the segmentation task can be challenging. In addition, we provide guidelines, tools, and annotated data to enable transfer learning approaches by other researchers and clinicians. Methods: A publicly available segmentation model was used to annotate a publicly available data set. This labeled data set was subsequently used to train a neural network for segmentation of left ventricle and myocardium in cardiac cine MRI. The network is used as starting point for transfer learning to 7T cine data of healthy volunteers (n = 22; 7873 images) by updating the pre-trained weights. Structured and random data subsets of different sizes were used to systematically assess data requirements for successful transfer learning. Results: Inconsistencies in the publically available data set were corrected, labels created, and a neural network trained. On 7T cardiac cine images the model pre-trained on public imaging data, acquired at 1.5T and 3T, achieved DICELV = 0.835 and DICEMY = 0.670. Transfer learning using 7T cine data and ImageNet weight initialization improved model performance to DICELV = 0.900 and DICEMY = 0.791. Using only end-systolic and end-diastolic images reduced training data by 90%, with no negative impact on segmentation performance (DICELV = 0.908, DICEMY = 0.805). Conclusions: This work demonstrates and quantifies the benefits of transfer learning for cardiac cine image segmentation. We provide practical guidelines for researchers planning transfer learning projects in cardiac MRI and make data, models, and code publicly available.</abstract><cop>HOBOKEN</cop><pub>Wiley</pub><pmid>34002412</pmid><doi>10.1002/mrm.28822</doi><tpages>13</tpages><orcidid>https://orcid.org/0000-0002-6509-3776</orcidid><orcidid>https://orcid.org/0000-0002-6620-807X</orcidid><orcidid>https://orcid.org/0000-0002-8827-1838</orcidid><orcidid>https://orcid.org/0000-0001-8324-1560</orcidid><orcidid>https://orcid.org/0000-0002-2813-7100</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 0740-3194
ispartof Magnetic resonance in medicine, 2021-10, Vol.86 (4), p.2179-2191
issn 0740-3194
1522-2594
language eng
recordid cdi_webofscience_primary_000755259300030
source Wiley Online Library - AutoHoldings Journals; Web of Science - Science Citation Index Expanded - 2021<img src="https://exlibris-pub.s3.amazonaws.com/fromwos-v2.jpg" />
subjects Life Sciences & Biomedicine
Radiology, Nuclear Medicine & Medical Imaging
Science & Technology
title Deep learning-based cardiac cine segmentation: Transfer learning application to 7T ultrahigh-field MRI
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-13T08%3A10%3A08IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-webofscience&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Deep%20learning-based%20cardiac%20cine%20segmentation:%20Transfer%20learning%20application%20to%207T%20ultrahigh-field%20MRI&rft.jtitle=Magnetic%20resonance%20in%20medicine&rft.au=Ankenbrand,%20Markus%20Johannes&rft.date=2021-10-01&rft.volume=86&rft.issue=4&rft.spage=2179&rft.epage=2191&rft.pages=2179-2191&rft.issn=0740-3194&rft.eissn=1522-2594&rft_id=info:doi/10.1002/mrm.28822&rft_dat=%3Cwebofscience%3E000755259300030%3C/webofscience%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/34002412&rfr_iscdi=true