Multi-Mask Self-Supervised Learning for Physics-Guided Neural Networks in Highly Accelerated MRI

Self-supervised learning has shown great promise due to its capability to train deep learning MRI reconstruction methods without fully-sampled data. Current self-supervised learning methods for physics-guided reconstruction networks split acquired undersampled data into two disjoint sets, where one...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:arXiv.org 2022-06
Hauptverfasser: Yaman, Burhaneddin, Gu, Hongyi, Seyed Amir Hossein Hosseini, Demirel, Omer Burak, Moeller, Steen, Ellermann, Jutta, Uğurbil, Kâmil, Akçakaya, Mehmet
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title arXiv.org
container_volume
creator Yaman, Burhaneddin
Gu, Hongyi
Seyed Amir Hossein Hosseini
Demirel, Omer Burak
Moeller, Steen
Ellermann, Jutta
Uğurbil, Kâmil
Akçakaya, Mehmet
description Self-supervised learning has shown great promise due to its capability to train deep learning MRI reconstruction methods without fully-sampled data. Current self-supervised learning methods for physics-guided reconstruction networks split acquired undersampled data into two disjoint sets, where one is used for data consistency (DC) in the unrolled network and the other to define the training loss. In this study, we propose an improved self-supervised learning strategy that more efficiently uses the acquired data to train a physics-guided reconstruction network without a database of fully-sampled data. The proposed multi-mask self-supervised learning via data undersampling (SSDU) applies a hold-out masking operation on acquired measurements to split it into multiple pairs of disjoint sets for each training sample, while using one of these pairs for DC units and the other for defining loss, thereby more efficiently using the undersampled data. Multi-mask SSDU is applied on fully-sampled 3D knee and prospectively undersampled 3D brain MRI datasets, for various acceleration rates and patterns, and compared to CG-SENSE and single-mask SSDU DL-MRI, as well as supervised DL-MRI when fully-sampled data is available. Results on knee MRI show that the proposed multi-mask SSDU outperforms SSDU and performs closely with supervised DL-MRI. A clinical reader study further ranks the multi-mask SSDU higher than supervised DL-MRI in terms of SNR and aliasing artifacts. Results on brain MRI show that multi-mask SSDU achieves better reconstruction quality compared to SSDU. Reader study demonstrates that multi-mask SSDU at R=8 significantly improves reconstruction compared to single-mask SSDU at R=8, as well as CG-SENSE at R=2.
doi_str_mv 10.48550/arxiv.2008.06029
format Article
fullrecord <record><control><sourceid>proquest_arxiv</sourceid><recordid>TN_cdi_arxiv_primary_2008_06029</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2434147408</sourcerecordid><originalsourceid>FETCH-LOGICAL-a528-db240761ade1e43e9230e20263f91e0dc0c05211f36eea2895f62e345317991d3</originalsourceid><addsrcrecordid>eNotkE9PwkAUxDcmJhLkA3iyiefFt293--dIiAIJqBHudW1fYaG2uNuCfHsreJrD_DKZGcbuBAxVrDU8GvdjD0MEiIcQAiZXrIdSCh4rxBs28H4LABhGqLXssY9FWzaWL4zfBUsqC75s9-QO1lMezMm4ylbroKhd8LY5eZt5Pmlt3nkv1DpTdtIca7fzga2CqV1vylMwyjIqyZmmoxbvs1t2XZjS0-Bf-2z1_LQaT_n8dTIbj-bcaIx5_okKolCYnAQpSQlKIOxqyiIRBHkGGWgUopAhkcE40UWIJJWWIkoSkcs-u7_Enuene2e_jDulfzek5xs64uFC7F393ZJv0m3duqrrlKKSSqhIQSx_AU9SXt0</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2434147408</pqid></control><display><type>article</type><title>Multi-Mask Self-Supervised Learning for Physics-Guided Neural Networks in Highly Accelerated MRI</title><source>arXiv.org</source><source>Free E- Journals</source><creator>Yaman, Burhaneddin ; Gu, Hongyi ; Seyed Amir Hossein Hosseini ; Demirel, Omer Burak ; Moeller, Steen ; Ellermann, Jutta ; Uğurbil, Kâmil ; Akçakaya, Mehmet</creator><creatorcontrib>Yaman, Burhaneddin ; Gu, Hongyi ; Seyed Amir Hossein Hosseini ; Demirel, Omer Burak ; Moeller, Steen ; Ellermann, Jutta ; Uğurbil, Kâmil ; Akçakaya, Mehmet</creatorcontrib><description>Self-supervised learning has shown great promise due to its capability to train deep learning MRI reconstruction methods without fully-sampled data. Current self-supervised learning methods for physics-guided reconstruction networks split acquired undersampled data into two disjoint sets, where one is used for data consistency (DC) in the unrolled network and the other to define the training loss. In this study, we propose an improved self-supervised learning strategy that more efficiently uses the acquired data to train a physics-guided reconstruction network without a database of fully-sampled data. The proposed multi-mask self-supervised learning via data undersampling (SSDU) applies a hold-out masking operation on acquired measurements to split it into multiple pairs of disjoint sets for each training sample, while using one of these pairs for DC units and the other for defining loss, thereby more efficiently using the undersampled data. Multi-mask SSDU is applied on fully-sampled 3D knee and prospectively undersampled 3D brain MRI datasets, for various acceleration rates and patterns, and compared to CG-SENSE and single-mask SSDU DL-MRI, as well as supervised DL-MRI when fully-sampled data is available. Results on knee MRI show that the proposed multi-mask SSDU outperforms SSDU and performs closely with supervised DL-MRI. A clinical reader study further ranks the multi-mask SSDU higher than supervised DL-MRI in terms of SNR and aliasing artifacts. Results on brain MRI show that multi-mask SSDU achieves better reconstruction quality compared to SSDU. Reader study demonstrates that multi-mask SSDU at R=8 significantly improves reconstruction compared to single-mask SSDU at R=8, as well as CG-SENSE at R=2.</description><identifier>EISSN: 2331-8422</identifier><identifier>DOI: 10.48550/arxiv.2008.06029</identifier><language>eng</language><publisher>Ithaca: Cornell University Library, arXiv.org</publisher><subject>Brain ; Computer Science - Computer Vision and Pattern Recognition ; Computer Science - Learning ; Data acquisition ; Deep learning ; Image reconstruction ; Knee ; Magnetic resonance imaging ; Neural networks ; Physics - Medical Physics ; Sampled data ; Self-supervised learning ; Training</subject><ispartof>arXiv.org, 2022-06</ispartof><rights>2022. This work is published under http://arxiv.org/licenses/nonexclusive-distrib/1.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><rights>http://arxiv.org/licenses/nonexclusive-distrib/1.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,780,784,885,27925</link.rule.ids><backlink>$$Uhttps://doi.org/10.1002/nbm.4798$$DView published paper (Access to full text may be restricted)$$Hfree_for_read</backlink><backlink>$$Uhttps://doi.org/10.48550/arXiv.2008.06029$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Yaman, Burhaneddin</creatorcontrib><creatorcontrib>Gu, Hongyi</creatorcontrib><creatorcontrib>Seyed Amir Hossein Hosseini</creatorcontrib><creatorcontrib>Demirel, Omer Burak</creatorcontrib><creatorcontrib>Moeller, Steen</creatorcontrib><creatorcontrib>Ellermann, Jutta</creatorcontrib><creatorcontrib>Uğurbil, Kâmil</creatorcontrib><creatorcontrib>Akçakaya, Mehmet</creatorcontrib><title>Multi-Mask Self-Supervised Learning for Physics-Guided Neural Networks in Highly Accelerated MRI</title><title>arXiv.org</title><description>Self-supervised learning has shown great promise due to its capability to train deep learning MRI reconstruction methods without fully-sampled data. Current self-supervised learning methods for physics-guided reconstruction networks split acquired undersampled data into two disjoint sets, where one is used for data consistency (DC) in the unrolled network and the other to define the training loss. In this study, we propose an improved self-supervised learning strategy that more efficiently uses the acquired data to train a physics-guided reconstruction network without a database of fully-sampled data. The proposed multi-mask self-supervised learning via data undersampling (SSDU) applies a hold-out masking operation on acquired measurements to split it into multiple pairs of disjoint sets for each training sample, while using one of these pairs for DC units and the other for defining loss, thereby more efficiently using the undersampled data. Multi-mask SSDU is applied on fully-sampled 3D knee and prospectively undersampled 3D brain MRI datasets, for various acceleration rates and patterns, and compared to CG-SENSE and single-mask SSDU DL-MRI, as well as supervised DL-MRI when fully-sampled data is available. Results on knee MRI show that the proposed multi-mask SSDU outperforms SSDU and performs closely with supervised DL-MRI. A clinical reader study further ranks the multi-mask SSDU higher than supervised DL-MRI in terms of SNR and aliasing artifacts. Results on brain MRI show that multi-mask SSDU achieves better reconstruction quality compared to SSDU. Reader study demonstrates that multi-mask SSDU at R=8 significantly improves reconstruction compared to single-mask SSDU at R=8, as well as CG-SENSE at R=2.</description><subject>Brain</subject><subject>Computer Science - Computer Vision and Pattern Recognition</subject><subject>Computer Science - Learning</subject><subject>Data acquisition</subject><subject>Deep learning</subject><subject>Image reconstruction</subject><subject>Knee</subject><subject>Magnetic resonance imaging</subject><subject>Neural networks</subject><subject>Physics - Medical Physics</subject><subject>Sampled data</subject><subject>Self-supervised learning</subject><subject>Training</subject><issn>2331-8422</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><sourceid>ABUWG</sourceid><sourceid>AFKRA</sourceid><sourceid>AZQEC</sourceid><sourceid>BENPR</sourceid><sourceid>CCPQU</sourceid><sourceid>DWQXO</sourceid><sourceid>GOX</sourceid><recordid>eNotkE9PwkAUxDcmJhLkA3iyiefFt293--dIiAIJqBHudW1fYaG2uNuCfHsreJrD_DKZGcbuBAxVrDU8GvdjD0MEiIcQAiZXrIdSCh4rxBs28H4LABhGqLXssY9FWzaWL4zfBUsqC75s9-QO1lMezMm4ylbroKhd8LY5eZt5Pmlt3nkv1DpTdtIca7fzga2CqV1vylMwyjIqyZmmoxbvs1t2XZjS0-Bf-2z1_LQaT_n8dTIbj-bcaIx5_okKolCYnAQpSQlKIOxqyiIRBHkGGWgUopAhkcE40UWIJJWWIkoSkcs-u7_Enuene2e_jDulfzek5xs64uFC7F393ZJv0m3duqrrlKKSSqhIQSx_AU9SXt0</recordid><startdate>20220609</startdate><enddate>20220609</enddate><creator>Yaman, Burhaneddin</creator><creator>Gu, Hongyi</creator><creator>Seyed Amir Hossein Hosseini</creator><creator>Demirel, Omer Burak</creator><creator>Moeller, Steen</creator><creator>Ellermann, Jutta</creator><creator>Uğurbil, Kâmil</creator><creator>Akçakaya, Mehmet</creator><general>Cornell University Library, arXiv.org</general><scope>8FE</scope><scope>8FG</scope><scope>ABJCF</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>HCIFZ</scope><scope>L6V</scope><scope>M7S</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>PTHSS</scope><scope>AKY</scope><scope>GOX</scope></search><sort><creationdate>20220609</creationdate><title>Multi-Mask Self-Supervised Learning for Physics-Guided Neural Networks in Highly Accelerated MRI</title><author>Yaman, Burhaneddin ; Gu, Hongyi ; Seyed Amir Hossein Hosseini ; Demirel, Omer Burak ; Moeller, Steen ; Ellermann, Jutta ; Uğurbil, Kâmil ; Akçakaya, Mehmet</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a528-db240761ade1e43e9230e20263f91e0dc0c05211f36eea2895f62e345317991d3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>Brain</topic><topic>Computer Science - Computer Vision and Pattern Recognition</topic><topic>Computer Science - Learning</topic><topic>Data acquisition</topic><topic>Deep learning</topic><topic>Image reconstruction</topic><topic>Knee</topic><topic>Magnetic resonance imaging</topic><topic>Neural networks</topic><topic>Physics - Medical Physics</topic><topic>Sampled data</topic><topic>Self-supervised learning</topic><topic>Training</topic><toplevel>online_resources</toplevel><creatorcontrib>Yaman, Burhaneddin</creatorcontrib><creatorcontrib>Gu, Hongyi</creatorcontrib><creatorcontrib>Seyed Amir Hossein Hosseini</creatorcontrib><creatorcontrib>Demirel, Omer Burak</creatorcontrib><creatorcontrib>Moeller, Steen</creatorcontrib><creatorcontrib>Ellermann, Jutta</creatorcontrib><creatorcontrib>Uğurbil, Kâmil</creatorcontrib><creatorcontrib>Akçakaya, Mehmet</creatorcontrib><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>Materials Science &amp; Engineering Collection</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Engineering Collection</collection><collection>Engineering Database</collection><collection>Publicly Available Content Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>Engineering Collection</collection><collection>arXiv Computer Science</collection><collection>arXiv.org</collection><jtitle>arXiv.org</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Yaman, Burhaneddin</au><au>Gu, Hongyi</au><au>Seyed Amir Hossein Hosseini</au><au>Demirel, Omer Burak</au><au>Moeller, Steen</au><au>Ellermann, Jutta</au><au>Uğurbil, Kâmil</au><au>Akçakaya, Mehmet</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Multi-Mask Self-Supervised Learning for Physics-Guided Neural Networks in Highly Accelerated MRI</atitle><jtitle>arXiv.org</jtitle><date>2022-06-09</date><risdate>2022</risdate><eissn>2331-8422</eissn><abstract>Self-supervised learning has shown great promise due to its capability to train deep learning MRI reconstruction methods without fully-sampled data. Current self-supervised learning methods for physics-guided reconstruction networks split acquired undersampled data into two disjoint sets, where one is used for data consistency (DC) in the unrolled network and the other to define the training loss. In this study, we propose an improved self-supervised learning strategy that more efficiently uses the acquired data to train a physics-guided reconstruction network without a database of fully-sampled data. The proposed multi-mask self-supervised learning via data undersampling (SSDU) applies a hold-out masking operation on acquired measurements to split it into multiple pairs of disjoint sets for each training sample, while using one of these pairs for DC units and the other for defining loss, thereby more efficiently using the undersampled data. Multi-mask SSDU is applied on fully-sampled 3D knee and prospectively undersampled 3D brain MRI datasets, for various acceleration rates and patterns, and compared to CG-SENSE and single-mask SSDU DL-MRI, as well as supervised DL-MRI when fully-sampled data is available. Results on knee MRI show that the proposed multi-mask SSDU outperforms SSDU and performs closely with supervised DL-MRI. A clinical reader study further ranks the multi-mask SSDU higher than supervised DL-MRI in terms of SNR and aliasing artifacts. Results on brain MRI show that multi-mask SSDU achieves better reconstruction quality compared to SSDU. Reader study demonstrates that multi-mask SSDU at R=8 significantly improves reconstruction compared to single-mask SSDU at R=8, as well as CG-SENSE at R=2.</abstract><cop>Ithaca</cop><pub>Cornell University Library, arXiv.org</pub><doi>10.48550/arxiv.2008.06029</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier EISSN: 2331-8422
ispartof arXiv.org, 2022-06
issn 2331-8422
language eng
recordid cdi_arxiv_primary_2008_06029
source arXiv.org; Free E- Journals
subjects Brain
Computer Science - Computer Vision and Pattern Recognition
Computer Science - Learning
Data acquisition
Deep learning
Image reconstruction
Knee
Magnetic resonance imaging
Neural networks
Physics - Medical Physics
Sampled data
Self-supervised learning
Training
title Multi-Mask Self-Supervised Learning for Physics-Guided Neural Networks in Highly Accelerated MRI
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-19T04%3A59%3A02IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_arxiv&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Multi-Mask%20Self-Supervised%20Learning%20for%20Physics-Guided%20Neural%20Networks%20in%20Highly%20Accelerated%20MRI&rft.jtitle=arXiv.org&rft.au=Yaman,%20Burhaneddin&rft.date=2022-06-09&rft.eissn=2331-8422&rft_id=info:doi/10.48550/arxiv.2008.06029&rft_dat=%3Cproquest_arxiv%3E2434147408%3C/proquest_arxiv%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2434147408&rft_id=info:pmid/&rfr_iscdi=true