Multi-Mask Self-Supervised Learning for Physics-Guided Neural Networks in Highly Accelerated MRI
Self-supervised learning has shown great promise due to its capability to train deep learning MRI reconstruction methods without fully-sampled data. Current self-supervised learning methods for physics-guided reconstruction networks split acquired undersampled data into two disjoint sets, where one...
Gespeichert in:
Veröffentlicht in: | arXiv.org 2022-06 |
---|---|
Hauptverfasser: | , , , , , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | |
---|---|
container_issue | |
container_start_page | |
container_title | arXiv.org |
container_volume | |
creator | Yaman, Burhaneddin Gu, Hongyi Seyed Amir Hossein Hosseini Demirel, Omer Burak Moeller, Steen Ellermann, Jutta Uğurbil, Kâmil Akçakaya, Mehmet |
description | Self-supervised learning has shown great promise due to its capability to train deep learning MRI reconstruction methods without fully-sampled data. Current self-supervised learning methods for physics-guided reconstruction networks split acquired undersampled data into two disjoint sets, where one is used for data consistency (DC) in the unrolled network and the other to define the training loss. In this study, we propose an improved self-supervised learning strategy that more efficiently uses the acquired data to train a physics-guided reconstruction network without a database of fully-sampled data. The proposed multi-mask self-supervised learning via data undersampling (SSDU) applies a hold-out masking operation on acquired measurements to split it into multiple pairs of disjoint sets for each training sample, while using one of these pairs for DC units and the other for defining loss, thereby more efficiently using the undersampled data. Multi-mask SSDU is applied on fully-sampled 3D knee and prospectively undersampled 3D brain MRI datasets, for various acceleration rates and patterns, and compared to CG-SENSE and single-mask SSDU DL-MRI, as well as supervised DL-MRI when fully-sampled data is available. Results on knee MRI show that the proposed multi-mask SSDU outperforms SSDU and performs closely with supervised DL-MRI. A clinical reader study further ranks the multi-mask SSDU higher than supervised DL-MRI in terms of SNR and aliasing artifacts. Results on brain MRI show that multi-mask SSDU achieves better reconstruction quality compared to SSDU. Reader study demonstrates that multi-mask SSDU at R=8 significantly improves reconstruction compared to single-mask SSDU at R=8, as well as CG-SENSE at R=2. |
doi_str_mv | 10.48550/arxiv.2008.06029 |
format | Article |
fullrecord | <record><control><sourceid>proquest_arxiv</sourceid><recordid>TN_cdi_arxiv_primary_2008_06029</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2434147408</sourcerecordid><originalsourceid>FETCH-LOGICAL-a528-db240761ade1e43e9230e20263f91e0dc0c05211f36eea2895f62e345317991d3</originalsourceid><addsrcrecordid>eNotkE9PwkAUxDcmJhLkA3iyiefFt293--dIiAIJqBHudW1fYaG2uNuCfHsreJrD_DKZGcbuBAxVrDU8GvdjD0MEiIcQAiZXrIdSCh4rxBs28H4LABhGqLXssY9FWzaWL4zfBUsqC75s9-QO1lMezMm4ylbroKhd8LY5eZt5Pmlt3nkv1DpTdtIca7fzga2CqV1vylMwyjIqyZmmoxbvs1t2XZjS0-Bf-2z1_LQaT_n8dTIbj-bcaIx5_okKolCYnAQpSQlKIOxqyiIRBHkGGWgUopAhkcE40UWIJJWWIkoSkcs-u7_Enuene2e_jDulfzek5xs64uFC7F393ZJv0m3duqrrlKKSSqhIQSx_AU9SXt0</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2434147408</pqid></control><display><type>article</type><title>Multi-Mask Self-Supervised Learning for Physics-Guided Neural Networks in Highly Accelerated MRI</title><source>arXiv.org</source><source>Free E- Journals</source><creator>Yaman, Burhaneddin ; Gu, Hongyi ; Seyed Amir Hossein Hosseini ; Demirel, Omer Burak ; Moeller, Steen ; Ellermann, Jutta ; Uğurbil, Kâmil ; Akçakaya, Mehmet</creator><creatorcontrib>Yaman, Burhaneddin ; Gu, Hongyi ; Seyed Amir Hossein Hosseini ; Demirel, Omer Burak ; Moeller, Steen ; Ellermann, Jutta ; Uğurbil, Kâmil ; Akçakaya, Mehmet</creatorcontrib><description>Self-supervised learning has shown great promise due to its capability to train deep learning MRI reconstruction methods without fully-sampled data. Current self-supervised learning methods for physics-guided reconstruction networks split acquired undersampled data into two disjoint sets, where one is used for data consistency (DC) in the unrolled network and the other to define the training loss. In this study, we propose an improved self-supervised learning strategy that more efficiently uses the acquired data to train a physics-guided reconstruction network without a database of fully-sampled data. The proposed multi-mask self-supervised learning via data undersampling (SSDU) applies a hold-out masking operation on acquired measurements to split it into multiple pairs of disjoint sets for each training sample, while using one of these pairs for DC units and the other for defining loss, thereby more efficiently using the undersampled data. Multi-mask SSDU is applied on fully-sampled 3D knee and prospectively undersampled 3D brain MRI datasets, for various acceleration rates and patterns, and compared to CG-SENSE and single-mask SSDU DL-MRI, as well as supervised DL-MRI when fully-sampled data is available. Results on knee MRI show that the proposed multi-mask SSDU outperforms SSDU and performs closely with supervised DL-MRI. A clinical reader study further ranks the multi-mask SSDU higher than supervised DL-MRI in terms of SNR and aliasing artifacts. Results on brain MRI show that multi-mask SSDU achieves better reconstruction quality compared to SSDU. Reader study demonstrates that multi-mask SSDU at R=8 significantly improves reconstruction compared to single-mask SSDU at R=8, as well as CG-SENSE at R=2.</description><identifier>EISSN: 2331-8422</identifier><identifier>DOI: 10.48550/arxiv.2008.06029</identifier><language>eng</language><publisher>Ithaca: Cornell University Library, arXiv.org</publisher><subject>Brain ; Computer Science - Computer Vision and Pattern Recognition ; Computer Science - Learning ; Data acquisition ; Deep learning ; Image reconstruction ; Knee ; Magnetic resonance imaging ; Neural networks ; Physics - Medical Physics ; Sampled data ; Self-supervised learning ; Training</subject><ispartof>arXiv.org, 2022-06</ispartof><rights>2022. This work is published under http://arxiv.org/licenses/nonexclusive-distrib/1.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><rights>http://arxiv.org/licenses/nonexclusive-distrib/1.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,780,784,885,27925</link.rule.ids><backlink>$$Uhttps://doi.org/10.1002/nbm.4798$$DView published paper (Access to full text may be restricted)$$Hfree_for_read</backlink><backlink>$$Uhttps://doi.org/10.48550/arXiv.2008.06029$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Yaman, Burhaneddin</creatorcontrib><creatorcontrib>Gu, Hongyi</creatorcontrib><creatorcontrib>Seyed Amir Hossein Hosseini</creatorcontrib><creatorcontrib>Demirel, Omer Burak</creatorcontrib><creatorcontrib>Moeller, Steen</creatorcontrib><creatorcontrib>Ellermann, Jutta</creatorcontrib><creatorcontrib>Uğurbil, Kâmil</creatorcontrib><creatorcontrib>Akçakaya, Mehmet</creatorcontrib><title>Multi-Mask Self-Supervised Learning for Physics-Guided Neural Networks in Highly Accelerated MRI</title><title>arXiv.org</title><description>Self-supervised learning has shown great promise due to its capability to train deep learning MRI reconstruction methods without fully-sampled data. Current self-supervised learning methods for physics-guided reconstruction networks split acquired undersampled data into two disjoint sets, where one is used for data consistency (DC) in the unrolled network and the other to define the training loss. In this study, we propose an improved self-supervised learning strategy that more efficiently uses the acquired data to train a physics-guided reconstruction network without a database of fully-sampled data. The proposed multi-mask self-supervised learning via data undersampling (SSDU) applies a hold-out masking operation on acquired measurements to split it into multiple pairs of disjoint sets for each training sample, while using one of these pairs for DC units and the other for defining loss, thereby more efficiently using the undersampled data. Multi-mask SSDU is applied on fully-sampled 3D knee and prospectively undersampled 3D brain MRI datasets, for various acceleration rates and patterns, and compared to CG-SENSE and single-mask SSDU DL-MRI, as well as supervised DL-MRI when fully-sampled data is available. Results on knee MRI show that the proposed multi-mask SSDU outperforms SSDU and performs closely with supervised DL-MRI. A clinical reader study further ranks the multi-mask SSDU higher than supervised DL-MRI in terms of SNR and aliasing artifacts. Results on brain MRI show that multi-mask SSDU achieves better reconstruction quality compared to SSDU. Reader study demonstrates that multi-mask SSDU at R=8 significantly improves reconstruction compared to single-mask SSDU at R=8, as well as CG-SENSE at R=2.</description><subject>Brain</subject><subject>Computer Science - Computer Vision and Pattern Recognition</subject><subject>Computer Science - Learning</subject><subject>Data acquisition</subject><subject>Deep learning</subject><subject>Image reconstruction</subject><subject>Knee</subject><subject>Magnetic resonance imaging</subject><subject>Neural networks</subject><subject>Physics - Medical Physics</subject><subject>Sampled data</subject><subject>Self-supervised learning</subject><subject>Training</subject><issn>2331-8422</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><sourceid>ABUWG</sourceid><sourceid>AFKRA</sourceid><sourceid>AZQEC</sourceid><sourceid>BENPR</sourceid><sourceid>CCPQU</sourceid><sourceid>DWQXO</sourceid><sourceid>GOX</sourceid><recordid>eNotkE9PwkAUxDcmJhLkA3iyiefFt293--dIiAIJqBHudW1fYaG2uNuCfHsreJrD_DKZGcbuBAxVrDU8GvdjD0MEiIcQAiZXrIdSCh4rxBs28H4LABhGqLXssY9FWzaWL4zfBUsqC75s9-QO1lMezMm4ylbroKhd8LY5eZt5Pmlt3nkv1DpTdtIca7fzga2CqV1vylMwyjIqyZmmoxbvs1t2XZjS0-Bf-2z1_LQaT_n8dTIbj-bcaIx5_okKolCYnAQpSQlKIOxqyiIRBHkGGWgUopAhkcE40UWIJJWWIkoSkcs-u7_Enuene2e_jDulfzek5xs64uFC7F393ZJv0m3duqrrlKKSSqhIQSx_AU9SXt0</recordid><startdate>20220609</startdate><enddate>20220609</enddate><creator>Yaman, Burhaneddin</creator><creator>Gu, Hongyi</creator><creator>Seyed Amir Hossein Hosseini</creator><creator>Demirel, Omer Burak</creator><creator>Moeller, Steen</creator><creator>Ellermann, Jutta</creator><creator>Uğurbil, Kâmil</creator><creator>Akçakaya, Mehmet</creator><general>Cornell University Library, arXiv.org</general><scope>8FE</scope><scope>8FG</scope><scope>ABJCF</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>HCIFZ</scope><scope>L6V</scope><scope>M7S</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>PTHSS</scope><scope>AKY</scope><scope>GOX</scope></search><sort><creationdate>20220609</creationdate><title>Multi-Mask Self-Supervised Learning for Physics-Guided Neural Networks in Highly Accelerated MRI</title><author>Yaman, Burhaneddin ; Gu, Hongyi ; Seyed Amir Hossein Hosseini ; Demirel, Omer Burak ; Moeller, Steen ; Ellermann, Jutta ; Uğurbil, Kâmil ; Akçakaya, Mehmet</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a528-db240761ade1e43e9230e20263f91e0dc0c05211f36eea2895f62e345317991d3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>Brain</topic><topic>Computer Science - Computer Vision and Pattern Recognition</topic><topic>Computer Science - Learning</topic><topic>Data acquisition</topic><topic>Deep learning</topic><topic>Image reconstruction</topic><topic>Knee</topic><topic>Magnetic resonance imaging</topic><topic>Neural networks</topic><topic>Physics - Medical Physics</topic><topic>Sampled data</topic><topic>Self-supervised learning</topic><topic>Training</topic><toplevel>online_resources</toplevel><creatorcontrib>Yaman, Burhaneddin</creatorcontrib><creatorcontrib>Gu, Hongyi</creatorcontrib><creatorcontrib>Seyed Amir Hossein Hosseini</creatorcontrib><creatorcontrib>Demirel, Omer Burak</creatorcontrib><creatorcontrib>Moeller, Steen</creatorcontrib><creatorcontrib>Ellermann, Jutta</creatorcontrib><creatorcontrib>Uğurbil, Kâmil</creatorcontrib><creatorcontrib>Akçakaya, Mehmet</creatorcontrib><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>Materials Science & Engineering Collection</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Engineering Collection</collection><collection>Engineering Database</collection><collection>Publicly Available Content Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>Engineering Collection</collection><collection>arXiv Computer Science</collection><collection>arXiv.org</collection><jtitle>arXiv.org</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Yaman, Burhaneddin</au><au>Gu, Hongyi</au><au>Seyed Amir Hossein Hosseini</au><au>Demirel, Omer Burak</au><au>Moeller, Steen</au><au>Ellermann, Jutta</au><au>Uğurbil, Kâmil</au><au>Akçakaya, Mehmet</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Multi-Mask Self-Supervised Learning for Physics-Guided Neural Networks in Highly Accelerated MRI</atitle><jtitle>arXiv.org</jtitle><date>2022-06-09</date><risdate>2022</risdate><eissn>2331-8422</eissn><abstract>Self-supervised learning has shown great promise due to its capability to train deep learning MRI reconstruction methods without fully-sampled data. Current self-supervised learning methods for physics-guided reconstruction networks split acquired undersampled data into two disjoint sets, where one is used for data consistency (DC) in the unrolled network and the other to define the training loss. In this study, we propose an improved self-supervised learning strategy that more efficiently uses the acquired data to train a physics-guided reconstruction network without a database of fully-sampled data. The proposed multi-mask self-supervised learning via data undersampling (SSDU) applies a hold-out masking operation on acquired measurements to split it into multiple pairs of disjoint sets for each training sample, while using one of these pairs for DC units and the other for defining loss, thereby more efficiently using the undersampled data. Multi-mask SSDU is applied on fully-sampled 3D knee and prospectively undersampled 3D brain MRI datasets, for various acceleration rates and patterns, and compared to CG-SENSE and single-mask SSDU DL-MRI, as well as supervised DL-MRI when fully-sampled data is available. Results on knee MRI show that the proposed multi-mask SSDU outperforms SSDU and performs closely with supervised DL-MRI. A clinical reader study further ranks the multi-mask SSDU higher than supervised DL-MRI in terms of SNR and aliasing artifacts. Results on brain MRI show that multi-mask SSDU achieves better reconstruction quality compared to SSDU. Reader study demonstrates that multi-mask SSDU at R=8 significantly improves reconstruction compared to single-mask SSDU at R=8, as well as CG-SENSE at R=2.</abstract><cop>Ithaca</cop><pub>Cornell University Library, arXiv.org</pub><doi>10.48550/arxiv.2008.06029</doi><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | EISSN: 2331-8422 |
ispartof | arXiv.org, 2022-06 |
issn | 2331-8422 |
language | eng |
recordid | cdi_arxiv_primary_2008_06029 |
source | arXiv.org; Free E- Journals |
subjects | Brain Computer Science - Computer Vision and Pattern Recognition Computer Science - Learning Data acquisition Deep learning Image reconstruction Knee Magnetic resonance imaging Neural networks Physics - Medical Physics Sampled data Self-supervised learning Training |
title | Multi-Mask Self-Supervised Learning for Physics-Guided Neural Networks in Highly Accelerated MRI |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-19T04%3A59%3A02IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_arxiv&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Multi-Mask%20Self-Supervised%20Learning%20for%20Physics-Guided%20Neural%20Networks%20in%20Highly%20Accelerated%20MRI&rft.jtitle=arXiv.org&rft.au=Yaman,%20Burhaneddin&rft.date=2022-06-09&rft.eissn=2331-8422&rft_id=info:doi/10.48550/arxiv.2008.06029&rft_dat=%3Cproquest_arxiv%3E2434147408%3C/proquest_arxiv%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2434147408&rft_id=info:pmid/&rfr_iscdi=true |