Correction of out-of-FOV motion artifacts using convolutional neural network

Subject motion during MRI scan can result in severe degradation of image quality. Existing motion correction algorithms rely on the assumption that no information is missing during motions. However, this assumption does not hold when out-of-FOV motion happens. Currently available algorithms are not...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Magnetic resonance imaging 2020-09, Vol.71, p.93-102
Hauptverfasser: Wang, Chengyan, Liang, Yucheng, Wu, Yuan, Zhao, Siwei, Du, Yiping P.
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 102
container_issue
container_start_page 93
container_title Magnetic resonance imaging
container_volume 71
creator Wang, Chengyan
Liang, Yucheng
Wu, Yuan
Zhao, Siwei
Du, Yiping P.
description Subject motion during MRI scan can result in severe degradation of image quality. Existing motion correction algorithms rely on the assumption that no information is missing during motions. However, this assumption does not hold when out-of-FOV motion happens. Currently available algorithms are not able to correct for image artifacts introduced by out-of-FOV motion. The purpose of this study is to demonstrate the feasibility of incorporating convolutional neural network (CNN) derived prior image into solving the out-of-FOV motion problem. A modified U-net network was proposed to correct out-of-FOV motion artifacts by incorporating motion parameters into the loss function. A motion model based data fidelity term was applied in combination with the CNN prediction to further improve the motion correction performance. We trained the CNN on 1113 MPRAGE images with simulated oscillating and sudden motion trajectories, and compared our algorithm to a gradient-based autofocusing (AF) algorithm in both 2D and 3D images. Additional experiment was performed to demonstrate the feasibility of transferring the networks to different dataset. We also evaluated the robustness of this algorithm by adding Gaussian noise to the motion parameters. The motion correction performance was evaluated using mean square error (NMSE), peak signal-to-noise ratio (PSNR) and structural similarity index (SSIM). The proposed algorithm outperformed AF-based algorithm for both 2D (NMSE: 0.0066 ± 0.0009 vs 0.0141 ± 0.008, P 
doi_str_mv 10.1016/j.mri.2020.05.004
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_2408194081</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S0730725X20300941</els_id><sourcerecordid>2408194081</sourcerecordid><originalsourceid>FETCH-LOGICAL-c353t-c59442edc1f103efac6e454650553cf5b57463cf70c4b2bfd695aa15d0f7fba83</originalsourceid><addsrcrecordid>eNp9kMtOwzAQRS0EoqXwAWxQlmwSxq88xApVFJAqdQOIneU4NnJJ4mInRfw9SVtYspk7mrlzpTkIXWJIMOD0Zp003iYECCTAEwB2hKY4z2jM84IdoylkFOKM8LcJOgthDQCcUH6KJpSwlBFGp2g5d95r1VnXRs5Eru9iZ-LF6jVq3G4ofWeNVF2I-mDb90i5duvqftzJOmp173fSfTn_cY5OjKyDvjjoDL0s7p_nj_Fy9fA0v1vGinLaxYoXjBFdKWwwUD2kp5pxlnLgnCrDS56xdGgyUKwkpanSgkuJeQUmM6XM6Qxd73M33n32OnSisUHpupatdn0QhEGOi7EMVry3Ku9C8NqIjbeN9N8CgxghirUYIIoRogAuBojDzdUhvi8bXf1d_FIbDLd7gx6e3FrtRVBWt0pXdmQpKmf_if8BfA-DDw</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2408194081</pqid></control><display><type>article</type><title>Correction of out-of-FOV motion artifacts using convolutional neural network</title><source>MEDLINE</source><source>Elsevier ScienceDirect Journals Complete</source><creator>Wang, Chengyan ; Liang, Yucheng ; Wu, Yuan ; Zhao, Siwei ; Du, Yiping P.</creator><creatorcontrib>Wang, Chengyan ; Liang, Yucheng ; Wu, Yuan ; Zhao, Siwei ; Du, Yiping P.</creatorcontrib><description><![CDATA[Subject motion during MRI scan can result in severe degradation of image quality. Existing motion correction algorithms rely on the assumption that no information is missing during motions. However, this assumption does not hold when out-of-FOV motion happens. Currently available algorithms are not able to correct for image artifacts introduced by out-of-FOV motion. The purpose of this study is to demonstrate the feasibility of incorporating convolutional neural network (CNN) derived prior image into solving the out-of-FOV motion problem. A modified U-net network was proposed to correct out-of-FOV motion artifacts by incorporating motion parameters into the loss function. A motion model based data fidelity term was applied in combination with the CNN prediction to further improve the motion correction performance. We trained the CNN on 1113 MPRAGE images with simulated oscillating and sudden motion trajectories, and compared our algorithm to a gradient-based autofocusing (AF) algorithm in both 2D and 3D images. Additional experiment was performed to demonstrate the feasibility of transferring the networks to different dataset. We also evaluated the robustness of this algorithm by adding Gaussian noise to the motion parameters. The motion correction performance was evaluated using mean square error (NMSE), peak signal-to-noise ratio (PSNR) and structural similarity index (SSIM). The proposed algorithm outperformed AF-based algorithm for both 2D (NMSE: 0.0066 ± 0.0009 vs 0.0141 ± 0.008, P < .01; PSNR: 29.60 ± 0.74 vs 21.71 ± 0.27, P < .01; SSIM: 0.89 ± 0.014 vs 0.73 ± 0.004, P < .01) and 3D imaging (NMSE: 0.0067 ± 0.0008 vs 0.070 ± 0.021, P < .01; PSNR: 32.40 ± 1.63 vs 22.32 ± 2.378, P < .01; SSIM: 0.89 ± 0.01 vs 0.62 ± 0.03, P < .01). Robust reconstruction was achieved with 20% data missed due to the out-of-FOV motion. In conclusion, the proposed CNN-based motion correction algorithm can significantly reduce out-of-FOV motion artifacts and achieve better image quality compared to AF-based algorithm.]]></description><identifier>ISSN: 0730-725X</identifier><identifier>EISSN: 1873-5894</identifier><identifier>DOI: 10.1016/j.mri.2020.05.004</identifier><identifier>PMID: 32464243</identifier><language>eng</language><publisher>Netherlands: Elsevier Inc</publisher><subject>Convolutional neural networks ; Humans ; Image Processing, Computer-Assisted - methods ; Machine learning ; Magnetic Resonance Imaging ; Motion correction ; Neural Networks, Computer ; Out-of-FOV motion ; Prior image ; Signal-To-Noise Ratio</subject><ispartof>Magnetic resonance imaging, 2020-09, Vol.71, p.93-102</ispartof><rights>2020 Elsevier Inc.</rights><rights>Copyright © 2020 Elsevier Inc. All rights reserved.</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c353t-c59442edc1f103efac6e454650553cf5b57463cf70c4b2bfd695aa15d0f7fba83</citedby><cites>FETCH-LOGICAL-c353t-c59442edc1f103efac6e454650553cf5b57463cf70c4b2bfd695aa15d0f7fba83</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://www.sciencedirect.com/science/article/pii/S0730725X20300941$$EHTML$$P50$$Gelsevier$$H</linktohtml><link.rule.ids>314,776,780,3537,27901,27902,65534</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/32464243$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Wang, Chengyan</creatorcontrib><creatorcontrib>Liang, Yucheng</creatorcontrib><creatorcontrib>Wu, Yuan</creatorcontrib><creatorcontrib>Zhao, Siwei</creatorcontrib><creatorcontrib>Du, Yiping P.</creatorcontrib><title>Correction of out-of-FOV motion artifacts using convolutional neural network</title><title>Magnetic resonance imaging</title><addtitle>Magn Reson Imaging</addtitle><description><![CDATA[Subject motion during MRI scan can result in severe degradation of image quality. Existing motion correction algorithms rely on the assumption that no information is missing during motions. However, this assumption does not hold when out-of-FOV motion happens. Currently available algorithms are not able to correct for image artifacts introduced by out-of-FOV motion. The purpose of this study is to demonstrate the feasibility of incorporating convolutional neural network (CNN) derived prior image into solving the out-of-FOV motion problem. A modified U-net network was proposed to correct out-of-FOV motion artifacts by incorporating motion parameters into the loss function. A motion model based data fidelity term was applied in combination with the CNN prediction to further improve the motion correction performance. We trained the CNN on 1113 MPRAGE images with simulated oscillating and sudden motion trajectories, and compared our algorithm to a gradient-based autofocusing (AF) algorithm in both 2D and 3D images. Additional experiment was performed to demonstrate the feasibility of transferring the networks to different dataset. We also evaluated the robustness of this algorithm by adding Gaussian noise to the motion parameters. The motion correction performance was evaluated using mean square error (NMSE), peak signal-to-noise ratio (PSNR) and structural similarity index (SSIM). The proposed algorithm outperformed AF-based algorithm for both 2D (NMSE: 0.0066 ± 0.0009 vs 0.0141 ± 0.008, P < .01; PSNR: 29.60 ± 0.74 vs 21.71 ± 0.27, P < .01; SSIM: 0.89 ± 0.014 vs 0.73 ± 0.004, P < .01) and 3D imaging (NMSE: 0.0067 ± 0.0008 vs 0.070 ± 0.021, P < .01; PSNR: 32.40 ± 1.63 vs 22.32 ± 2.378, P < .01; SSIM: 0.89 ± 0.01 vs 0.62 ± 0.03, P < .01). Robust reconstruction was achieved with 20% data missed due to the out-of-FOV motion. In conclusion, the proposed CNN-based motion correction algorithm can significantly reduce out-of-FOV motion artifacts and achieve better image quality compared to AF-based algorithm.]]></description><subject>Convolutional neural networks</subject><subject>Humans</subject><subject>Image Processing, Computer-Assisted - methods</subject><subject>Machine learning</subject><subject>Magnetic Resonance Imaging</subject><subject>Motion correction</subject><subject>Neural Networks, Computer</subject><subject>Out-of-FOV motion</subject><subject>Prior image</subject><subject>Signal-To-Noise Ratio</subject><issn>0730-725X</issn><issn>1873-5894</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2020</creationdate><recordtype>article</recordtype><sourceid>EIF</sourceid><recordid>eNp9kMtOwzAQRS0EoqXwAWxQlmwSxq88xApVFJAqdQOIneU4NnJJ4mInRfw9SVtYspk7mrlzpTkIXWJIMOD0Zp003iYECCTAEwB2hKY4z2jM84IdoylkFOKM8LcJOgthDQCcUH6KJpSwlBFGp2g5d95r1VnXRs5Eru9iZ-LF6jVq3G4ofWeNVF2I-mDb90i5duvqftzJOmp173fSfTn_cY5OjKyDvjjoDL0s7p_nj_Fy9fA0v1vGinLaxYoXjBFdKWwwUD2kp5pxlnLgnCrDS56xdGgyUKwkpanSgkuJeQUmM6XM6Qxd73M33n32OnSisUHpupatdn0QhEGOi7EMVry3Ku9C8NqIjbeN9N8CgxghirUYIIoRogAuBojDzdUhvi8bXf1d_FIbDLd7gx6e3FrtRVBWt0pXdmQpKmf_if8BfA-DDw</recordid><startdate>202009</startdate><enddate>202009</enddate><creator>Wang, Chengyan</creator><creator>Liang, Yucheng</creator><creator>Wu, Yuan</creator><creator>Zhao, Siwei</creator><creator>Du, Yiping P.</creator><general>Elsevier Inc</general><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7X8</scope></search><sort><creationdate>202009</creationdate><title>Correction of out-of-FOV motion artifacts using convolutional neural network</title><author>Wang, Chengyan ; Liang, Yucheng ; Wu, Yuan ; Zhao, Siwei ; Du, Yiping P.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c353t-c59442edc1f103efac6e454650553cf5b57463cf70c4b2bfd695aa15d0f7fba83</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2020</creationdate><topic>Convolutional neural networks</topic><topic>Humans</topic><topic>Image Processing, Computer-Assisted - methods</topic><topic>Machine learning</topic><topic>Magnetic Resonance Imaging</topic><topic>Motion correction</topic><topic>Neural Networks, Computer</topic><topic>Out-of-FOV motion</topic><topic>Prior image</topic><topic>Signal-To-Noise Ratio</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Wang, Chengyan</creatorcontrib><creatorcontrib>Liang, Yucheng</creatorcontrib><creatorcontrib>Wu, Yuan</creatorcontrib><creatorcontrib>Zhao, Siwei</creatorcontrib><creatorcontrib>Du, Yiping P.</creatorcontrib><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>MEDLINE - Academic</collection><jtitle>Magnetic resonance imaging</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Wang, Chengyan</au><au>Liang, Yucheng</au><au>Wu, Yuan</au><au>Zhao, Siwei</au><au>Du, Yiping P.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Correction of out-of-FOV motion artifacts using convolutional neural network</atitle><jtitle>Magnetic resonance imaging</jtitle><addtitle>Magn Reson Imaging</addtitle><date>2020-09</date><risdate>2020</risdate><volume>71</volume><spage>93</spage><epage>102</epage><pages>93-102</pages><issn>0730-725X</issn><eissn>1873-5894</eissn><abstract><![CDATA[Subject motion during MRI scan can result in severe degradation of image quality. Existing motion correction algorithms rely on the assumption that no information is missing during motions. However, this assumption does not hold when out-of-FOV motion happens. Currently available algorithms are not able to correct for image artifacts introduced by out-of-FOV motion. The purpose of this study is to demonstrate the feasibility of incorporating convolutional neural network (CNN) derived prior image into solving the out-of-FOV motion problem. A modified U-net network was proposed to correct out-of-FOV motion artifacts by incorporating motion parameters into the loss function. A motion model based data fidelity term was applied in combination with the CNN prediction to further improve the motion correction performance. We trained the CNN on 1113 MPRAGE images with simulated oscillating and sudden motion trajectories, and compared our algorithm to a gradient-based autofocusing (AF) algorithm in both 2D and 3D images. Additional experiment was performed to demonstrate the feasibility of transferring the networks to different dataset. We also evaluated the robustness of this algorithm by adding Gaussian noise to the motion parameters. The motion correction performance was evaluated using mean square error (NMSE), peak signal-to-noise ratio (PSNR) and structural similarity index (SSIM). The proposed algorithm outperformed AF-based algorithm for both 2D (NMSE: 0.0066 ± 0.0009 vs 0.0141 ± 0.008, P < .01; PSNR: 29.60 ± 0.74 vs 21.71 ± 0.27, P < .01; SSIM: 0.89 ± 0.014 vs 0.73 ± 0.004, P < .01) and 3D imaging (NMSE: 0.0067 ± 0.0008 vs 0.070 ± 0.021, P < .01; PSNR: 32.40 ± 1.63 vs 22.32 ± 2.378, P < .01; SSIM: 0.89 ± 0.01 vs 0.62 ± 0.03, P < .01). Robust reconstruction was achieved with 20% data missed due to the out-of-FOV motion. In conclusion, the proposed CNN-based motion correction algorithm can significantly reduce out-of-FOV motion artifacts and achieve better image quality compared to AF-based algorithm.]]></abstract><cop>Netherlands</cop><pub>Elsevier Inc</pub><pmid>32464243</pmid><doi>10.1016/j.mri.2020.05.004</doi><tpages>10</tpages></addata></record>
fulltext fulltext
identifier ISSN: 0730-725X
ispartof Magnetic resonance imaging, 2020-09, Vol.71, p.93-102
issn 0730-725X
1873-5894
language eng
recordid cdi_proquest_miscellaneous_2408194081
source MEDLINE; Elsevier ScienceDirect Journals Complete
subjects Convolutional neural networks
Humans
Image Processing, Computer-Assisted - methods
Machine learning
Magnetic Resonance Imaging
Motion correction
Neural Networks, Computer
Out-of-FOV motion
Prior image
Signal-To-Noise Ratio
title Correction of out-of-FOV motion artifacts using convolutional neural network
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-14T11%3A47%3A17IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Correction%20of%20out-of-FOV%20motion%20artifacts%20using%20convolutional%20neural%20network&rft.jtitle=Magnetic%20resonance%20imaging&rft.au=Wang,%20Chengyan&rft.date=2020-09&rft.volume=71&rft.spage=93&rft.epage=102&rft.pages=93-102&rft.issn=0730-725X&rft.eissn=1873-5894&rft_id=info:doi/10.1016/j.mri.2020.05.004&rft_dat=%3Cproquest_cross%3E2408194081%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2408194081&rft_id=info:pmid/32464243&rft_els_id=S0730725X20300941&rfr_iscdi=true