FDRN: A fast deformable registration network for medical images

Purpose Deformable image registration is a fundamental task in medical imaging. Due to the large computational complexity of deformable registration of volumetric images, conventional iterative methods usually face the tradeoff between the registration accuracy and the computation time in practice....

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Medical physics (Lancaster) 2021-10, Vol.48 (10), p.6453-6463
Hauptverfasser: Sun, Kaicong, Simon, Sven
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 6463
container_issue 10
container_start_page 6453
container_title Medical physics (Lancaster)
container_volume 48
creator Sun, Kaicong
Simon, Sven
description Purpose Deformable image registration is a fundamental task in medical imaging. Due to the large computational complexity of deformable registration of volumetric images, conventional iterative methods usually face the tradeoff between the registration accuracy and the computation time in practice. In order to boost the performance of deformable registration in both accuracy and runtime, we propose a fast unsupervised convolutional neural network for deformable image registration. Methods The proposed registration model FDRN possesses a compact encoder–decoder network architecture which employs a pair of fixed and moving images as input and outputs a three‐dimensional displacement vector field (DVF) describing the offsets between the corresponding voxels in the fixed and moving images. In order to efficiently utilize the memory resources and enlarge the model capacity, we adopt additive forwarding instead of channel concatenation and deepen the network in each encoder and decoder stage. To facilitate the learning efficiency, we leverage skip connection within the encoder and decoder stages to enable residual learning and employ an auxiliary loss at the bottom layer with lowest resolution to involve deep supervision. Particularly, the low‐resolution auxiliary loss is weighted by an exponentially decayed parameter during the training phase. In conjunction with the main loss in high‐resolution grid, a coarse‐to‐fine learning strategy is achieved. Last but not least, we involve a proposed multi‐label segmentation loss (SL) to improve the network performance in Dice score in case the segmentation prior is available. Comparing to the SL using average Dice score, the proposed SL does not require additional memory in the training phase and improves the registration accuracy efficiently. Results We evaluated FDRN on multiple brain MRI datasets from different aspects including registration accuracy, model generalizability, and model analysis. Experimental results demonstrate that FDRN performs better than the state‐of‐the‐art registration method VoxelMorph by 1.46% in Dice score in LPBA40. In addition to LPBA40, FDRN obtains the best Dice and NCC among all the investigated methods in the unseen MRI datasets including CUMC12, MGH10, ABIDE, and ADNI by a large margin. Conclusions The proposed FDRN provides better performance than the existing state‐of‐the‐art registration methods for brain MR images by resorting to the compact autoencoder structure and efficient learn
doi_str_mv 10.1002/mp.15011
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_2535110350</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2535110350</sourcerecordid><originalsourceid>FETCH-LOGICAL-c3321-128094d7ae1b548313353ac3482718d76afe541421b9141cd56fed9dd82e8b4a3</originalsourceid><addsrcrecordid>eNp10E1Lw0AQBuBFFIxV8Cfs0UvqzH40iRcptVWhfiB6XjbZSYkmTdxNKf33Rit48jSHeRjeeRk7RxgjgLhsujFqQDxgkVCJjJWA7JBFAJmKhQJ9zE5CeAeAidQQsevFzcvjFZ_y0oaeOypb39i8Ju5pVYXe275q13xN_bb1H3zY8oZcVdiaV41dUThlR6WtA539zhF7W8xfZ3fx8un2fjZdxoWUAmMU6RDAJZYw1yqVKKWWtpAqFQmmLpnYkrRCJTDPUGHh9KQklzmXCkpzZeWIXezvdr793FDoTVOFgurarqndBCO01Igw_PRHC9-G4Kk0nR_C-p1BMN8dmaYzPx0NNN7TbVXT7l9nHp73_gvwLGUR</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2535110350</pqid></control><display><type>article</type><title>FDRN: A fast deformable registration network for medical images</title><source>Wiley Online Library Journals Frontfile Complete</source><source>Alma/SFX Local Collection</source><creator>Sun, Kaicong ; Simon, Sven</creator><creatorcontrib>Sun, Kaicong ; Simon, Sven</creatorcontrib><description>Purpose Deformable image registration is a fundamental task in medical imaging. Due to the large computational complexity of deformable registration of volumetric images, conventional iterative methods usually face the tradeoff between the registration accuracy and the computation time in practice. In order to boost the performance of deformable registration in both accuracy and runtime, we propose a fast unsupervised convolutional neural network for deformable image registration. Methods The proposed registration model FDRN possesses a compact encoder–decoder network architecture which employs a pair of fixed and moving images as input and outputs a three‐dimensional displacement vector field (DVF) describing the offsets between the corresponding voxels in the fixed and moving images. In order to efficiently utilize the memory resources and enlarge the model capacity, we adopt additive forwarding instead of channel concatenation and deepen the network in each encoder and decoder stage. To facilitate the learning efficiency, we leverage skip connection within the encoder and decoder stages to enable residual learning and employ an auxiliary loss at the bottom layer with lowest resolution to involve deep supervision. Particularly, the low‐resolution auxiliary loss is weighted by an exponentially decayed parameter during the training phase. In conjunction with the main loss in high‐resolution grid, a coarse‐to‐fine learning strategy is achieved. Last but not least, we involve a proposed multi‐label segmentation loss (SL) to improve the network performance in Dice score in case the segmentation prior is available. Comparing to the SL using average Dice score, the proposed SL does not require additional memory in the training phase and improves the registration accuracy efficiently. Results We evaluated FDRN on multiple brain MRI datasets from different aspects including registration accuracy, model generalizability, and model analysis. Experimental results demonstrate that FDRN performs better than the state‐of‐the‐art registration method VoxelMorph by 1.46% in Dice score in LPBA40. In addition to LPBA40, FDRN obtains the best Dice and NCC among all the investigated methods in the unseen MRI datasets including CUMC12, MGH10, ABIDE, and ADNI by a large margin. Conclusions The proposed FDRN provides better performance than the existing state‐of‐the‐art registration methods for brain MR images by resorting to the compact autoencoder structure and efficient learning. Additionally, FDRN is a generalized framework for image registration which is not confined to a particular type of medical images or anatomy.</description><identifier>ISSN: 0094-2405</identifier><identifier>EISSN: 2473-4209</identifier><identifier>DOI: 10.1002/mp.15011</identifier><language>eng</language><subject>brain MRI registration ; coarse‐to‐fine learning ; deep supervision ; deformable image registration ; encoder–decoder network ; multi‐label segmentation loss</subject><ispartof>Medical physics (Lancaster), 2021-10, Vol.48 (10), p.6453-6463</ispartof><rights>2021 The Authors. published by Wiley Periodicals LLC on behalf of American Association of Physicists in Medicine</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c3321-128094d7ae1b548313353ac3482718d76afe541421b9141cd56fed9dd82e8b4a3</citedby><cites>FETCH-LOGICAL-c3321-128094d7ae1b548313353ac3482718d76afe541421b9141cd56fed9dd82e8b4a3</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://onlinelibrary.wiley.com/doi/pdf/10.1002%2Fmp.15011$$EPDF$$P50$$Gwiley$$Hfree_for_read</linktopdf><linktohtml>$$Uhttps://onlinelibrary.wiley.com/doi/full/10.1002%2Fmp.15011$$EHTML$$P50$$Gwiley$$Hfree_for_read</linktohtml><link.rule.ids>314,778,782,1414,27911,27912,45561,45562</link.rule.ids></links><search><creatorcontrib>Sun, Kaicong</creatorcontrib><creatorcontrib>Simon, Sven</creatorcontrib><title>FDRN: A fast deformable registration network for medical images</title><title>Medical physics (Lancaster)</title><description>Purpose Deformable image registration is a fundamental task in medical imaging. Due to the large computational complexity of deformable registration of volumetric images, conventional iterative methods usually face the tradeoff between the registration accuracy and the computation time in practice. In order to boost the performance of deformable registration in both accuracy and runtime, we propose a fast unsupervised convolutional neural network for deformable image registration. Methods The proposed registration model FDRN possesses a compact encoder–decoder network architecture which employs a pair of fixed and moving images as input and outputs a three‐dimensional displacement vector field (DVF) describing the offsets between the corresponding voxels in the fixed and moving images. In order to efficiently utilize the memory resources and enlarge the model capacity, we adopt additive forwarding instead of channel concatenation and deepen the network in each encoder and decoder stage. To facilitate the learning efficiency, we leverage skip connection within the encoder and decoder stages to enable residual learning and employ an auxiliary loss at the bottom layer with lowest resolution to involve deep supervision. Particularly, the low‐resolution auxiliary loss is weighted by an exponentially decayed parameter during the training phase. In conjunction with the main loss in high‐resolution grid, a coarse‐to‐fine learning strategy is achieved. Last but not least, we involve a proposed multi‐label segmentation loss (SL) to improve the network performance in Dice score in case the segmentation prior is available. Comparing to the SL using average Dice score, the proposed SL does not require additional memory in the training phase and improves the registration accuracy efficiently. Results We evaluated FDRN on multiple brain MRI datasets from different aspects including registration accuracy, model generalizability, and model analysis. Experimental results demonstrate that FDRN performs better than the state‐of‐the‐art registration method VoxelMorph by 1.46% in Dice score in LPBA40. In addition to LPBA40, FDRN obtains the best Dice and NCC among all the investigated methods in the unseen MRI datasets including CUMC12, MGH10, ABIDE, and ADNI by a large margin. Conclusions The proposed FDRN provides better performance than the existing state‐of‐the‐art registration methods for brain MR images by resorting to the compact autoencoder structure and efficient learning. Additionally, FDRN is a generalized framework for image registration which is not confined to a particular type of medical images or anatomy.</description><subject>brain MRI registration</subject><subject>coarse‐to‐fine learning</subject><subject>deep supervision</subject><subject>deformable image registration</subject><subject>encoder–decoder network</subject><subject>multi‐label segmentation loss</subject><issn>0094-2405</issn><issn>2473-4209</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2021</creationdate><recordtype>article</recordtype><sourceid>24P</sourceid><sourceid>WIN</sourceid><recordid>eNp10E1Lw0AQBuBFFIxV8Cfs0UvqzH40iRcptVWhfiB6XjbZSYkmTdxNKf33Rit48jSHeRjeeRk7RxgjgLhsujFqQDxgkVCJjJWA7JBFAJmKhQJ9zE5CeAeAidQQsevFzcvjFZ_y0oaeOypb39i8Ju5pVYXe275q13xN_bb1H3zY8oZcVdiaV41dUThlR6WtA539zhF7W8xfZ3fx8un2fjZdxoWUAmMU6RDAJZYw1yqVKKWWtpAqFQmmLpnYkrRCJTDPUGHh9KQklzmXCkpzZeWIXezvdr793FDoTVOFgurarqndBCO01Igw_PRHC9-G4Kk0nR_C-p1BMN8dmaYzPx0NNN7TbVXT7l9nHp73_gvwLGUR</recordid><startdate>202110</startdate><enddate>202110</enddate><creator>Sun, Kaicong</creator><creator>Simon, Sven</creator><scope>24P</scope><scope>WIN</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7X8</scope></search><sort><creationdate>202110</creationdate><title>FDRN: A fast deformable registration network for medical images</title><author>Sun, Kaicong ; Simon, Sven</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c3321-128094d7ae1b548313353ac3482718d76afe541421b9141cd56fed9dd82e8b4a3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2021</creationdate><topic>brain MRI registration</topic><topic>coarse‐to‐fine learning</topic><topic>deep supervision</topic><topic>deformable image registration</topic><topic>encoder–decoder network</topic><topic>multi‐label segmentation loss</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Sun, Kaicong</creatorcontrib><creatorcontrib>Simon, Sven</creatorcontrib><collection>Wiley-Blackwell Open Access Titles</collection><collection>Wiley Free Content</collection><collection>CrossRef</collection><collection>MEDLINE - Academic</collection><jtitle>Medical physics (Lancaster)</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Sun, Kaicong</au><au>Simon, Sven</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>FDRN: A fast deformable registration network for medical images</atitle><jtitle>Medical physics (Lancaster)</jtitle><date>2021-10</date><risdate>2021</risdate><volume>48</volume><issue>10</issue><spage>6453</spage><epage>6463</epage><pages>6453-6463</pages><issn>0094-2405</issn><eissn>2473-4209</eissn><abstract>Purpose Deformable image registration is a fundamental task in medical imaging. Due to the large computational complexity of deformable registration of volumetric images, conventional iterative methods usually face the tradeoff between the registration accuracy and the computation time in practice. In order to boost the performance of deformable registration in both accuracy and runtime, we propose a fast unsupervised convolutional neural network for deformable image registration. Methods The proposed registration model FDRN possesses a compact encoder–decoder network architecture which employs a pair of fixed and moving images as input and outputs a three‐dimensional displacement vector field (DVF) describing the offsets between the corresponding voxels in the fixed and moving images. In order to efficiently utilize the memory resources and enlarge the model capacity, we adopt additive forwarding instead of channel concatenation and deepen the network in each encoder and decoder stage. To facilitate the learning efficiency, we leverage skip connection within the encoder and decoder stages to enable residual learning and employ an auxiliary loss at the bottom layer with lowest resolution to involve deep supervision. Particularly, the low‐resolution auxiliary loss is weighted by an exponentially decayed parameter during the training phase. In conjunction with the main loss in high‐resolution grid, a coarse‐to‐fine learning strategy is achieved. Last but not least, we involve a proposed multi‐label segmentation loss (SL) to improve the network performance in Dice score in case the segmentation prior is available. Comparing to the SL using average Dice score, the proposed SL does not require additional memory in the training phase and improves the registration accuracy efficiently. Results We evaluated FDRN on multiple brain MRI datasets from different aspects including registration accuracy, model generalizability, and model analysis. Experimental results demonstrate that FDRN performs better than the state‐of‐the‐art registration method VoxelMorph by 1.46% in Dice score in LPBA40. In addition to LPBA40, FDRN obtains the best Dice and NCC among all the investigated methods in the unseen MRI datasets including CUMC12, MGH10, ABIDE, and ADNI by a large margin. Conclusions The proposed FDRN provides better performance than the existing state‐of‐the‐art registration methods for brain MR images by resorting to the compact autoencoder structure and efficient learning. Additionally, FDRN is a generalized framework for image registration which is not confined to a particular type of medical images or anatomy.</abstract><doi>10.1002/mp.15011</doi><tpages>11</tpages><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 0094-2405
ispartof Medical physics (Lancaster), 2021-10, Vol.48 (10), p.6453-6463
issn 0094-2405
2473-4209
language eng
recordid cdi_proquest_miscellaneous_2535110350
source Wiley Online Library Journals Frontfile Complete; Alma/SFX Local Collection
subjects brain MRI registration
coarse‐to‐fine learning
deep supervision
deformable image registration
encoder–decoder network
multi‐label segmentation loss
title FDRN: A fast deformable registration network for medical images
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-15T18%3A58%3A10IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=FDRN:%20A%20fast%20deformable%20registration%20network%20for%20medical%20images&rft.jtitle=Medical%20physics%20(Lancaster)&rft.au=Sun,%20Kaicong&rft.date=2021-10&rft.volume=48&rft.issue=10&rft.spage=6453&rft.epage=6463&rft.pages=6453-6463&rft.issn=0094-2405&rft.eissn=2473-4209&rft_id=info:doi/10.1002/mp.15011&rft_dat=%3Cproquest_cross%3E2535110350%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2535110350&rft_id=info:pmid/&rfr_iscdi=true