Gaussian Primitives for Deformable Image Registration

Deformable Image Registration (DIR) is essential for aligning medical images that exhibit anatomical variations, facilitating applications such as disease tracking and radiotherapy planning. While classical iterative methods and deep learning approaches have achieved success in DIR, they are often h...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Li, Jihe, Liu, Xiang, Zhang, Fabian, Li, Xia, Cao, Xixin, Zhang, Ye, Buhmann, Joachim
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator Li, Jihe
Liu, Xiang
Zhang, Fabian
Li, Xia
Cao, Xixin
Zhang, Ye
Buhmann, Joachim
description Deformable Image Registration (DIR) is essential for aligning medical images that exhibit anatomical variations, facilitating applications such as disease tracking and radiotherapy planning. While classical iterative methods and deep learning approaches have achieved success in DIR, they are often hindered by computational inefficiency or poor generalization. In this paper, we introduce GaussianDIR, a novel, case-specific optimization DIR method inspired by 3D Gaussian splatting. In general, GaussianDIR represents image deformations using a sparse set of mobile and flexible Gaussian primitives, each defined by a center position, covariance, and local rigid transformation. This compact and explicit representation reduces noise and computational overhead while improving interpretability. Furthermore, the movement of individual voxel is derived via blending the local rigid transformation of the neighboring Gaussian primitives. By this, GaussianDIR captures both global smoothness and local rigidity as well as reduces the computational burden. To address varying levels of deformation complexity, GaussianDIR also integrates an adaptive density control mechanism that dynamically adjusts the density of Gaussian primitives. Additionally, we employ multi-scale Gaussian primitives to capture both coarse and fine deformations, reducing optimization to local minima. Experimental results on brain MRI, lung CT, and cardiac MRI datasets demonstrate that GaussianDIR outperforms existing DIR methods in both accuracy and efficiency, highlighting its potential for clinical applications. Finally, as a training-free approach, it challenges the stereotype that iterative methods are inherently slow and transcend the limitations of poor generalization.
doi_str_mv 10.48550/arxiv.2406.03394
format Article
fullrecord <record><control><sourceid>arxiv_GOX</sourceid><recordid>TN_cdi_arxiv_primary_2406_03394</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2406_03394</sourcerecordid><originalsourceid>FETCH-arxiv_primary_2406_033943</originalsourceid><addsrcrecordid>eNpjYJA0NNAzsTA1NdBPLKrILNMzMjEw0zMwNrY04WQwdU8sLS7OTMxTCCjKzM0sySxLLVZIyy9ScEkFkrmJSTmpCp65iempCkGp6ZnFJUWJJZn5eTwMrGmJOcWpvFCam0HezTXE2UMXbEF8AdCoxKLKeJBF8WCLjAmrAAB_HjLj</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Gaussian Primitives for Deformable Image Registration</title><source>arXiv.org</source><creator>Li, Jihe ; Liu, Xiang ; Zhang, Fabian ; Li, Xia ; Cao, Xixin ; Zhang, Ye ; Buhmann, Joachim</creator><creatorcontrib>Li, Jihe ; Liu, Xiang ; Zhang, Fabian ; Li, Xia ; Cao, Xixin ; Zhang, Ye ; Buhmann, Joachim</creatorcontrib><description>Deformable Image Registration (DIR) is essential for aligning medical images that exhibit anatomical variations, facilitating applications such as disease tracking and radiotherapy planning. While classical iterative methods and deep learning approaches have achieved success in DIR, they are often hindered by computational inefficiency or poor generalization. In this paper, we introduce GaussianDIR, a novel, case-specific optimization DIR method inspired by 3D Gaussian splatting. In general, GaussianDIR represents image deformations using a sparse set of mobile and flexible Gaussian primitives, each defined by a center position, covariance, and local rigid transformation. This compact and explicit representation reduces noise and computational overhead while improving interpretability. Furthermore, the movement of individual voxel is derived via blending the local rigid transformation of the neighboring Gaussian primitives. By this, GaussianDIR captures both global smoothness and local rigidity as well as reduces the computational burden. To address varying levels of deformation complexity, GaussianDIR also integrates an adaptive density control mechanism that dynamically adjusts the density of Gaussian primitives. Additionally, we employ multi-scale Gaussian primitives to capture both coarse and fine deformations, reducing optimization to local minima. Experimental results on brain MRI, lung CT, and cardiac MRI datasets demonstrate that GaussianDIR outperforms existing DIR methods in both accuracy and efficiency, highlighting its potential for clinical applications. Finally, as a training-free approach, it challenges the stereotype that iterative methods are inherently slow and transcend the limitations of poor generalization.</description><identifier>DOI: 10.48550/arxiv.2406.03394</identifier><language>eng</language><subject>Computer Science - Computer Vision and Pattern Recognition</subject><creationdate>2024-06</creationdate><rights>http://arxiv.org/licenses/nonexclusive-distrib/1.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,776,881</link.rule.ids><linktorsrc>$$Uhttps://arxiv.org/abs/2406.03394$$EView_record_in_Cornell_University$$FView_record_in_$$GCornell_University$$Hfree_for_read</linktorsrc><backlink>$$Uhttps://doi.org/10.48550/arXiv.2406.03394$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Li, Jihe</creatorcontrib><creatorcontrib>Liu, Xiang</creatorcontrib><creatorcontrib>Zhang, Fabian</creatorcontrib><creatorcontrib>Li, Xia</creatorcontrib><creatorcontrib>Cao, Xixin</creatorcontrib><creatorcontrib>Zhang, Ye</creatorcontrib><creatorcontrib>Buhmann, Joachim</creatorcontrib><title>Gaussian Primitives for Deformable Image Registration</title><description>Deformable Image Registration (DIR) is essential for aligning medical images that exhibit anatomical variations, facilitating applications such as disease tracking and radiotherapy planning. While classical iterative methods and deep learning approaches have achieved success in DIR, they are often hindered by computational inefficiency or poor generalization. In this paper, we introduce GaussianDIR, a novel, case-specific optimization DIR method inspired by 3D Gaussian splatting. In general, GaussianDIR represents image deformations using a sparse set of mobile and flexible Gaussian primitives, each defined by a center position, covariance, and local rigid transformation. This compact and explicit representation reduces noise and computational overhead while improving interpretability. Furthermore, the movement of individual voxel is derived via blending the local rigid transformation of the neighboring Gaussian primitives. By this, GaussianDIR captures both global smoothness and local rigidity as well as reduces the computational burden. To address varying levels of deformation complexity, GaussianDIR also integrates an adaptive density control mechanism that dynamically adjusts the density of Gaussian primitives. Additionally, we employ multi-scale Gaussian primitives to capture both coarse and fine deformations, reducing optimization to local minima. Experimental results on brain MRI, lung CT, and cardiac MRI datasets demonstrate that GaussianDIR outperforms existing DIR methods in both accuracy and efficiency, highlighting its potential for clinical applications. Finally, as a training-free approach, it challenges the stereotype that iterative methods are inherently slow and transcend the limitations of poor generalization.</description><subject>Computer Science - Computer Vision and Pattern Recognition</subject><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><sourceid>GOX</sourceid><recordid>eNpjYJA0NNAzsTA1NdBPLKrILNMzMjEw0zMwNrY04WQwdU8sLS7OTMxTCCjKzM0sySxLLVZIyy9ScEkFkrmJSTmpCp65iempCkGp6ZnFJUWJJZn5eTwMrGmJOcWpvFCam0HezTXE2UMXbEF8AdCoxKLKeJBF8WCLjAmrAAB_HjLj</recordid><startdate>20240605</startdate><enddate>20240605</enddate><creator>Li, Jihe</creator><creator>Liu, Xiang</creator><creator>Zhang, Fabian</creator><creator>Li, Xia</creator><creator>Cao, Xixin</creator><creator>Zhang, Ye</creator><creator>Buhmann, Joachim</creator><scope>AKY</scope><scope>GOX</scope></search><sort><creationdate>20240605</creationdate><title>Gaussian Primitives for Deformable Image Registration</title><author>Li, Jihe ; Liu, Xiang ; Zhang, Fabian ; Li, Xia ; Cao, Xixin ; Zhang, Ye ; Buhmann, Joachim</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-arxiv_primary_2406_033943</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Computer Science - Computer Vision and Pattern Recognition</topic><toplevel>online_resources</toplevel><creatorcontrib>Li, Jihe</creatorcontrib><creatorcontrib>Liu, Xiang</creatorcontrib><creatorcontrib>Zhang, Fabian</creatorcontrib><creatorcontrib>Li, Xia</creatorcontrib><creatorcontrib>Cao, Xixin</creatorcontrib><creatorcontrib>Zhang, Ye</creatorcontrib><creatorcontrib>Buhmann, Joachim</creatorcontrib><collection>arXiv Computer Science</collection><collection>arXiv.org</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Li, Jihe</au><au>Liu, Xiang</au><au>Zhang, Fabian</au><au>Li, Xia</au><au>Cao, Xixin</au><au>Zhang, Ye</au><au>Buhmann, Joachim</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Gaussian Primitives for Deformable Image Registration</atitle><date>2024-06-05</date><risdate>2024</risdate><abstract>Deformable Image Registration (DIR) is essential for aligning medical images that exhibit anatomical variations, facilitating applications such as disease tracking and radiotherapy planning. While classical iterative methods and deep learning approaches have achieved success in DIR, they are often hindered by computational inefficiency or poor generalization. In this paper, we introduce GaussianDIR, a novel, case-specific optimization DIR method inspired by 3D Gaussian splatting. In general, GaussianDIR represents image deformations using a sparse set of mobile and flexible Gaussian primitives, each defined by a center position, covariance, and local rigid transformation. This compact and explicit representation reduces noise and computational overhead while improving interpretability. Furthermore, the movement of individual voxel is derived via blending the local rigid transformation of the neighboring Gaussian primitives. By this, GaussianDIR captures both global smoothness and local rigidity as well as reduces the computational burden. To address varying levels of deformation complexity, GaussianDIR also integrates an adaptive density control mechanism that dynamically adjusts the density of Gaussian primitives. Additionally, we employ multi-scale Gaussian primitives to capture both coarse and fine deformations, reducing optimization to local minima. Experimental results on brain MRI, lung CT, and cardiac MRI datasets demonstrate that GaussianDIR outperforms existing DIR methods in both accuracy and efficiency, highlighting its potential for clinical applications. Finally, as a training-free approach, it challenges the stereotype that iterative methods are inherently slow and transcend the limitations of poor generalization.</abstract><doi>10.48550/arxiv.2406.03394</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier DOI: 10.48550/arxiv.2406.03394
ispartof
issn
language eng
recordid cdi_arxiv_primary_2406_03394
source arXiv.org
subjects Computer Science - Computer Vision and Pattern Recognition
title Gaussian Primitives for Deformable Image Registration
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-14T08%3A06%3A23IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-arxiv_GOX&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Gaussian%20Primitives%20for%20Deformable%20Image%20Registration&rft.au=Li,%20Jihe&rft.date=2024-06-05&rft_id=info:doi/10.48550/arxiv.2406.03394&rft_dat=%3Carxiv_GOX%3E2406_03394%3C/arxiv_GOX%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true