Diffusion models in medical imaging: A comprehensive survey

Denoising diffusion models, a class of generative models, have garnered immense interest lately in various deep-learning problems. A diffusion probabilistic model defines a forward diffusion stage where the input data is gradually perturbed over several steps by adding Gaussian noise and then learns...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Medical image analysis 2023-08, Vol.88, p.102846-102846, Article 102846
Hauptverfasser: Kazerouni, Amirhossein, Aghdam, Ehsan Khodapanah, Heidari, Moein, Azad, Reza, Fayyaz, Mohsen, Hacihaliloglu, Ilker, Merhof, Dorit
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 102846
container_issue
container_start_page 102846
container_title Medical image analysis
container_volume 88
creator Kazerouni, Amirhossein
Aghdam, Ehsan Khodapanah
Heidari, Moein
Azad, Reza
Fayyaz, Mohsen
Hacihaliloglu, Ilker
Merhof, Dorit
description Denoising diffusion models, a class of generative models, have garnered immense interest lately in various deep-learning problems. A diffusion probabilistic model defines a forward diffusion stage where the input data is gradually perturbed over several steps by adding Gaussian noise and then learns to reverse the diffusion process to retrieve the desired noise-free data from noisy data samples. Diffusion models are widely appreciated for their strong mode coverage and quality of the generated samples in spite of their known computational burdens. Capitalizing on the advances in computer vision, the field of medical imaging has also observed a growing interest in diffusion models. With the aim of helping the researcher navigate this profusion, this survey intends to provide a comprehensive overview of diffusion models in the discipline of medical imaging. Specifically, we start with an introduction to the solid theoretical foundation and fundamental concepts behind diffusion models and the three generic diffusion modeling frameworks, namely, diffusion probabilistic models, noise-conditioned score networks, and stochastic differential equations. Then, we provide a systematic taxonomy of diffusion models in the medical domain and propose a multi-perspective categorization based on their application, imaging modality, organ of interest, and algorithms. To this end, we cover extensive applications of diffusion models in the medical domain, including image-to-image translation, reconstruction, registration, classification, segmentation, denoising, 2/3D generation, anomaly detection, and other medically-related challenges. Furthermore, we emphasize the practical use case of some selected approaches, and then we discuss the limitations of the diffusion models in the medical domain and propose several directions to fulfill the demands of this field. Finally, we gather the overviewed studies with their available open-source implementations at our GitHub.11https://github.com/amirhossein-kz/Awesome-Diffusion-Models-in-Medical-Imaging. We aim to update the relevant latest papers within it regularly. •This is the first survey paper on the diffusion models in the medical imaging•A multi-perspective categorization of diffusion models in the medical community•Detailed study of different application in medical imagning•A new taxonomy based on algorithm, organ concerned and imaging modality.•Finally, we discuss the challenges and open issues in diffusion models
doi_str_mv 10.1016/j.media.2023.102846
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_2824692180</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S1361841523001068</els_id><sourcerecordid>2824692180</sourcerecordid><originalsourceid>FETCH-LOGICAL-c409t-a4dfbc75a6ab7c1558d2a8f33a0203df0306550036c645aa66cfe82bef8f6d4e3</originalsourceid><addsrcrecordid>eNp9kE1LAzEQhoMotlZ_gSB79LI135sqHkr9hIIXPYdsdlJT9qMm3UL_vamtHj3NMPPO-zIPQpcEjwkm8mY5bqDyZkwxZWlCFZdHaEiYJLnilB3_9UQM0FmMS4xxwTk-RQNW0IlghAzR3YN3ro--a7Omq6COmU9d8rWmznxjFr5d3GbTzHbNKsAntNFvIIt92MD2HJ04U0e4ONQR-nh6fJ-95PO359fZdJ5bjifr3PDKlbYQRpqysEQIVVGjHGMGU8wqhxmWQmDMpJVcGCOldaBoCU45WXFgI3S9912F7quHuNaNjxbq2rTQ9VFTRbmcUKJwkrK91IYuxgBOr0L6Imw1wXpHTS_1DzW9o6b31NLV1SGgL9P27-YXUxLc7wUJEGw8BB2th9YmpwB2ravO_xvwDfZUff8</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2824692180</pqid></control><display><type>article</type><title>Diffusion models in medical imaging: A comprehensive survey</title><source>Elsevier ScienceDirect Journals Complete</source><creator>Kazerouni, Amirhossein ; Aghdam, Ehsan Khodapanah ; Heidari, Moein ; Azad, Reza ; Fayyaz, Mohsen ; Hacihaliloglu, Ilker ; Merhof, Dorit</creator><creatorcontrib>Kazerouni, Amirhossein ; Aghdam, Ehsan Khodapanah ; Heidari, Moein ; Azad, Reza ; Fayyaz, Mohsen ; Hacihaliloglu, Ilker ; Merhof, Dorit</creatorcontrib><description>Denoising diffusion models, a class of generative models, have garnered immense interest lately in various deep-learning problems. A diffusion probabilistic model defines a forward diffusion stage where the input data is gradually perturbed over several steps by adding Gaussian noise and then learns to reverse the diffusion process to retrieve the desired noise-free data from noisy data samples. Diffusion models are widely appreciated for their strong mode coverage and quality of the generated samples in spite of their known computational burdens. Capitalizing on the advances in computer vision, the field of medical imaging has also observed a growing interest in diffusion models. With the aim of helping the researcher navigate this profusion, this survey intends to provide a comprehensive overview of diffusion models in the discipline of medical imaging. Specifically, we start with an introduction to the solid theoretical foundation and fundamental concepts behind diffusion models and the three generic diffusion modeling frameworks, namely, diffusion probabilistic models, noise-conditioned score networks, and stochastic differential equations. Then, we provide a systematic taxonomy of diffusion models in the medical domain and propose a multi-perspective categorization based on their application, imaging modality, organ of interest, and algorithms. To this end, we cover extensive applications of diffusion models in the medical domain, including image-to-image translation, reconstruction, registration, classification, segmentation, denoising, 2/3D generation, anomaly detection, and other medically-related challenges. Furthermore, we emphasize the practical use case of some selected approaches, and then we discuss the limitations of the diffusion models in the medical domain and propose several directions to fulfill the demands of this field. Finally, we gather the overviewed studies with their available open-source implementations at our GitHub.11https://github.com/amirhossein-kz/Awesome-Diffusion-Models-in-Medical-Imaging. We aim to update the relevant latest papers within it regularly. •This is the first survey paper on the diffusion models in the medical imaging•A multi-perspective categorization of diffusion models in the medical community•Detailed study of different application in medical imagning•A new taxonomy based on algorithm, organ concerned and imaging modality.•Finally, we discuss the challenges and open issues in diffusion models</description><identifier>ISSN: 1361-8415</identifier><identifier>EISSN: 1361-8423</identifier><identifier>DOI: 10.1016/j.media.2023.102846</identifier><identifier>PMID: 37295311</identifier><language>eng</language><publisher>Netherlands: Elsevier B.V</publisher><subject>Denoising diffusion models ; Diffusion models ; Generative models ; Medical applications ; Medical imaging ; Noise conditioned score networks ; Score-based models ; Survey</subject><ispartof>Medical image analysis, 2023-08, Vol.88, p.102846-102846, Article 102846</ispartof><rights>2023 Elsevier B.V.</rights><rights>Copyright © 2023 Elsevier B.V. All rights reserved.</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c409t-a4dfbc75a6ab7c1558d2a8f33a0203df0306550036c645aa66cfe82bef8f6d4e3</citedby><cites>FETCH-LOGICAL-c409t-a4dfbc75a6ab7c1558d2a8f33a0203df0306550036c645aa66cfe82bef8f6d4e3</cites><orcidid>0000-0003-3232-8193 ; 0000-0002-3155-4407 ; 0000-0002-1672-2185 ; 0000-0003-3676-0127 ; 0000-0001-5254-3128</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://dx.doi.org/10.1016/j.media.2023.102846$$EHTML$$P50$$Gelsevier$$H</linktohtml><link.rule.ids>314,776,780,3536,27903,27904,45974</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/37295311$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Kazerouni, Amirhossein</creatorcontrib><creatorcontrib>Aghdam, Ehsan Khodapanah</creatorcontrib><creatorcontrib>Heidari, Moein</creatorcontrib><creatorcontrib>Azad, Reza</creatorcontrib><creatorcontrib>Fayyaz, Mohsen</creatorcontrib><creatorcontrib>Hacihaliloglu, Ilker</creatorcontrib><creatorcontrib>Merhof, Dorit</creatorcontrib><title>Diffusion models in medical imaging: A comprehensive survey</title><title>Medical image analysis</title><addtitle>Med Image Anal</addtitle><description>Denoising diffusion models, a class of generative models, have garnered immense interest lately in various deep-learning problems. A diffusion probabilistic model defines a forward diffusion stage where the input data is gradually perturbed over several steps by adding Gaussian noise and then learns to reverse the diffusion process to retrieve the desired noise-free data from noisy data samples. Diffusion models are widely appreciated for their strong mode coverage and quality of the generated samples in spite of their known computational burdens. Capitalizing on the advances in computer vision, the field of medical imaging has also observed a growing interest in diffusion models. With the aim of helping the researcher navigate this profusion, this survey intends to provide a comprehensive overview of diffusion models in the discipline of medical imaging. Specifically, we start with an introduction to the solid theoretical foundation and fundamental concepts behind diffusion models and the three generic diffusion modeling frameworks, namely, diffusion probabilistic models, noise-conditioned score networks, and stochastic differential equations. Then, we provide a systematic taxonomy of diffusion models in the medical domain and propose a multi-perspective categorization based on their application, imaging modality, organ of interest, and algorithms. To this end, we cover extensive applications of diffusion models in the medical domain, including image-to-image translation, reconstruction, registration, classification, segmentation, denoising, 2/3D generation, anomaly detection, and other medically-related challenges. Furthermore, we emphasize the practical use case of some selected approaches, and then we discuss the limitations of the diffusion models in the medical domain and propose several directions to fulfill the demands of this field. Finally, we gather the overviewed studies with their available open-source implementations at our GitHub.11https://github.com/amirhossein-kz/Awesome-Diffusion-Models-in-Medical-Imaging. We aim to update the relevant latest papers within it regularly. •This is the first survey paper on the diffusion models in the medical imaging•A multi-perspective categorization of diffusion models in the medical community•Detailed study of different application in medical imagning•A new taxonomy based on algorithm, organ concerned and imaging modality.•Finally, we discuss the challenges and open issues in diffusion models</description><subject>Denoising diffusion models</subject><subject>Diffusion models</subject><subject>Generative models</subject><subject>Medical applications</subject><subject>Medical imaging</subject><subject>Noise conditioned score networks</subject><subject>Score-based models</subject><subject>Survey</subject><issn>1361-8415</issn><issn>1361-8423</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><recordid>eNp9kE1LAzEQhoMotlZ_gSB79LI135sqHkr9hIIXPYdsdlJT9qMm3UL_vamtHj3NMPPO-zIPQpcEjwkm8mY5bqDyZkwxZWlCFZdHaEiYJLnilB3_9UQM0FmMS4xxwTk-RQNW0IlghAzR3YN3ro--a7Omq6COmU9d8rWmznxjFr5d3GbTzHbNKsAntNFvIIt92MD2HJ04U0e4ONQR-nh6fJ-95PO359fZdJ5bjifr3PDKlbYQRpqysEQIVVGjHGMGU8wqhxmWQmDMpJVcGCOldaBoCU45WXFgI3S9912F7quHuNaNjxbq2rTQ9VFTRbmcUKJwkrK91IYuxgBOr0L6Imw1wXpHTS_1DzW9o6b31NLV1SGgL9P27-YXUxLc7wUJEGw8BB2th9YmpwB2ravO_xvwDfZUff8</recordid><startdate>202308</startdate><enddate>202308</enddate><creator>Kazerouni, Amirhossein</creator><creator>Aghdam, Ehsan Khodapanah</creator><creator>Heidari, Moein</creator><creator>Azad, Reza</creator><creator>Fayyaz, Mohsen</creator><creator>Hacihaliloglu, Ilker</creator><creator>Merhof, Dorit</creator><general>Elsevier B.V</general><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7X8</scope><orcidid>https://orcid.org/0000-0003-3232-8193</orcidid><orcidid>https://orcid.org/0000-0002-3155-4407</orcidid><orcidid>https://orcid.org/0000-0002-1672-2185</orcidid><orcidid>https://orcid.org/0000-0003-3676-0127</orcidid><orcidid>https://orcid.org/0000-0001-5254-3128</orcidid></search><sort><creationdate>202308</creationdate><title>Diffusion models in medical imaging: A comprehensive survey</title><author>Kazerouni, Amirhossein ; Aghdam, Ehsan Khodapanah ; Heidari, Moein ; Azad, Reza ; Fayyaz, Mohsen ; Hacihaliloglu, Ilker ; Merhof, Dorit</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c409t-a4dfbc75a6ab7c1558d2a8f33a0203df0306550036c645aa66cfe82bef8f6d4e3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Denoising diffusion models</topic><topic>Diffusion models</topic><topic>Generative models</topic><topic>Medical applications</topic><topic>Medical imaging</topic><topic>Noise conditioned score networks</topic><topic>Score-based models</topic><topic>Survey</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Kazerouni, Amirhossein</creatorcontrib><creatorcontrib>Aghdam, Ehsan Khodapanah</creatorcontrib><creatorcontrib>Heidari, Moein</creatorcontrib><creatorcontrib>Azad, Reza</creatorcontrib><creatorcontrib>Fayyaz, Mohsen</creatorcontrib><creatorcontrib>Hacihaliloglu, Ilker</creatorcontrib><creatorcontrib>Merhof, Dorit</creatorcontrib><collection>PubMed</collection><collection>CrossRef</collection><collection>MEDLINE - Academic</collection><jtitle>Medical image analysis</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Kazerouni, Amirhossein</au><au>Aghdam, Ehsan Khodapanah</au><au>Heidari, Moein</au><au>Azad, Reza</au><au>Fayyaz, Mohsen</au><au>Hacihaliloglu, Ilker</au><au>Merhof, Dorit</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Diffusion models in medical imaging: A comprehensive survey</atitle><jtitle>Medical image analysis</jtitle><addtitle>Med Image Anal</addtitle><date>2023-08</date><risdate>2023</risdate><volume>88</volume><spage>102846</spage><epage>102846</epage><pages>102846-102846</pages><artnum>102846</artnum><issn>1361-8415</issn><eissn>1361-8423</eissn><abstract>Denoising diffusion models, a class of generative models, have garnered immense interest lately in various deep-learning problems. A diffusion probabilistic model defines a forward diffusion stage where the input data is gradually perturbed over several steps by adding Gaussian noise and then learns to reverse the diffusion process to retrieve the desired noise-free data from noisy data samples. Diffusion models are widely appreciated for their strong mode coverage and quality of the generated samples in spite of their known computational burdens. Capitalizing on the advances in computer vision, the field of medical imaging has also observed a growing interest in diffusion models. With the aim of helping the researcher navigate this profusion, this survey intends to provide a comprehensive overview of diffusion models in the discipline of medical imaging. Specifically, we start with an introduction to the solid theoretical foundation and fundamental concepts behind diffusion models and the three generic diffusion modeling frameworks, namely, diffusion probabilistic models, noise-conditioned score networks, and stochastic differential equations. Then, we provide a systematic taxonomy of diffusion models in the medical domain and propose a multi-perspective categorization based on their application, imaging modality, organ of interest, and algorithms. To this end, we cover extensive applications of diffusion models in the medical domain, including image-to-image translation, reconstruction, registration, classification, segmentation, denoising, 2/3D generation, anomaly detection, and other medically-related challenges. Furthermore, we emphasize the practical use case of some selected approaches, and then we discuss the limitations of the diffusion models in the medical domain and propose several directions to fulfill the demands of this field. Finally, we gather the overviewed studies with their available open-source implementations at our GitHub.11https://github.com/amirhossein-kz/Awesome-Diffusion-Models-in-Medical-Imaging. We aim to update the relevant latest papers within it regularly. •This is the first survey paper on the diffusion models in the medical imaging•A multi-perspective categorization of diffusion models in the medical community•Detailed study of different application in medical imagning•A new taxonomy based on algorithm, organ concerned and imaging modality.•Finally, we discuss the challenges and open issues in diffusion models</abstract><cop>Netherlands</cop><pub>Elsevier B.V</pub><pmid>37295311</pmid><doi>10.1016/j.media.2023.102846</doi><tpages>1</tpages><orcidid>https://orcid.org/0000-0003-3232-8193</orcidid><orcidid>https://orcid.org/0000-0002-3155-4407</orcidid><orcidid>https://orcid.org/0000-0002-1672-2185</orcidid><orcidid>https://orcid.org/0000-0003-3676-0127</orcidid><orcidid>https://orcid.org/0000-0001-5254-3128</orcidid></addata></record>
fulltext fulltext
identifier ISSN: 1361-8415
ispartof Medical image analysis, 2023-08, Vol.88, p.102846-102846, Article 102846
issn 1361-8415
1361-8423
language eng
recordid cdi_proquest_miscellaneous_2824692180
source Elsevier ScienceDirect Journals Complete
subjects Denoising diffusion models
Diffusion models
Generative models
Medical applications
Medical imaging
Noise conditioned score networks
Score-based models
Survey
title Diffusion models in medical imaging: A comprehensive survey
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-22T04%3A46%3A49IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Diffusion%20models%20in%20medical%20imaging:%20A%20comprehensive%20survey&rft.jtitle=Medical%20image%20analysis&rft.au=Kazerouni,%20Amirhossein&rft.date=2023-08&rft.volume=88&rft.spage=102846&rft.epage=102846&rft.pages=102846-102846&rft.artnum=102846&rft.issn=1361-8415&rft.eissn=1361-8423&rft_id=info:doi/10.1016/j.media.2023.102846&rft_dat=%3Cproquest_cross%3E2824692180%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2824692180&rft_id=info:pmid/37295311&rft_els_id=S1361841523001068&rfr_iscdi=true