FLAME Diffuser: Wildfire Image Synthesis using Mask Guided Diffusion

Wildfires are a significant threat to ecosystems and human infrastructure, leading to widespread destruction and environmental degradation. Recent advancements in deep learning and generative models have enabled new methods for wildfire detection and monitoring. However, the scarcity of annotated wi...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Wang, Hao, Boroujeni, Sayed Pedram Haeri, Chen, Xiwen, Bastola, Ashish, Li, Huayu, Zhu, Wenhui, Razi, Abolfazl
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator Wang, Hao
Boroujeni, Sayed Pedram Haeri
Chen, Xiwen
Bastola, Ashish
Li, Huayu
Zhu, Wenhui
Razi, Abolfazl
description Wildfires are a significant threat to ecosystems and human infrastructure, leading to widespread destruction and environmental degradation. Recent advancements in deep learning and generative models have enabled new methods for wildfire detection and monitoring. However, the scarcity of annotated wildfire images limits the development of robust models for these tasks. In this work, we present the FLAME Diffuser, a training-free, diffusion-based framework designed to generate realistic wildfire images with paired ground truth. Our framework uses augmented masks, sampled from real wildfire data, and applies Perlin noise to guide the generation of realistic flames. By controlling the placement of these elements within the image, we ensure precise integration while maintaining the original images style. We evaluate the generated images using normalized Frechet Inception Distance, CLIP Score, and a custom CLIP Confidence metric, demonstrating the high quality and realism of the synthesized wildfire images. Specifically, the fusion of Perlin noise in this work significantly improved the quality of synthesized images. The proposed method is particularly valuable for enhancing datasets used in downstream tasks such as wildfire detection and monitoring.
doi_str_mv 10.48550/arxiv.2403.03463
format Article
fullrecord <record><control><sourceid>arxiv_GOX</sourceid><recordid>TN_cdi_arxiv_primary_2403_03463</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2403_03463</sourcerecordid><originalsourceid>FETCH-arxiv_primary_2403_034633</originalsourceid><addsrcrecordid>eNpjYJA0NNAzsTA1NdBPLKrILNMzMjEw1jMwNjEz5mRwcfNx9HVVcMlMSystTi2yUgjPzElJyyxKVfDMTUxPVQiuzCvJSC3OLFYoLc7MS1fwTSzOVnAvzUxJTYFqyszP42FgTUvMKU7lhdLcDPJuriHOHrpg--ILijJzE4sq40H2xoPtNSasAgBgDTco</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>FLAME Diffuser: Wildfire Image Synthesis using Mask Guided Diffusion</title><source>arXiv.org</source><creator>Wang, Hao ; Boroujeni, Sayed Pedram Haeri ; Chen, Xiwen ; Bastola, Ashish ; Li, Huayu ; Zhu, Wenhui ; Razi, Abolfazl</creator><creatorcontrib>Wang, Hao ; Boroujeni, Sayed Pedram Haeri ; Chen, Xiwen ; Bastola, Ashish ; Li, Huayu ; Zhu, Wenhui ; Razi, Abolfazl</creatorcontrib><description>Wildfires are a significant threat to ecosystems and human infrastructure, leading to widespread destruction and environmental degradation. Recent advancements in deep learning and generative models have enabled new methods for wildfire detection and monitoring. However, the scarcity of annotated wildfire images limits the development of robust models for these tasks. In this work, we present the FLAME Diffuser, a training-free, diffusion-based framework designed to generate realistic wildfire images with paired ground truth. Our framework uses augmented masks, sampled from real wildfire data, and applies Perlin noise to guide the generation of realistic flames. By controlling the placement of these elements within the image, we ensure precise integration while maintaining the original images style. We evaluate the generated images using normalized Frechet Inception Distance, CLIP Score, and a custom CLIP Confidence metric, demonstrating the high quality and realism of the synthesized wildfire images. Specifically, the fusion of Perlin noise in this work significantly improved the quality of synthesized images. The proposed method is particularly valuable for enhancing datasets used in downstream tasks such as wildfire detection and monitoring.</description><identifier>DOI: 10.48550/arxiv.2403.03463</identifier><language>eng</language><subject>Computer Science - Computer Vision and Pattern Recognition</subject><creationdate>2024-03</creationdate><rights>http://arxiv.org/licenses/nonexclusive-distrib/1.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,776,881</link.rule.ids><linktorsrc>$$Uhttps://arxiv.org/abs/2403.03463$$EView_record_in_Cornell_University$$FView_record_in_$$GCornell_University$$Hfree_for_read</linktorsrc><backlink>$$Uhttps://doi.org/10.48550/arXiv.2403.03463$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Wang, Hao</creatorcontrib><creatorcontrib>Boroujeni, Sayed Pedram Haeri</creatorcontrib><creatorcontrib>Chen, Xiwen</creatorcontrib><creatorcontrib>Bastola, Ashish</creatorcontrib><creatorcontrib>Li, Huayu</creatorcontrib><creatorcontrib>Zhu, Wenhui</creatorcontrib><creatorcontrib>Razi, Abolfazl</creatorcontrib><title>FLAME Diffuser: Wildfire Image Synthesis using Mask Guided Diffusion</title><description>Wildfires are a significant threat to ecosystems and human infrastructure, leading to widespread destruction and environmental degradation. Recent advancements in deep learning and generative models have enabled new methods for wildfire detection and monitoring. However, the scarcity of annotated wildfire images limits the development of robust models for these tasks. In this work, we present the FLAME Diffuser, a training-free, diffusion-based framework designed to generate realistic wildfire images with paired ground truth. Our framework uses augmented masks, sampled from real wildfire data, and applies Perlin noise to guide the generation of realistic flames. By controlling the placement of these elements within the image, we ensure precise integration while maintaining the original images style. We evaluate the generated images using normalized Frechet Inception Distance, CLIP Score, and a custom CLIP Confidence metric, demonstrating the high quality and realism of the synthesized wildfire images. Specifically, the fusion of Perlin noise in this work significantly improved the quality of synthesized images. The proposed method is particularly valuable for enhancing datasets used in downstream tasks such as wildfire detection and monitoring.</description><subject>Computer Science - Computer Vision and Pattern Recognition</subject><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><sourceid>GOX</sourceid><recordid>eNpjYJA0NNAzsTA1NdBPLKrILNMzMjEw1jMwNjEz5mRwcfNx9HVVcMlMSystTi2yUgjPzElJyyxKVfDMTUxPVQiuzCvJSC3OLFYoLc7MS1fwTSzOVnAvzUxJTYFqyszP42FgTUvMKU7lhdLcDPJuriHOHrpg--ILijJzE4sq40H2xoPtNSasAgBgDTco</recordid><startdate>20240305</startdate><enddate>20240305</enddate><creator>Wang, Hao</creator><creator>Boroujeni, Sayed Pedram Haeri</creator><creator>Chen, Xiwen</creator><creator>Bastola, Ashish</creator><creator>Li, Huayu</creator><creator>Zhu, Wenhui</creator><creator>Razi, Abolfazl</creator><scope>AKY</scope><scope>GOX</scope></search><sort><creationdate>20240305</creationdate><title>FLAME Diffuser: Wildfire Image Synthesis using Mask Guided Diffusion</title><author>Wang, Hao ; Boroujeni, Sayed Pedram Haeri ; Chen, Xiwen ; Bastola, Ashish ; Li, Huayu ; Zhu, Wenhui ; Razi, Abolfazl</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-arxiv_primary_2403_034633</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Computer Science - Computer Vision and Pattern Recognition</topic><toplevel>online_resources</toplevel><creatorcontrib>Wang, Hao</creatorcontrib><creatorcontrib>Boroujeni, Sayed Pedram Haeri</creatorcontrib><creatorcontrib>Chen, Xiwen</creatorcontrib><creatorcontrib>Bastola, Ashish</creatorcontrib><creatorcontrib>Li, Huayu</creatorcontrib><creatorcontrib>Zhu, Wenhui</creatorcontrib><creatorcontrib>Razi, Abolfazl</creatorcontrib><collection>arXiv Computer Science</collection><collection>arXiv.org</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Wang, Hao</au><au>Boroujeni, Sayed Pedram Haeri</au><au>Chen, Xiwen</au><au>Bastola, Ashish</au><au>Li, Huayu</au><au>Zhu, Wenhui</au><au>Razi, Abolfazl</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>FLAME Diffuser: Wildfire Image Synthesis using Mask Guided Diffusion</atitle><date>2024-03-05</date><risdate>2024</risdate><abstract>Wildfires are a significant threat to ecosystems and human infrastructure, leading to widespread destruction and environmental degradation. Recent advancements in deep learning and generative models have enabled new methods for wildfire detection and monitoring. However, the scarcity of annotated wildfire images limits the development of robust models for these tasks. In this work, we present the FLAME Diffuser, a training-free, diffusion-based framework designed to generate realistic wildfire images with paired ground truth. Our framework uses augmented masks, sampled from real wildfire data, and applies Perlin noise to guide the generation of realistic flames. By controlling the placement of these elements within the image, we ensure precise integration while maintaining the original images style. We evaluate the generated images using normalized Frechet Inception Distance, CLIP Score, and a custom CLIP Confidence metric, demonstrating the high quality and realism of the synthesized wildfire images. Specifically, the fusion of Perlin noise in this work significantly improved the quality of synthesized images. The proposed method is particularly valuable for enhancing datasets used in downstream tasks such as wildfire detection and monitoring.</abstract><doi>10.48550/arxiv.2403.03463</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier DOI: 10.48550/arxiv.2403.03463
ispartof
issn
language eng
recordid cdi_arxiv_primary_2403_03463
source arXiv.org
subjects Computer Science - Computer Vision and Pattern Recognition
title FLAME Diffuser: Wildfire Image Synthesis using Mask Guided Diffusion
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-15T01%3A22%3A57IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-arxiv_GOX&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=FLAME%20Diffuser:%20Wildfire%20Image%20Synthesis%20using%20Mask%20Guided%20Diffusion&rft.au=Wang,%20Hao&rft.date=2024-03-05&rft_id=info:doi/10.48550/arxiv.2403.03463&rft_dat=%3Carxiv_GOX%3E2403_03463%3C/arxiv_GOX%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true