Real-time fire detection algorithms running on small embedded devices based on MobileNetV3 and YOLOv4
Aim Fires are a serious threat to people’s lives and property. Detecting fires quickly and effectively and extinguishing them in the nascent stage is an effective way to reduce fire hazards. Currently, deep learning-based fire detection algorithms are usually deployed on the PC side. Methods After m...
Gespeichert in:
Veröffentlicht in: | Fire Ecology 2023-12, Vol.19 (1), p.31, Article 31 |
---|---|
Hauptverfasser: | , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | |
---|---|
container_issue | 1 |
container_start_page | 31 |
container_title | Fire Ecology |
container_volume | 19 |
creator | Zheng, Hongtao Duan, Junchen Dong, Yu Liu, Yan |
description | Aim
Fires are a serious threat to people’s lives and property. Detecting fires quickly and effectively and extinguishing them in the nascent stage is an effective way to reduce fire hazards. Currently, deep learning-based fire detection algorithms are usually deployed on the PC side.
Methods
After migrating to small embedded devices, the accuracy and speed of recognition are degraded due to the lack of computing power. In this paper, we propose a real-time fire detection algorithm based on MobileNetV3-large and yolov4, replacing CSP Darknet53 in yolov4 with MobileNetV3-large to achieve the initial extraction of flame and smoke features while greatly reducing the computational effort of the network structure. A path connecting PANet was explored on Gbneck(104, 104, 24), while SPP was embedded in the path from MobileNetV3 to PANet to improve the feature extraction capability for small targets; the PANet in yolo4 was improved by combining the BiFPN path fusion method, and the improved PANet further improved the feature extraction capability; the Vision Transformer model is added to the backbone feature extraction network and PANet of the YOLOv4 model to give full play to the model’s multi-headed attention mechanism for pre-processing image features; adding ECA Net to the head network of yolo4 improves the overall recognition performance of the network.
Result
These algorithms run well on PC and reach 95.14% recognition accuracy on the public dataset BoWFire. Finally, these algorithms were migrated to the Jeston Xavier NX platform, and the entire network was quantized and accelerated with the TensorRT algorithm. With the image propagation function of the fire robot, the overall recognition frame rate can reach about 26.13 with high real-time performance while maintaining a high recognition accuracy.
Conclusion
Several comparative experiments have also validated the effectiveness of this paper’s improvements to the YOLOv4 algorithm and the superiority of these structures. With the effective integration of these components, the algorithm shows high accuracy and real-time performance. |
doi_str_mv | 10.1186/s42408-023-00189-0 |
format | Article |
fullrecord | <record><control><sourceid>gale_proqu</sourceid><recordid>TN_cdi_proquest_journals_2813777277</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><galeid>A749458992</galeid><sourcerecordid>A749458992</sourcerecordid><originalsourceid>FETCH-LOGICAL-c436t-eb1b149eb8321351522b72de806b707e7933cad40d7326955473010dfe115be3</originalsourceid><addsrcrecordid>eNp9kU1LAzEQhhdRsNT-AU8Bz1vztZvssRS_oFqQIngKyWa2puxma7It-O-NrqAnM4ckM--TzPBm2SXBc0JkeR055VjmmLIcYyKrHJ9kE1IxlleCi9M_5_NsFuMOp8UYEUJOMngG3eaD6wA1LgCyMEA9uN4j3W774Ia3LqJw8N75LUrZ2Om2RdAZsBZskh9dDREZHdMt1R9741p4guGFIe0tel2v1kd-kZ01uo0w-9mn2eb2ZrO8z1fru4flYpXXnJVDDoYYwiswklHCClJQagS1IHFpBBYg0hy1thxbwWhZFQUXDBNsGyCkMMCm2dX47D707weIg9r1h-DTj4pKwoQQVIikmo-qrW5BOd_0Q9B1Cgudq3sPTZpALQSveCGriiaAjkAd-hgDNGofXKfDhyJYfTmgRgdUckB9O6BwgtgIxST2Wwi_vfxDfQJ9O4ce</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2813777277</pqid></control><display><type>article</type><title>Real-time fire detection algorithms running on small embedded devices based on MobileNetV3 and YOLOv4</title><source>Springer Open Access</source><source>DOAJ Directory of Open Access Journals</source><source>EZB-FREE-00999 freely available EZB journals</source><source>SpringerLink Journals - AutoHoldings</source><creator>Zheng, Hongtao ; Duan, Junchen ; Dong, Yu ; Liu, Yan</creator><creatorcontrib>Zheng, Hongtao ; Duan, Junchen ; Dong, Yu ; Liu, Yan</creatorcontrib><description>Aim
Fires are a serious threat to people’s lives and property. Detecting fires quickly and effectively and extinguishing them in the nascent stage is an effective way to reduce fire hazards. Currently, deep learning-based fire detection algorithms are usually deployed on the PC side.
Methods
After migrating to small embedded devices, the accuracy and speed of recognition are degraded due to the lack of computing power. In this paper, we propose a real-time fire detection algorithm based on MobileNetV3-large and yolov4, replacing CSP Darknet53 in yolov4 with MobileNetV3-large to achieve the initial extraction of flame and smoke features while greatly reducing the computational effort of the network structure. A path connecting PANet was explored on Gbneck(104, 104, 24), while SPP was embedded in the path from MobileNetV3 to PANet to improve the feature extraction capability for small targets; the PANet in yolo4 was improved by combining the BiFPN path fusion method, and the improved PANet further improved the feature extraction capability; the Vision Transformer model is added to the backbone feature extraction network and PANet of the YOLOv4 model to give full play to the model’s multi-headed attention mechanism for pre-processing image features; adding ECA Net to the head network of yolo4 improves the overall recognition performance of the network.
Result
These algorithms run well on PC and reach 95.14% recognition accuracy on the public dataset BoWFire. Finally, these algorithms were migrated to the Jeston Xavier NX platform, and the entire network was quantized and accelerated with the TensorRT algorithm. With the image propagation function of the fire robot, the overall recognition frame rate can reach about 26.13 with high real-time performance while maintaining a high recognition accuracy.
Conclusion
Several comparative experiments have also validated the effectiveness of this paper’s improvements to the YOLOv4 algorithm and the superiority of these structures. With the effective integration of these components, the algorithm shows high accuracy and real-time performance.</description><identifier>ISSN: 1933-9747</identifier><identifier>EISSN: 1933-9747</identifier><identifier>DOI: 10.1186/s42408-023-00189-0</identifier><language>eng</language><publisher>Cham: Springer International Publishing</publisher><subject>Accuracy ; Algorithms ; Analysis ; Biomedical and Life Sciences ; Deep learning ; Ecology ; Electronic devices ; Embedded systems ; Feature extraction ; Fire detection ; Fire hazards ; Fires ; Forestry ; Life Sciences ; Machine learning ; Object recognition ; Original Research ; Real time ; Remote Sensing for Wildfire Management Potential and Impacts ; Robots ; Tensors</subject><ispartof>Fire Ecology, 2023-12, Vol.19 (1), p.31, Article 31</ispartof><rights>The Author(s) 2023</rights><rights>COPYRIGHT 2023 Springer</rights><rights>The Author(s) 2023. This work is published under http://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c436t-eb1b149eb8321351522b72de806b707e7933cad40d7326955473010dfe115be3</citedby><cites>FETCH-LOGICAL-c436t-eb1b149eb8321351522b72de806b707e7933cad40d7326955473010dfe115be3</cites><orcidid>0000-0002-1128-0752</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://link.springer.com/content/pdf/10.1186/s42408-023-00189-0$$EPDF$$P50$$Gspringer$$Hfree_for_read</linktopdf><linktohtml>$$Uhttps://doi.org/10.1186/s42408-023-00189-0$$EHTML$$P50$$Gspringer$$Hfree_for_read</linktohtml><link.rule.ids>314,780,784,864,27924,27925,41120,41488,42189,42557,51319,51576</link.rule.ids></links><search><creatorcontrib>Zheng, Hongtao</creatorcontrib><creatorcontrib>Duan, Junchen</creatorcontrib><creatorcontrib>Dong, Yu</creatorcontrib><creatorcontrib>Liu, Yan</creatorcontrib><title>Real-time fire detection algorithms running on small embedded devices based on MobileNetV3 and YOLOv4</title><title>Fire Ecology</title><addtitle>fire ecol</addtitle><description>Aim
Fires are a serious threat to people’s lives and property. Detecting fires quickly and effectively and extinguishing them in the nascent stage is an effective way to reduce fire hazards. Currently, deep learning-based fire detection algorithms are usually deployed on the PC side.
Methods
After migrating to small embedded devices, the accuracy and speed of recognition are degraded due to the lack of computing power. In this paper, we propose a real-time fire detection algorithm based on MobileNetV3-large and yolov4, replacing CSP Darknet53 in yolov4 with MobileNetV3-large to achieve the initial extraction of flame and smoke features while greatly reducing the computational effort of the network structure. A path connecting PANet was explored on Gbneck(104, 104, 24), while SPP was embedded in the path from MobileNetV3 to PANet to improve the feature extraction capability for small targets; the PANet in yolo4 was improved by combining the BiFPN path fusion method, and the improved PANet further improved the feature extraction capability; the Vision Transformer model is added to the backbone feature extraction network and PANet of the YOLOv4 model to give full play to the model’s multi-headed attention mechanism for pre-processing image features; adding ECA Net to the head network of yolo4 improves the overall recognition performance of the network.
Result
These algorithms run well on PC and reach 95.14% recognition accuracy on the public dataset BoWFire. Finally, these algorithms were migrated to the Jeston Xavier NX platform, and the entire network was quantized and accelerated with the TensorRT algorithm. With the image propagation function of the fire robot, the overall recognition frame rate can reach about 26.13 with high real-time performance while maintaining a high recognition accuracy.
Conclusion
Several comparative experiments have also validated the effectiveness of this paper’s improvements to the YOLOv4 algorithm and the superiority of these structures. With the effective integration of these components, the algorithm shows high accuracy and real-time performance.</description><subject>Accuracy</subject><subject>Algorithms</subject><subject>Analysis</subject><subject>Biomedical and Life Sciences</subject><subject>Deep learning</subject><subject>Ecology</subject><subject>Electronic devices</subject><subject>Embedded systems</subject><subject>Feature extraction</subject><subject>Fire detection</subject><subject>Fire hazards</subject><subject>Fires</subject><subject>Forestry</subject><subject>Life Sciences</subject><subject>Machine learning</subject><subject>Object recognition</subject><subject>Original Research</subject><subject>Real time</subject><subject>Remote Sensing for Wildfire Management Potential and Impacts</subject><subject>Robots</subject><subject>Tensors</subject><issn>1933-9747</issn><issn>1933-9747</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><sourceid>C6C</sourceid><sourceid>ABUWG</sourceid><sourceid>AFKRA</sourceid><sourceid>AZQEC</sourceid><sourceid>BENPR</sourceid><sourceid>CCPQU</sourceid><sourceid>DWQXO</sourceid><recordid>eNp9kU1LAzEQhhdRsNT-AU8Bz1vztZvssRS_oFqQIngKyWa2puxma7It-O-NrqAnM4ckM--TzPBm2SXBc0JkeR055VjmmLIcYyKrHJ9kE1IxlleCi9M_5_NsFuMOp8UYEUJOMngG3eaD6wA1LgCyMEA9uN4j3W774Ia3LqJw8N75LUrZ2Om2RdAZsBZskh9dDREZHdMt1R9741p4guGFIe0tel2v1kd-kZ01uo0w-9mn2eb2ZrO8z1fru4flYpXXnJVDDoYYwiswklHCClJQagS1IHFpBBYg0hy1thxbwWhZFQUXDBNsGyCkMMCm2dX47D707weIg9r1h-DTj4pKwoQQVIikmo-qrW5BOd_0Q9B1Cgudq3sPTZpALQSveCGriiaAjkAd-hgDNGofXKfDhyJYfTmgRgdUckB9O6BwgtgIxST2Wwi_vfxDfQJ9O4ce</recordid><startdate>20231201</startdate><enddate>20231201</enddate><creator>Zheng, Hongtao</creator><creator>Duan, Junchen</creator><creator>Dong, Yu</creator><creator>Liu, Yan</creator><general>Springer International Publishing</general><general>Springer</general><general>Springer Nature B.V</general><scope>C6C</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>IAO</scope><scope>7SN</scope><scope>7ST</scope><scope>7U6</scope><scope>ABUWG</scope><scope>AEUYN</scope><scope>AFKRA</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>C1K</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><orcidid>https://orcid.org/0000-0002-1128-0752</orcidid></search><sort><creationdate>20231201</creationdate><title>Real-time fire detection algorithms running on small embedded devices based on MobileNetV3 and YOLOv4</title><author>Zheng, Hongtao ; Duan, Junchen ; Dong, Yu ; Liu, Yan</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c436t-eb1b149eb8321351522b72de806b707e7933cad40d7326955473010dfe115be3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Accuracy</topic><topic>Algorithms</topic><topic>Analysis</topic><topic>Biomedical and Life Sciences</topic><topic>Deep learning</topic><topic>Ecology</topic><topic>Electronic devices</topic><topic>Embedded systems</topic><topic>Feature extraction</topic><topic>Fire detection</topic><topic>Fire hazards</topic><topic>Fires</topic><topic>Forestry</topic><topic>Life Sciences</topic><topic>Machine learning</topic><topic>Object recognition</topic><topic>Original Research</topic><topic>Real time</topic><topic>Remote Sensing for Wildfire Management Potential and Impacts</topic><topic>Robots</topic><topic>Tensors</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Zheng, Hongtao</creatorcontrib><creatorcontrib>Duan, Junchen</creatorcontrib><creatorcontrib>Dong, Yu</creatorcontrib><creatorcontrib>Liu, Yan</creatorcontrib><collection>Springer Open Access</collection><collection>CrossRef</collection><collection>Gale Academic OneFile</collection><collection>Ecology Abstracts</collection><collection>Environment Abstracts</collection><collection>Sustainability Science Abstracts</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest One Sustainability</collection><collection>ProQuest Central UK/Ireland</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Environmental Sciences and Pollution Management</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>Publicly Available Content Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><jtitle>Fire Ecology</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Zheng, Hongtao</au><au>Duan, Junchen</au><au>Dong, Yu</au><au>Liu, Yan</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Real-time fire detection algorithms running on small embedded devices based on MobileNetV3 and YOLOv4</atitle><jtitle>Fire Ecology</jtitle><stitle>fire ecol</stitle><date>2023-12-01</date><risdate>2023</risdate><volume>19</volume><issue>1</issue><spage>31</spage><pages>31-</pages><artnum>31</artnum><issn>1933-9747</issn><eissn>1933-9747</eissn><abstract>Aim
Fires are a serious threat to people’s lives and property. Detecting fires quickly and effectively and extinguishing them in the nascent stage is an effective way to reduce fire hazards. Currently, deep learning-based fire detection algorithms are usually deployed on the PC side.
Methods
After migrating to small embedded devices, the accuracy and speed of recognition are degraded due to the lack of computing power. In this paper, we propose a real-time fire detection algorithm based on MobileNetV3-large and yolov4, replacing CSP Darknet53 in yolov4 with MobileNetV3-large to achieve the initial extraction of flame and smoke features while greatly reducing the computational effort of the network structure. A path connecting PANet was explored on Gbneck(104, 104, 24), while SPP was embedded in the path from MobileNetV3 to PANet to improve the feature extraction capability for small targets; the PANet in yolo4 was improved by combining the BiFPN path fusion method, and the improved PANet further improved the feature extraction capability; the Vision Transformer model is added to the backbone feature extraction network and PANet of the YOLOv4 model to give full play to the model’s multi-headed attention mechanism for pre-processing image features; adding ECA Net to the head network of yolo4 improves the overall recognition performance of the network.
Result
These algorithms run well on PC and reach 95.14% recognition accuracy on the public dataset BoWFire. Finally, these algorithms were migrated to the Jeston Xavier NX platform, and the entire network was quantized and accelerated with the TensorRT algorithm. With the image propagation function of the fire robot, the overall recognition frame rate can reach about 26.13 with high real-time performance while maintaining a high recognition accuracy.
Conclusion
Several comparative experiments have also validated the effectiveness of this paper’s improvements to the YOLOv4 algorithm and the superiority of these structures. With the effective integration of these components, the algorithm shows high accuracy and real-time performance.</abstract><cop>Cham</cop><pub>Springer International Publishing</pub><doi>10.1186/s42408-023-00189-0</doi><orcidid>https://orcid.org/0000-0002-1128-0752</orcidid><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | ISSN: 1933-9747 |
ispartof | Fire Ecology, 2023-12, Vol.19 (1), p.31, Article 31 |
issn | 1933-9747 1933-9747 |
language | eng |
recordid | cdi_proquest_journals_2813777277 |
source | Springer Open Access; DOAJ Directory of Open Access Journals; EZB-FREE-00999 freely available EZB journals; SpringerLink Journals - AutoHoldings |
subjects | Accuracy Algorithms Analysis Biomedical and Life Sciences Deep learning Ecology Electronic devices Embedded systems Feature extraction Fire detection Fire hazards Fires Forestry Life Sciences Machine learning Object recognition Original Research Real time Remote Sensing for Wildfire Management Potential and Impacts Robots Tensors |
title | Real-time fire detection algorithms running on small embedded devices based on MobileNetV3 and YOLOv4 |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-07T20%3A35%3A05IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-gale_proqu&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Real-time%20fire%20detection%20algorithms%20running%20on%20small%20embedded%20devices%20based%20on%20MobileNetV3%20and%20YOLOv4&rft.jtitle=Fire%20Ecology&rft.au=Zheng,%20Hongtao&rft.date=2023-12-01&rft.volume=19&rft.issue=1&rft.spage=31&rft.pages=31-&rft.artnum=31&rft.issn=1933-9747&rft.eissn=1933-9747&rft_id=info:doi/10.1186/s42408-023-00189-0&rft_dat=%3Cgale_proqu%3EA749458992%3C/gale_proqu%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2813777277&rft_id=info:pmid/&rft_galeid=A749458992&rfr_iscdi=true |