Audio-Based Drone Detection and Identification Using Deep Learning Techniques with Dataset Enhancement through Generative Adversarial Networks

Drones are becoming increasingly popular not only for recreational purposes but in day-to-day applications in engineering, medicine, logistics, security and others. In addition to their useful applications, an alarming concern in regard to the physical infrastructure security, safety and privacy has...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Sensors (Basel, Switzerland) Switzerland), 2021-07, Vol.21 (15), p.4953
Hauptverfasser: Al-Emadi, Sara, Al-Ali, Abdulla, Al-Ali, Abdulaziz
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue 15
container_start_page 4953
container_title Sensors (Basel, Switzerland)
container_volume 21
creator Al-Emadi, Sara
Al-Ali, Abdulla
Al-Ali, Abdulaziz
description Drones are becoming increasingly popular not only for recreational purposes but in day-to-day applications in engineering, medicine, logistics, security and others. In addition to their useful applications, an alarming concern in regard to the physical infrastructure security, safety and privacy has arisen due to the potential of their use in malicious activities. To address this problem, we propose a novel solution that automates the drone detection and identification processes using a drone's acoustic features with different deep learning algorithms. However, the lack of acoustic drone datasets hinders the ability to implement an effective solution. In this paper, we aim to fill this gap by introducing a hybrid drone acoustic dataset composed of recorded drone audio clips and artificially generated drone audio samples using a state-of-the-art deep learning technique known as the Generative Adversarial Network. Furthermore, we examine the effectiveness of using drone audio with different deep learning algorithms, namely, the Convolutional Neural Network, the Recurrent Neural Network and the Convolutional Recurrent Neural Network in drone detection and identification. Moreover, we investigate the impact of our proposed hybrid dataset in drone detection. Our findings prove the advantage of using deep learning techniques for drone detection and identification while confirming our hypothesis on the benefits of using the Generative Adversarial Networks to generate real-like drone audio clips with an aim of enhancing the detection of new and unfamiliar drones.
doi_str_mv 10.3390/s21154953
format Article
fullrecord <record><control><sourceid>proquest_doaj_</sourceid><recordid>TN_cdi_proquest_miscellaneous_2560060692</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><doaj_id>oai_doaj_org_article_ac95ab095ad44bfa9b5f264e1bb653a9</doaj_id><sourcerecordid>2558927908</sourcerecordid><originalsourceid>FETCH-LOGICAL-c469t-48868a35ae3bd822dae362bd2dac5ff6aca2e9a407ee104a0623f505d408db053</originalsourceid><addsrcrecordid>eNpdks1uEzEQgFcIRH_gwAsgS1zgEPD6Z-O9IKVNKZEiuLTn1aw9m3XY2MH2puIleOY6TYlaLvZ4_OnTzGiK4l1JP3Ne0y-RlaUUteQvitNSMDFRjNGXT-KT4izGNaWMc65eFydc8CkrVX1a_J2NxvrJBUQ0ZB68QzLHhDpZ7wg4QxYGXbKd1fCQuo3WrTKCW7JECG7_ukHdO_t7xEjubOrJHFLWJXLlenAaN1lAUh_8uOrJNToMWbVDMjM7DBGChYH8wHTnw6_4pnjVwRDx7eN9Xtx-u7q5_D5Z_rxeXM6WEy2qOk2EUpUCLgF5a3KDJgcVa00OtOy6CjQwrEHQKWJJBdCK8U5SaQRVpqWSnxeLg9d4WDfbYDcQ_jQebPOQ8GHVQEhWD9iAriW0NB9GiLaDupUdqwSWbVtJDnV2fT24tmO7QaNzuwGGZ9LnP872zcrvGsWF4uVe8PFREPx-iqnZ2KhxGMChH2PDZEVpRauaZfTDf-jaj8HlUWVKqppNa6oy9elA6eBjDNgdiylps9-Y5rgxmX3_tPoj-W9F-D0JdL54</addsrcrecordid><sourcetype>Open Website</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2558927908</pqid></control><display><type>article</type><title>Audio-Based Drone Detection and Identification Using Deep Learning Techniques with Dataset Enhancement through Generative Adversarial Networks</title><source>MEDLINE</source><source>DOAJ Directory of Open Access Journals</source><source>Elektronische Zeitschriftenbibliothek - Frei zugängliche E-Journals</source><source>MDPI - Multidisciplinary Digital Publishing Institute</source><source>PubMed Central</source><source>Free Full-Text Journals in Chemistry</source><creator>Al-Emadi, Sara ; Al-Ali, Abdulla ; Al-Ali, Abdulaziz</creator><creatorcontrib>Al-Emadi, Sara ; Al-Ali, Abdulla ; Al-Ali, Abdulaziz</creatorcontrib><description>Drones are becoming increasingly popular not only for recreational purposes but in day-to-day applications in engineering, medicine, logistics, security and others. In addition to their useful applications, an alarming concern in regard to the physical infrastructure security, safety and privacy has arisen due to the potential of their use in malicious activities. To address this problem, we propose a novel solution that automates the drone detection and identification processes using a drone's acoustic features with different deep learning algorithms. However, the lack of acoustic drone datasets hinders the ability to implement an effective solution. In this paper, we aim to fill this gap by introducing a hybrid drone acoustic dataset composed of recorded drone audio clips and artificially generated drone audio samples using a state-of-the-art deep learning technique known as the Generative Adversarial Network. Furthermore, we examine the effectiveness of using drone audio with different deep learning algorithms, namely, the Convolutional Neural Network, the Recurrent Neural Network and the Convolutional Recurrent Neural Network in drone detection and identification. Moreover, we investigate the impact of our proposed hybrid dataset in drone detection. Our findings prove the advantage of using deep learning techniques for drone detection and identification while confirming our hypothesis on the benefits of using the Generative Adversarial Networks to generate real-like drone audio clips with an aim of enhancing the detection of new and unfamiliar drones.</description><identifier>ISSN: 1424-8220</identifier><identifier>EISSN: 1424-8220</identifier><identifier>DOI: 10.3390/s21154953</identifier><identifier>PMID: 34372189</identifier><language>eng</language><publisher>Switzerland: MDPI AG</publisher><subject>Acoustics ; Algorithms ; Clips ; Convolutional Neural Network CNN ; Crude oil ; Datasets ; Deep Learning ; drone ; Drones ; Human error ; Humans ; Logistics ; Machine learning ; Neural networks ; Neural Networks, Computer ; Performance evaluation ; Privacy ; Radar systems ; Recurrent Neural Network RNN ; Recurrent neural networks ; Signal processing ; Support vector machines ; UAV ; Unmanned aerial vehicles</subject><ispartof>Sensors (Basel, Switzerland), 2021-07, Vol.21 (15), p.4953</ispartof><rights>2021 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><rights>2021 by the authors. 2021</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c469t-48868a35ae3bd822dae362bd2dac5ff6aca2e9a407ee104a0623f505d408db053</citedby><cites>FETCH-LOGICAL-c469t-48868a35ae3bd822dae362bd2dac5ff6aca2e9a407ee104a0623f505d408db053</cites><orcidid>0000-0002-8762-7804 ; 0000-0002-3527-2554 ; 0000-0003-0006-2642</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://www.ncbi.nlm.nih.gov/pmc/articles/PMC8348319/pdf/$$EPDF$$P50$$Gpubmedcentral$$Hfree_for_read</linktopdf><linktohtml>$$Uhttps://www.ncbi.nlm.nih.gov/pmc/articles/PMC8348319/$$EHTML$$P50$$Gpubmedcentral$$Hfree_for_read</linktohtml><link.rule.ids>230,314,724,777,781,861,882,2096,27905,27906,53772,53774</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/34372189$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Al-Emadi, Sara</creatorcontrib><creatorcontrib>Al-Ali, Abdulla</creatorcontrib><creatorcontrib>Al-Ali, Abdulaziz</creatorcontrib><title>Audio-Based Drone Detection and Identification Using Deep Learning Techniques with Dataset Enhancement through Generative Adversarial Networks</title><title>Sensors (Basel, Switzerland)</title><addtitle>Sensors (Basel)</addtitle><description>Drones are becoming increasingly popular not only for recreational purposes but in day-to-day applications in engineering, medicine, logistics, security and others. In addition to their useful applications, an alarming concern in regard to the physical infrastructure security, safety and privacy has arisen due to the potential of their use in malicious activities. To address this problem, we propose a novel solution that automates the drone detection and identification processes using a drone's acoustic features with different deep learning algorithms. However, the lack of acoustic drone datasets hinders the ability to implement an effective solution. In this paper, we aim to fill this gap by introducing a hybrid drone acoustic dataset composed of recorded drone audio clips and artificially generated drone audio samples using a state-of-the-art deep learning technique known as the Generative Adversarial Network. Furthermore, we examine the effectiveness of using drone audio with different deep learning algorithms, namely, the Convolutional Neural Network, the Recurrent Neural Network and the Convolutional Recurrent Neural Network in drone detection and identification. Moreover, we investigate the impact of our proposed hybrid dataset in drone detection. Our findings prove the advantage of using deep learning techniques for drone detection and identification while confirming our hypothesis on the benefits of using the Generative Adversarial Networks to generate real-like drone audio clips with an aim of enhancing the detection of new and unfamiliar drones.</description><subject>Acoustics</subject><subject>Algorithms</subject><subject>Clips</subject><subject>Convolutional Neural Network CNN</subject><subject>Crude oil</subject><subject>Datasets</subject><subject>Deep Learning</subject><subject>drone</subject><subject>Drones</subject><subject>Human error</subject><subject>Humans</subject><subject>Logistics</subject><subject>Machine learning</subject><subject>Neural networks</subject><subject>Neural Networks, Computer</subject><subject>Performance evaluation</subject><subject>Privacy</subject><subject>Radar systems</subject><subject>Recurrent Neural Network RNN</subject><subject>Recurrent neural networks</subject><subject>Signal processing</subject><subject>Support vector machines</subject><subject>UAV</subject><subject>Unmanned aerial vehicles</subject><issn>1424-8220</issn><issn>1424-8220</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2021</creationdate><recordtype>article</recordtype><sourceid>EIF</sourceid><sourceid>ABUWG</sourceid><sourceid>AFKRA</sourceid><sourceid>AZQEC</sourceid><sourceid>BENPR</sourceid><sourceid>CCPQU</sourceid><sourceid>DWQXO</sourceid><sourceid>DOA</sourceid><recordid>eNpdks1uEzEQgFcIRH_gwAsgS1zgEPD6Z-O9IKVNKZEiuLTn1aw9m3XY2MH2puIleOY6TYlaLvZ4_OnTzGiK4l1JP3Ne0y-RlaUUteQvitNSMDFRjNGXT-KT4izGNaWMc65eFydc8CkrVX1a_J2NxvrJBUQ0ZB68QzLHhDpZ7wg4QxYGXbKd1fCQuo3WrTKCW7JECG7_ukHdO_t7xEjubOrJHFLWJXLlenAaN1lAUh_8uOrJNToMWbVDMjM7DBGChYH8wHTnw6_4pnjVwRDx7eN9Xtx-u7q5_D5Z_rxeXM6WEy2qOk2EUpUCLgF5a3KDJgcVa00OtOy6CjQwrEHQKWJJBdCK8U5SaQRVpqWSnxeLg9d4WDfbYDcQ_jQebPOQ8GHVQEhWD9iAriW0NB9GiLaDupUdqwSWbVtJDnV2fT24tmO7QaNzuwGGZ9LnP872zcrvGsWF4uVe8PFREPx-iqnZ2KhxGMChH2PDZEVpRauaZfTDf-jaj8HlUWVKqppNa6oy9elA6eBjDNgdiylps9-Y5rgxmX3_tPoj-W9F-D0JdL54</recordid><startdate>20210721</startdate><enddate>20210721</enddate><creator>Al-Emadi, Sara</creator><creator>Al-Ali, Abdulla</creator><creator>Al-Ali, Abdulaziz</creator><general>MDPI AG</general><general>MDPI</general><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>3V.</scope><scope>7X7</scope><scope>7XB</scope><scope>88E</scope><scope>8FI</scope><scope>8FJ</scope><scope>8FK</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>FYUFA</scope><scope>GHDGH</scope><scope>K9.</scope><scope>M0S</scope><scope>M1P</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>7X8</scope><scope>5PM</scope><scope>DOA</scope><orcidid>https://orcid.org/0000-0002-8762-7804</orcidid><orcidid>https://orcid.org/0000-0002-3527-2554</orcidid><orcidid>https://orcid.org/0000-0003-0006-2642</orcidid></search><sort><creationdate>20210721</creationdate><title>Audio-Based Drone Detection and Identification Using Deep Learning Techniques with Dataset Enhancement through Generative Adversarial Networks</title><author>Al-Emadi, Sara ; Al-Ali, Abdulla ; Al-Ali, Abdulaziz</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c469t-48868a35ae3bd822dae362bd2dac5ff6aca2e9a407ee104a0623f505d408db053</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2021</creationdate><topic>Acoustics</topic><topic>Algorithms</topic><topic>Clips</topic><topic>Convolutional Neural Network CNN</topic><topic>Crude oil</topic><topic>Datasets</topic><topic>Deep Learning</topic><topic>drone</topic><topic>Drones</topic><topic>Human error</topic><topic>Humans</topic><topic>Logistics</topic><topic>Machine learning</topic><topic>Neural networks</topic><topic>Neural Networks, Computer</topic><topic>Performance evaluation</topic><topic>Privacy</topic><topic>Radar systems</topic><topic>Recurrent Neural Network RNN</topic><topic>Recurrent neural networks</topic><topic>Signal processing</topic><topic>Support vector machines</topic><topic>UAV</topic><topic>Unmanned aerial vehicles</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Al-Emadi, Sara</creatorcontrib><creatorcontrib>Al-Ali, Abdulla</creatorcontrib><creatorcontrib>Al-Ali, Abdulaziz</creatorcontrib><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>ProQuest Central (Corporate)</collection><collection>Health &amp; Medical Collection</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>Medical Database (Alumni Edition)</collection><collection>Hospital Premium Collection</collection><collection>Hospital Premium Collection (Alumni Edition)</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>Health Research Premium Collection</collection><collection>Health Research Premium Collection (Alumni)</collection><collection>ProQuest Health &amp; Medical Complete (Alumni)</collection><collection>Health &amp; Medical Collection (Alumni Edition)</collection><collection>Medical Database</collection><collection>Publicly Available Content Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>MEDLINE - Academic</collection><collection>PubMed Central (Full Participant titles)</collection><collection>DOAJ Directory of Open Access Journals</collection><jtitle>Sensors (Basel, Switzerland)</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Al-Emadi, Sara</au><au>Al-Ali, Abdulla</au><au>Al-Ali, Abdulaziz</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Audio-Based Drone Detection and Identification Using Deep Learning Techniques with Dataset Enhancement through Generative Adversarial Networks</atitle><jtitle>Sensors (Basel, Switzerland)</jtitle><addtitle>Sensors (Basel)</addtitle><date>2021-07-21</date><risdate>2021</risdate><volume>21</volume><issue>15</issue><spage>4953</spage><pages>4953-</pages><issn>1424-8220</issn><eissn>1424-8220</eissn><abstract>Drones are becoming increasingly popular not only for recreational purposes but in day-to-day applications in engineering, medicine, logistics, security and others. In addition to their useful applications, an alarming concern in regard to the physical infrastructure security, safety and privacy has arisen due to the potential of their use in malicious activities. To address this problem, we propose a novel solution that automates the drone detection and identification processes using a drone's acoustic features with different deep learning algorithms. However, the lack of acoustic drone datasets hinders the ability to implement an effective solution. In this paper, we aim to fill this gap by introducing a hybrid drone acoustic dataset composed of recorded drone audio clips and artificially generated drone audio samples using a state-of-the-art deep learning technique known as the Generative Adversarial Network. Furthermore, we examine the effectiveness of using drone audio with different deep learning algorithms, namely, the Convolutional Neural Network, the Recurrent Neural Network and the Convolutional Recurrent Neural Network in drone detection and identification. Moreover, we investigate the impact of our proposed hybrid dataset in drone detection. Our findings prove the advantage of using deep learning techniques for drone detection and identification while confirming our hypothesis on the benefits of using the Generative Adversarial Networks to generate real-like drone audio clips with an aim of enhancing the detection of new and unfamiliar drones.</abstract><cop>Switzerland</cop><pub>MDPI AG</pub><pmid>34372189</pmid><doi>10.3390/s21154953</doi><orcidid>https://orcid.org/0000-0002-8762-7804</orcidid><orcidid>https://orcid.org/0000-0002-3527-2554</orcidid><orcidid>https://orcid.org/0000-0003-0006-2642</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 1424-8220
ispartof Sensors (Basel, Switzerland), 2021-07, Vol.21 (15), p.4953
issn 1424-8220
1424-8220
language eng
recordid cdi_proquest_miscellaneous_2560060692
source MEDLINE; DOAJ Directory of Open Access Journals; Elektronische Zeitschriftenbibliothek - Frei zugängliche E-Journals; MDPI - Multidisciplinary Digital Publishing Institute; PubMed Central; Free Full-Text Journals in Chemistry
subjects Acoustics
Algorithms
Clips
Convolutional Neural Network CNN
Crude oil
Datasets
Deep Learning
drone
Drones
Human error
Humans
Logistics
Machine learning
Neural networks
Neural Networks, Computer
Performance evaluation
Privacy
Radar systems
Recurrent Neural Network RNN
Recurrent neural networks
Signal processing
Support vector machines
UAV
Unmanned aerial vehicles
title Audio-Based Drone Detection and Identification Using Deep Learning Techniques with Dataset Enhancement through Generative Adversarial Networks
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-21T02%3A58%3A08IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_doaj_&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Audio-Based%20Drone%20Detection%20and%20Identification%20Using%20Deep%20Learning%20Techniques%20with%20Dataset%20Enhancement%20through%20Generative%20Adversarial%20Networks&rft.jtitle=Sensors%20(Basel,%20Switzerland)&rft.au=Al-Emadi,%20Sara&rft.date=2021-07-21&rft.volume=21&rft.issue=15&rft.spage=4953&rft.pages=4953-&rft.issn=1424-8220&rft.eissn=1424-8220&rft_id=info:doi/10.3390/s21154953&rft_dat=%3Cproquest_doaj_%3E2558927908%3C/proquest_doaj_%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2558927908&rft_id=info:pmid/34372189&rft_doaj_id=oai_doaj_org_article_ac95ab095ad44bfa9b5f264e1bb653a9&rfr_iscdi=true