Rule-Based Outlier Detection with a Modified Variational AutoEncoder for Enhancing Data Accuracy in Wireless Sensor Networks

In wireless sensor networks (WSNs), a number of outlier detection (OD) methods have been established over time to identify data that do not match the rest of the data. These data are anomalies, outliers, or irregularities because they result from hostile attacks or sensor node malfunctions. OD is di...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:International journal of fuzzy systems 2023-09, Vol.25 (6), p.2187-2202
Hauptverfasser: Arul Jothi, S., Venkatesan, R., Santhi, V.
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 2202
container_issue 6
container_start_page 2187
container_title International journal of fuzzy systems
container_volume 25
creator Arul Jothi, S.
Venkatesan, R.
Santhi, V.
description In wireless sensor networks (WSNs), a number of outlier detection (OD) methods have been established over time to identify data that do not match the rest of the data. These data are anomalies, outliers, or irregularities because they result from hostile attacks or sensor node malfunctions. OD is difficult due to the classification process and the challenges in feature development. The limitations of conventional OD include insufficient feature learning, noise, excessive dimensionality, and a lack of training data. Unsupervised outlier detection (UOD) in WSNs is a new research area that has been ascertained to perform exceptionally well in terms of detection accuracy. The fact that prior knowledge of abnormal data is unknown, i.e., the ground truth of data is unknown for the classification of outlier instances, is a substantial barrier in UOD. This made it possible for researchers to examine flexible deep learning methods for domain-specific UOD, like Variational AutoEncoder (VAE). In order to achieve an appropriate categorization of anomalous data, this research suggests using a Modified Variational AutoEncoder (ModVAE) model with a rule-based approach. In the first stage of the proposed system, an adaptive VAE model is developed to produce modified latent space vector samples suitable for reproducing the data with reasonable reconstruction loss, and in the second stage, fuzzy rules are generated to precisely classify abnormal data with fewer false positives. The suggested model's efficiency is demonstrated with experiments done using benchmark datasets. The experimental results show improved performance when compared with other approaches available in the literature.
doi_str_mv 10.1007/s40815-023-01496-z
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2922076767</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2922076767</sourcerecordid><originalsourceid>FETCH-LOGICAL-c270t-90b562d6132ce170e44c8491f662c28e03c1409604c7a9265cc738aa6b7171d43</originalsourceid><addsrcrecordid>eNp9kMtKAzEUhoMoWNQXcBVwHc1tksmyar1AVfC6DGkmU6PjRJMMxeLDm1rBnZzFWZzv_-F8AOwTfEgwlkeJ45pUCFOGMOFKoOUGGFGiFGKUkE0wIpWgiHKptsFeSn6GGaGCVYKNwNft0Dl0bJJr4M2QO-8iPHXZ2exDDxc-P0MDr0LjW1-IRxO9WV1MB8dDDpPehqYk2hDhpH82vfX9HJ6abODY2iEa-wl9D598dJ1LCd65PhX02uVFiK9pF2y1pktu73fvgIezyf3JBZrenF-ejKfIUokzUnhWHmgEYdQ6IrHj3NZckVYIamntMLOEYyUwt9IoKiprJauNETNJJGk42wEH6973GD4Gl7J-CUMsTyRNFaVYijKFomvKxpBSdK1-j_7NxE9NsF6J1mvRuojWP6L1soTYOpQK3M9d_Kv-J_UN3OGBJw</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2922076767</pqid></control><display><type>article</type><title>Rule-Based Outlier Detection with a Modified Variational AutoEncoder for Enhancing Data Accuracy in Wireless Sensor Networks</title><source>ProQuest Central UK/Ireland</source><source>SpringerLink Journals - AutoHoldings</source><source>ProQuest Central</source><creator>Arul Jothi, S. ; Venkatesan, R. ; Santhi, V.</creator><creatorcontrib>Arul Jothi, S. ; Venkatesan, R. ; Santhi, V.</creatorcontrib><description>In wireless sensor networks (WSNs), a number of outlier detection (OD) methods have been established over time to identify data that do not match the rest of the data. These data are anomalies, outliers, or irregularities because they result from hostile attacks or sensor node malfunctions. OD is difficult due to the classification process and the challenges in feature development. The limitations of conventional OD include insufficient feature learning, noise, excessive dimensionality, and a lack of training data. Unsupervised outlier detection (UOD) in WSNs is a new research area that has been ascertained to perform exceptionally well in terms of detection accuracy. The fact that prior knowledge of abnormal data is unknown, i.e., the ground truth of data is unknown for the classification of outlier instances, is a substantial barrier in UOD. This made it possible for researchers to examine flexible deep learning methods for domain-specific UOD, like Variational AutoEncoder (VAE). In order to achieve an appropriate categorization of anomalous data, this research suggests using a Modified Variational AutoEncoder (ModVAE) model with a rule-based approach. In the first stage of the proposed system, an adaptive VAE model is developed to produce modified latent space vector samples suitable for reproducing the data with reasonable reconstruction loss, and in the second stage, fuzzy rules are generated to precisely classify abnormal data with fewer false positives. The suggested model's efficiency is demonstrated with experiments done using benchmark datasets. The experimental results show improved performance when compared with other approaches available in the literature.</description><identifier>ISSN: 1562-2479</identifier><identifier>EISSN: 2199-3211</identifier><identifier>DOI: 10.1007/s40815-023-01496-z</identifier><language>eng</language><publisher>Berlin/Heidelberg: Springer Berlin Heidelberg</publisher><subject>Accuracy ; Adaptive systems ; Artificial Intelligence ; Classification ; Computational Intelligence ; Data analysis ; Datasets ; Deep learning ; Engineering ; Internet of Things ; Machine learning ; Management Science ; Operations Research ; Outliers (statistics) ; Sensors ; Sparsity ; Time series ; Wireless sensor networks</subject><ispartof>International journal of fuzzy systems, 2023-09, Vol.25 (6), p.2187-2202</ispartof><rights>The Author(s) under exclusive licence to Taiwan Fuzzy Systems Association 2023. corrected publication 2023. Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-c270t-90b562d6132ce170e44c8491f662c28e03c1409604c7a9265cc738aa6b7171d43</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://link.springer.com/content/pdf/10.1007/s40815-023-01496-z$$EPDF$$P50$$Gspringer$$H</linktopdf><linktohtml>$$Uhttps://www.proquest.com/docview/2922076767?pq-origsite=primo$$EHTML$$P50$$Gproquest$$H</linktohtml><link.rule.ids>314,780,784,21387,27923,27924,33743,41487,42556,43804,51318,64384,64388,72240</link.rule.ids></links><search><creatorcontrib>Arul Jothi, S.</creatorcontrib><creatorcontrib>Venkatesan, R.</creatorcontrib><creatorcontrib>Santhi, V.</creatorcontrib><title>Rule-Based Outlier Detection with a Modified Variational AutoEncoder for Enhancing Data Accuracy in Wireless Sensor Networks</title><title>International journal of fuzzy systems</title><addtitle>Int. J. Fuzzy Syst</addtitle><description>In wireless sensor networks (WSNs), a number of outlier detection (OD) methods have been established over time to identify data that do not match the rest of the data. These data are anomalies, outliers, or irregularities because they result from hostile attacks or sensor node malfunctions. OD is difficult due to the classification process and the challenges in feature development. The limitations of conventional OD include insufficient feature learning, noise, excessive dimensionality, and a lack of training data. Unsupervised outlier detection (UOD) in WSNs is a new research area that has been ascertained to perform exceptionally well in terms of detection accuracy. The fact that prior knowledge of abnormal data is unknown, i.e., the ground truth of data is unknown for the classification of outlier instances, is a substantial barrier in UOD. This made it possible for researchers to examine flexible deep learning methods for domain-specific UOD, like Variational AutoEncoder (VAE). In order to achieve an appropriate categorization of anomalous data, this research suggests using a Modified Variational AutoEncoder (ModVAE) model with a rule-based approach. In the first stage of the proposed system, an adaptive VAE model is developed to produce modified latent space vector samples suitable for reproducing the data with reasonable reconstruction loss, and in the second stage, fuzzy rules are generated to precisely classify abnormal data with fewer false positives. The suggested model's efficiency is demonstrated with experiments done using benchmark datasets. The experimental results show improved performance when compared with other approaches available in the literature.</description><subject>Accuracy</subject><subject>Adaptive systems</subject><subject>Artificial Intelligence</subject><subject>Classification</subject><subject>Computational Intelligence</subject><subject>Data analysis</subject><subject>Datasets</subject><subject>Deep learning</subject><subject>Engineering</subject><subject>Internet of Things</subject><subject>Machine learning</subject><subject>Management Science</subject><subject>Operations Research</subject><subject>Outliers (statistics)</subject><subject>Sensors</subject><subject>Sparsity</subject><subject>Time series</subject><subject>Wireless sensor networks</subject><issn>1562-2479</issn><issn>2199-3211</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><sourceid>AFKRA</sourceid><sourceid>AZQEC</sourceid><sourceid>BENPR</sourceid><sourceid>CCPQU</sourceid><sourceid>DWQXO</sourceid><sourceid>GNUQQ</sourceid><recordid>eNp9kMtKAzEUhoMoWNQXcBVwHc1tksmyar1AVfC6DGkmU6PjRJMMxeLDm1rBnZzFWZzv_-F8AOwTfEgwlkeJ45pUCFOGMOFKoOUGGFGiFGKUkE0wIpWgiHKptsFeSn6GGaGCVYKNwNft0Dl0bJJr4M2QO-8iPHXZ2exDDxc-P0MDr0LjW1-IRxO9WV1MB8dDDpPehqYk2hDhpH82vfX9HJ6abODY2iEa-wl9D598dJ1LCd65PhX02uVFiK9pF2y1pktu73fvgIezyf3JBZrenF-ejKfIUokzUnhWHmgEYdQ6IrHj3NZckVYIamntMLOEYyUwt9IoKiprJauNETNJJGk42wEH6973GD4Gl7J-CUMsTyRNFaVYijKFomvKxpBSdK1-j_7NxE9NsF6J1mvRuojWP6L1soTYOpQK3M9d_Kv-J_UN3OGBJw</recordid><startdate>20230901</startdate><enddate>20230901</enddate><creator>Arul Jothi, S.</creator><creator>Venkatesan, R.</creator><creator>Santhi, V.</creator><general>Springer Berlin Heidelberg</general><general>Springer Nature B.V</general><scope>AAYXX</scope><scope>CITATION</scope><scope>8FE</scope><scope>8FG</scope><scope>ABJCF</scope><scope>AFKRA</scope><scope>ARAPS</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>GNUQQ</scope><scope>HCIFZ</scope><scope>JQ2</scope><scope>K7-</scope><scope>L6V</scope><scope>M7S</scope><scope>P5Z</scope><scope>P62</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PTHSS</scope></search><sort><creationdate>20230901</creationdate><title>Rule-Based Outlier Detection with a Modified Variational AutoEncoder for Enhancing Data Accuracy in Wireless Sensor Networks</title><author>Arul Jothi, S. ; Venkatesan, R. ; Santhi, V.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c270t-90b562d6132ce170e44c8491f662c28e03c1409604c7a9265cc738aa6b7171d43</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Accuracy</topic><topic>Adaptive systems</topic><topic>Artificial Intelligence</topic><topic>Classification</topic><topic>Computational Intelligence</topic><topic>Data analysis</topic><topic>Datasets</topic><topic>Deep learning</topic><topic>Engineering</topic><topic>Internet of Things</topic><topic>Machine learning</topic><topic>Management Science</topic><topic>Operations Research</topic><topic>Outliers (statistics)</topic><topic>Sensors</topic><topic>Sparsity</topic><topic>Time series</topic><topic>Wireless sensor networks</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Arul Jothi, S.</creatorcontrib><creatorcontrib>Venkatesan, R.</creatorcontrib><creatorcontrib>Santhi, V.</creatorcontrib><collection>CrossRef</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>Materials Science &amp; Engineering Collection</collection><collection>ProQuest Central UK/Ireland</collection><collection>Advanced Technologies &amp; Aerospace Collection</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Technology Collection (ProQuest)</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>ProQuest Central Student</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Computer Science Collection</collection><collection>Computer Science Database</collection><collection>ProQuest Engineering Collection</collection><collection>Engineering Database</collection><collection>Advanced Technologies &amp; Aerospace Database</collection><collection>ProQuest Advanced Technologies &amp; Aerospace Collection</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>Engineering Collection</collection><jtitle>International journal of fuzzy systems</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Arul Jothi, S.</au><au>Venkatesan, R.</au><au>Santhi, V.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Rule-Based Outlier Detection with a Modified Variational AutoEncoder for Enhancing Data Accuracy in Wireless Sensor Networks</atitle><jtitle>International journal of fuzzy systems</jtitle><stitle>Int. J. Fuzzy Syst</stitle><date>2023-09-01</date><risdate>2023</risdate><volume>25</volume><issue>6</issue><spage>2187</spage><epage>2202</epage><pages>2187-2202</pages><issn>1562-2479</issn><eissn>2199-3211</eissn><abstract>In wireless sensor networks (WSNs), a number of outlier detection (OD) methods have been established over time to identify data that do not match the rest of the data. These data are anomalies, outliers, or irregularities because they result from hostile attacks or sensor node malfunctions. OD is difficult due to the classification process and the challenges in feature development. The limitations of conventional OD include insufficient feature learning, noise, excessive dimensionality, and a lack of training data. Unsupervised outlier detection (UOD) in WSNs is a new research area that has been ascertained to perform exceptionally well in terms of detection accuracy. The fact that prior knowledge of abnormal data is unknown, i.e., the ground truth of data is unknown for the classification of outlier instances, is a substantial barrier in UOD. This made it possible for researchers to examine flexible deep learning methods for domain-specific UOD, like Variational AutoEncoder (VAE). In order to achieve an appropriate categorization of anomalous data, this research suggests using a Modified Variational AutoEncoder (ModVAE) model with a rule-based approach. In the first stage of the proposed system, an adaptive VAE model is developed to produce modified latent space vector samples suitable for reproducing the data with reasonable reconstruction loss, and in the second stage, fuzzy rules are generated to precisely classify abnormal data with fewer false positives. The suggested model's efficiency is demonstrated with experiments done using benchmark datasets. The experimental results show improved performance when compared with other approaches available in the literature.</abstract><cop>Berlin/Heidelberg</cop><pub>Springer Berlin Heidelberg</pub><doi>10.1007/s40815-023-01496-z</doi><tpages>16</tpages></addata></record>
fulltext fulltext
identifier ISSN: 1562-2479
ispartof International journal of fuzzy systems, 2023-09, Vol.25 (6), p.2187-2202
issn 1562-2479
2199-3211
language eng
recordid cdi_proquest_journals_2922076767
source ProQuest Central UK/Ireland; SpringerLink Journals - AutoHoldings; ProQuest Central
subjects Accuracy
Adaptive systems
Artificial Intelligence
Classification
Computational Intelligence
Data analysis
Datasets
Deep learning
Engineering
Internet of Things
Machine learning
Management Science
Operations Research
Outliers (statistics)
Sensors
Sparsity
Time series
Wireless sensor networks
title Rule-Based Outlier Detection with a Modified Variational AutoEncoder for Enhancing Data Accuracy in Wireless Sensor Networks
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-13T06%3A23%3A31IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Rule-Based%20Outlier%20Detection%20with%20a%20Modified%20Variational%20AutoEncoder%20for%20Enhancing%20Data%20Accuracy%20in%20Wireless%20Sensor%20Networks&rft.jtitle=International%20journal%20of%20fuzzy%20systems&rft.au=Arul%20Jothi,%20S.&rft.date=2023-09-01&rft.volume=25&rft.issue=6&rft.spage=2187&rft.epage=2202&rft.pages=2187-2202&rft.issn=1562-2479&rft.eissn=2199-3211&rft_id=info:doi/10.1007/s40815-023-01496-z&rft_dat=%3Cproquest_cross%3E2922076767%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2922076767&rft_id=info:pmid/&rfr_iscdi=true