Rule-Based Outlier Detection with a Modified Variational AutoEncoder for Enhancing Data Accuracy in Wireless Sensor Networks
In wireless sensor networks (WSNs), a number of outlier detection (OD) methods have been established over time to identify data that do not match the rest of the data. These data are anomalies, outliers, or irregularities because they result from hostile attacks or sensor node malfunctions. OD is di...
Gespeichert in:
Veröffentlicht in: | International journal of fuzzy systems 2023-09, Vol.25 (6), p.2187-2202 |
---|---|
Hauptverfasser: | , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 2202 |
---|---|
container_issue | 6 |
container_start_page | 2187 |
container_title | International journal of fuzzy systems |
container_volume | 25 |
creator | Arul Jothi, S. Venkatesan, R. Santhi, V. |
description | In wireless sensor networks (WSNs), a number of outlier detection (OD) methods have been established over time to identify data that do not match the rest of the data. These data are anomalies, outliers, or irregularities because they result from hostile attacks or sensor node malfunctions. OD is difficult due to the classification process and the challenges in feature development. The limitations of conventional OD include insufficient feature learning, noise, excessive dimensionality, and a lack of training data. Unsupervised outlier detection (UOD) in WSNs is a new research area that has been ascertained to perform exceptionally well in terms of detection accuracy. The fact that prior knowledge of abnormal data is unknown, i.e., the ground truth of data is unknown for the classification of outlier instances, is a substantial barrier in UOD. This made it possible for researchers to examine flexible deep learning methods for domain-specific UOD, like Variational AutoEncoder (VAE). In order to achieve an appropriate categorization of anomalous data, this research suggests using a Modified Variational AutoEncoder (ModVAE) model with a rule-based approach. In the first stage of the proposed system, an adaptive VAE model is developed to produce modified latent space vector samples suitable for reproducing the data with reasonable reconstruction loss, and in the second stage, fuzzy rules are generated to precisely classify abnormal data with fewer false positives. The suggested model's efficiency is demonstrated with experiments done using benchmark datasets. The experimental results show improved performance when compared with other approaches available in the literature. |
doi_str_mv | 10.1007/s40815-023-01496-z |
format | Article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2922076767</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2922076767</sourcerecordid><originalsourceid>FETCH-LOGICAL-c270t-90b562d6132ce170e44c8491f662c28e03c1409604c7a9265cc738aa6b7171d43</originalsourceid><addsrcrecordid>eNp9kMtKAzEUhoMoWNQXcBVwHc1tksmyar1AVfC6DGkmU6PjRJMMxeLDm1rBnZzFWZzv_-F8AOwTfEgwlkeJ45pUCFOGMOFKoOUGGFGiFGKUkE0wIpWgiHKptsFeSn6GGaGCVYKNwNft0Dl0bJJr4M2QO-8iPHXZ2exDDxc-P0MDr0LjW1-IRxO9WV1MB8dDDpPehqYk2hDhpH82vfX9HJ6abODY2iEa-wl9D598dJ1LCd65PhX02uVFiK9pF2y1pktu73fvgIezyf3JBZrenF-ejKfIUokzUnhWHmgEYdQ6IrHj3NZckVYIamntMLOEYyUwt9IoKiprJauNETNJJGk42wEH6973GD4Gl7J-CUMsTyRNFaVYijKFomvKxpBSdK1-j_7NxE9NsF6J1mvRuojWP6L1soTYOpQK3M9d_Kv-J_UN3OGBJw</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2922076767</pqid></control><display><type>article</type><title>Rule-Based Outlier Detection with a Modified Variational AutoEncoder for Enhancing Data Accuracy in Wireless Sensor Networks</title><source>ProQuest Central UK/Ireland</source><source>SpringerLink Journals - AutoHoldings</source><source>ProQuest Central</source><creator>Arul Jothi, S. ; Venkatesan, R. ; Santhi, V.</creator><creatorcontrib>Arul Jothi, S. ; Venkatesan, R. ; Santhi, V.</creatorcontrib><description>In wireless sensor networks (WSNs), a number of outlier detection (OD) methods have been established over time to identify data that do not match the rest of the data. These data are anomalies, outliers, or irregularities because they result from hostile attacks or sensor node malfunctions. OD is difficult due to the classification process and the challenges in feature development. The limitations of conventional OD include insufficient feature learning, noise, excessive dimensionality, and a lack of training data. Unsupervised outlier detection (UOD) in WSNs is a new research area that has been ascertained to perform exceptionally well in terms of detection accuracy. The fact that prior knowledge of abnormal data is unknown, i.e., the ground truth of data is unknown for the classification of outlier instances, is a substantial barrier in UOD. This made it possible for researchers to examine flexible deep learning methods for domain-specific UOD, like Variational AutoEncoder (VAE). In order to achieve an appropriate categorization of anomalous data, this research suggests using a Modified Variational AutoEncoder (ModVAE) model with a rule-based approach. In the first stage of the proposed system, an adaptive VAE model is developed to produce modified latent space vector samples suitable for reproducing the data with reasonable reconstruction loss, and in the second stage, fuzzy rules are generated to precisely classify abnormal data with fewer false positives. The suggested model's efficiency is demonstrated with experiments done using benchmark datasets. The experimental results show improved performance when compared with other approaches available in the literature.</description><identifier>ISSN: 1562-2479</identifier><identifier>EISSN: 2199-3211</identifier><identifier>DOI: 10.1007/s40815-023-01496-z</identifier><language>eng</language><publisher>Berlin/Heidelberg: Springer Berlin Heidelberg</publisher><subject>Accuracy ; Adaptive systems ; Artificial Intelligence ; Classification ; Computational Intelligence ; Data analysis ; Datasets ; Deep learning ; Engineering ; Internet of Things ; Machine learning ; Management Science ; Operations Research ; Outliers (statistics) ; Sensors ; Sparsity ; Time series ; Wireless sensor networks</subject><ispartof>International journal of fuzzy systems, 2023-09, Vol.25 (6), p.2187-2202</ispartof><rights>The Author(s) under exclusive licence to Taiwan Fuzzy Systems Association 2023. corrected publication 2023. Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-c270t-90b562d6132ce170e44c8491f662c28e03c1409604c7a9265cc738aa6b7171d43</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://link.springer.com/content/pdf/10.1007/s40815-023-01496-z$$EPDF$$P50$$Gspringer$$H</linktopdf><linktohtml>$$Uhttps://www.proquest.com/docview/2922076767?pq-origsite=primo$$EHTML$$P50$$Gproquest$$H</linktohtml><link.rule.ids>314,780,784,21387,27923,27924,33743,41487,42556,43804,51318,64384,64388,72240</link.rule.ids></links><search><creatorcontrib>Arul Jothi, S.</creatorcontrib><creatorcontrib>Venkatesan, R.</creatorcontrib><creatorcontrib>Santhi, V.</creatorcontrib><title>Rule-Based Outlier Detection with a Modified Variational AutoEncoder for Enhancing Data Accuracy in Wireless Sensor Networks</title><title>International journal of fuzzy systems</title><addtitle>Int. J. Fuzzy Syst</addtitle><description>In wireless sensor networks (WSNs), a number of outlier detection (OD) methods have been established over time to identify data that do not match the rest of the data. These data are anomalies, outliers, or irregularities because they result from hostile attacks or sensor node malfunctions. OD is difficult due to the classification process and the challenges in feature development. The limitations of conventional OD include insufficient feature learning, noise, excessive dimensionality, and a lack of training data. Unsupervised outlier detection (UOD) in WSNs is a new research area that has been ascertained to perform exceptionally well in terms of detection accuracy. The fact that prior knowledge of abnormal data is unknown, i.e., the ground truth of data is unknown for the classification of outlier instances, is a substantial barrier in UOD. This made it possible for researchers to examine flexible deep learning methods for domain-specific UOD, like Variational AutoEncoder (VAE). In order to achieve an appropriate categorization of anomalous data, this research suggests using a Modified Variational AutoEncoder (ModVAE) model with a rule-based approach. In the first stage of the proposed system, an adaptive VAE model is developed to produce modified latent space vector samples suitable for reproducing the data with reasonable reconstruction loss, and in the second stage, fuzzy rules are generated to precisely classify abnormal data with fewer false positives. The suggested model's efficiency is demonstrated with experiments done using benchmark datasets. The experimental results show improved performance when compared with other approaches available in the literature.</description><subject>Accuracy</subject><subject>Adaptive systems</subject><subject>Artificial Intelligence</subject><subject>Classification</subject><subject>Computational Intelligence</subject><subject>Data analysis</subject><subject>Datasets</subject><subject>Deep learning</subject><subject>Engineering</subject><subject>Internet of Things</subject><subject>Machine learning</subject><subject>Management Science</subject><subject>Operations Research</subject><subject>Outliers (statistics)</subject><subject>Sensors</subject><subject>Sparsity</subject><subject>Time series</subject><subject>Wireless sensor networks</subject><issn>1562-2479</issn><issn>2199-3211</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><sourceid>AFKRA</sourceid><sourceid>AZQEC</sourceid><sourceid>BENPR</sourceid><sourceid>CCPQU</sourceid><sourceid>DWQXO</sourceid><sourceid>GNUQQ</sourceid><recordid>eNp9kMtKAzEUhoMoWNQXcBVwHc1tksmyar1AVfC6DGkmU6PjRJMMxeLDm1rBnZzFWZzv_-F8AOwTfEgwlkeJ45pUCFOGMOFKoOUGGFGiFGKUkE0wIpWgiHKptsFeSn6GGaGCVYKNwNft0Dl0bJJr4M2QO-8iPHXZ2exDDxc-P0MDr0LjW1-IRxO9WV1MB8dDDpPehqYk2hDhpH82vfX9HJ6abODY2iEa-wl9D598dJ1LCd65PhX02uVFiK9pF2y1pktu73fvgIezyf3JBZrenF-ejKfIUokzUnhWHmgEYdQ6IrHj3NZckVYIamntMLOEYyUwt9IoKiprJauNETNJJGk42wEH6973GD4Gl7J-CUMsTyRNFaVYijKFomvKxpBSdK1-j_7NxE9NsF6J1mvRuojWP6L1soTYOpQK3M9d_Kv-J_UN3OGBJw</recordid><startdate>20230901</startdate><enddate>20230901</enddate><creator>Arul Jothi, S.</creator><creator>Venkatesan, R.</creator><creator>Santhi, V.</creator><general>Springer Berlin Heidelberg</general><general>Springer Nature B.V</general><scope>AAYXX</scope><scope>CITATION</scope><scope>8FE</scope><scope>8FG</scope><scope>ABJCF</scope><scope>AFKRA</scope><scope>ARAPS</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>GNUQQ</scope><scope>HCIFZ</scope><scope>JQ2</scope><scope>K7-</scope><scope>L6V</scope><scope>M7S</scope><scope>P5Z</scope><scope>P62</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PTHSS</scope></search><sort><creationdate>20230901</creationdate><title>Rule-Based Outlier Detection with a Modified Variational AutoEncoder for Enhancing Data Accuracy in Wireless Sensor Networks</title><author>Arul Jothi, S. ; Venkatesan, R. ; Santhi, V.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c270t-90b562d6132ce170e44c8491f662c28e03c1409604c7a9265cc738aa6b7171d43</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Accuracy</topic><topic>Adaptive systems</topic><topic>Artificial Intelligence</topic><topic>Classification</topic><topic>Computational Intelligence</topic><topic>Data analysis</topic><topic>Datasets</topic><topic>Deep learning</topic><topic>Engineering</topic><topic>Internet of Things</topic><topic>Machine learning</topic><topic>Management Science</topic><topic>Operations Research</topic><topic>Outliers (statistics)</topic><topic>Sensors</topic><topic>Sparsity</topic><topic>Time series</topic><topic>Wireless sensor networks</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Arul Jothi, S.</creatorcontrib><creatorcontrib>Venkatesan, R.</creatorcontrib><creatorcontrib>Santhi, V.</creatorcontrib><collection>CrossRef</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>Materials Science & Engineering Collection</collection><collection>ProQuest Central UK/Ireland</collection><collection>Advanced Technologies & Aerospace Collection</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Technology Collection (ProQuest)</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>ProQuest Central Student</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Computer Science Collection</collection><collection>Computer Science Database</collection><collection>ProQuest Engineering Collection</collection><collection>Engineering Database</collection><collection>Advanced Technologies & Aerospace Database</collection><collection>ProQuest Advanced Technologies & Aerospace Collection</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>Engineering Collection</collection><jtitle>International journal of fuzzy systems</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Arul Jothi, S.</au><au>Venkatesan, R.</au><au>Santhi, V.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Rule-Based Outlier Detection with a Modified Variational AutoEncoder for Enhancing Data Accuracy in Wireless Sensor Networks</atitle><jtitle>International journal of fuzzy systems</jtitle><stitle>Int. J. Fuzzy Syst</stitle><date>2023-09-01</date><risdate>2023</risdate><volume>25</volume><issue>6</issue><spage>2187</spage><epage>2202</epage><pages>2187-2202</pages><issn>1562-2479</issn><eissn>2199-3211</eissn><abstract>In wireless sensor networks (WSNs), a number of outlier detection (OD) methods have been established over time to identify data that do not match the rest of the data. These data are anomalies, outliers, or irregularities because they result from hostile attacks or sensor node malfunctions. OD is difficult due to the classification process and the challenges in feature development. The limitations of conventional OD include insufficient feature learning, noise, excessive dimensionality, and a lack of training data. Unsupervised outlier detection (UOD) in WSNs is a new research area that has been ascertained to perform exceptionally well in terms of detection accuracy. The fact that prior knowledge of abnormal data is unknown, i.e., the ground truth of data is unknown for the classification of outlier instances, is a substantial barrier in UOD. This made it possible for researchers to examine flexible deep learning methods for domain-specific UOD, like Variational AutoEncoder (VAE). In order to achieve an appropriate categorization of anomalous data, this research suggests using a Modified Variational AutoEncoder (ModVAE) model with a rule-based approach. In the first stage of the proposed system, an adaptive VAE model is developed to produce modified latent space vector samples suitable for reproducing the data with reasonable reconstruction loss, and in the second stage, fuzzy rules are generated to precisely classify abnormal data with fewer false positives. The suggested model's efficiency is demonstrated with experiments done using benchmark datasets. The experimental results show improved performance when compared with other approaches available in the literature.</abstract><cop>Berlin/Heidelberg</cop><pub>Springer Berlin Heidelberg</pub><doi>10.1007/s40815-023-01496-z</doi><tpages>16</tpages></addata></record> |
fulltext | fulltext |
identifier | ISSN: 1562-2479 |
ispartof | International journal of fuzzy systems, 2023-09, Vol.25 (6), p.2187-2202 |
issn | 1562-2479 2199-3211 |
language | eng |
recordid | cdi_proquest_journals_2922076767 |
source | ProQuest Central UK/Ireland; SpringerLink Journals - AutoHoldings; ProQuest Central |
subjects | Accuracy Adaptive systems Artificial Intelligence Classification Computational Intelligence Data analysis Datasets Deep learning Engineering Internet of Things Machine learning Management Science Operations Research Outliers (statistics) Sensors Sparsity Time series Wireless sensor networks |
title | Rule-Based Outlier Detection with a Modified Variational AutoEncoder for Enhancing Data Accuracy in Wireless Sensor Networks |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-13T06%3A23%3A31IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Rule-Based%20Outlier%20Detection%20with%20a%20Modified%20Variational%20AutoEncoder%20for%20Enhancing%20Data%20Accuracy%20in%20Wireless%20Sensor%20Networks&rft.jtitle=International%20journal%20of%20fuzzy%20systems&rft.au=Arul%20Jothi,%20S.&rft.date=2023-09-01&rft.volume=25&rft.issue=6&rft.spage=2187&rft.epage=2202&rft.pages=2187-2202&rft.issn=1562-2479&rft.eissn=2199-3211&rft_id=info:doi/10.1007/s40815-023-01496-z&rft_dat=%3Cproquest_cross%3E2922076767%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2922076767&rft_id=info:pmid/&rfr_iscdi=true |