CSITime: Privacy-preserving human activity recognition using WiFi channel state information
Human activity recognition (HAR) is an important task in many applications such as smart homes, sports analysis, healthcare services, etc. Popular modalities for human activity recognition involving computer vision and inertial sensors are in the literature for solving HAR, however, they face seriou...
Gespeichert in:
Veröffentlicht in: | Neural networks 2022-02, Vol.146, p.11-21 |
---|---|
Hauptverfasser: | , , , , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 21 |
---|---|
container_issue | |
container_start_page | 11 |
container_title | Neural networks |
container_volume | 146 |
creator | Yadav, Santosh Kumar Sai, Siva Gundewar, Akshay Rathore, Heena Tiwari, Kamlesh Pandey, Hari Mohan Mathur, Mohit |
description | Human activity recognition (HAR) is an important task in many applications such as smart homes, sports analysis, healthcare services, etc. Popular modalities for human activity recognition involving computer vision and inertial sensors are in the literature for solving HAR, however, they face serious limitations with respect to different illumination, background, clutter, obtrusiveness, and other factors. In recent years, WiFi channel state information (CSI) based activity recognition is gaining momentum due to its many advantages including easy deployability, and cost-effectiveness. This work proposes CSITime, a modified InceptionTime network architecture, a generic architecture for CSI-based human activity recognition. We perceive CSI activity recognition as a multi-variate time series problem. The methodology of CSITime is threefold. First, we pre-process CSI signals followed by data augmentation using two label-mixing strategies — mixup and cutmix to enhance the neural network’s learning. Second, in the basic block of CSITime, features from multiple convolutional kernels are concatenated and passed through a self-attention layer followed by a fully connected layer with Mish activation. CSITime network consists of six such blocks followed by a global average pooling layer and a final fully connected layer for the final classification. Third, in the training of the neural network, instead of adopting general training procedures such as early stopping, we use one-cycle policy and cosine annealing to monitor the learning rate. The proposed model has been tested on publicly available benchmark datasets, i.e., ARIL, StanWiFi, and SignFi datasets. The proposed CSITime has achieved accuracy of 98.20%, 98%, and 95.42% on ARIL, StanWiFi, and SignFi datasets, respectively, for WiFi-based activity recognition. This is an improvement on state-of-the-art accuracies by 3.3%, 0.67%, and 0.82% on ARIL, StanWiFi, and SignFi datasets, respectively. In lab-5 users’ scenario of the SignFi dataset, which has the training and testing data from different distributions, our model achieved accuracy was 2.17% higher than state-of-the-art, which shows the comparative robustness of our model. |
doi_str_mv | 10.1016/j.neunet.2021.11.011 |
format | Article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_2604456776</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S0893608021004391</els_id><sourcerecordid>2604456776</sourcerecordid><originalsourceid>FETCH-LOGICAL-c408t-ac9a727383669186024010529eba517ed43e70895416444458f3331e03c3a2873</originalsourceid><addsrcrecordid>eNp9kE1rGzEQhkVoaNy0_yCUPfay2xlpLWl7CAQTt4FAAknpoQchy-NExqt1JK3B_z4yTnqsLnPQ887Hw9gFQoOA8vu6CTQGyg0Hjg1iA4gnbIJadTVXmn9gE9CdqCVoOGOfUloDgNSt-MjORKtFV34n7O_s4ebR9_Sjuo9-Z92-3kZKFHc-PFXPY29DZV32O5_3VSQ3PAWf_RCqMR2AP37uK_dsQ6BNlbLNVPmwGmJvD9Bndrqym0Rf3uo5-z2_fpz9qm_vft7Mrm5r14LOtXWdVVwJLaTsUEvgLSBMeUcLO0VFy1aQKstOW5RteVO9EkIggXDCcq3EOft27LuNw8tIKZveJ0ebjQ00jMlwCSUllZIFbY-oi0NKkVZmG31v494gmINWszZHreag1SCaorXEvr5NGBc9Lf-F3j0W4PIIULlz5yma5DwFR0tfrGWzHPz_J7wC-sCJ4w</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2604456776</pqid></control><display><type>article</type><title>CSITime: Privacy-preserving human activity recognition using WiFi channel state information</title><source>MEDLINE</source><source>Elsevier ScienceDirect Journals</source><creator>Yadav, Santosh Kumar ; Sai, Siva ; Gundewar, Akshay ; Rathore, Heena ; Tiwari, Kamlesh ; Pandey, Hari Mohan ; Mathur, Mohit</creator><creatorcontrib>Yadav, Santosh Kumar ; Sai, Siva ; Gundewar, Akshay ; Rathore, Heena ; Tiwari, Kamlesh ; Pandey, Hari Mohan ; Mathur, Mohit</creatorcontrib><description>Human activity recognition (HAR) is an important task in many applications such as smart homes, sports analysis, healthcare services, etc. Popular modalities for human activity recognition involving computer vision and inertial sensors are in the literature for solving HAR, however, they face serious limitations with respect to different illumination, background, clutter, obtrusiveness, and other factors. In recent years, WiFi channel state information (CSI) based activity recognition is gaining momentum due to its many advantages including easy deployability, and cost-effectiveness. This work proposes CSITime, a modified InceptionTime network architecture, a generic architecture for CSI-based human activity recognition. We perceive CSI activity recognition as a multi-variate time series problem. The methodology of CSITime is threefold. First, we pre-process CSI signals followed by data augmentation using two label-mixing strategies — mixup and cutmix to enhance the neural network’s learning. Second, in the basic block of CSITime, features from multiple convolutional kernels are concatenated and passed through a self-attention layer followed by a fully connected layer with Mish activation. CSITime network consists of six such blocks followed by a global average pooling layer and a final fully connected layer for the final classification. Third, in the training of the neural network, instead of adopting general training procedures such as early stopping, we use one-cycle policy and cosine annealing to monitor the learning rate. The proposed model has been tested on publicly available benchmark datasets, i.e., ARIL, StanWiFi, and SignFi datasets. The proposed CSITime has achieved accuracy of 98.20%, 98%, and 95.42% on ARIL, StanWiFi, and SignFi datasets, respectively, for WiFi-based activity recognition. This is an improvement on state-of-the-art accuracies by 3.3%, 0.67%, and 0.82% on ARIL, StanWiFi, and SignFi datasets, respectively. In lab-5 users’ scenario of the SignFi dataset, which has the training and testing data from different distributions, our model achieved accuracy was 2.17% higher than state-of-the-art, which shows the comparative robustness of our model.</description><identifier>ISSN: 0893-6080</identifier><identifier>EISSN: 1879-2782</identifier><identifier>DOI: 10.1016/j.neunet.2021.11.011</identifier><identifier>PMID: 34839089</identifier><language>eng</language><publisher>United States: Elsevier Ltd</publisher><subject>Algorithms ; Data augmentation ; Human Activities ; Human activity recognition ; Humans ; Neural Networks, Computer ; Privacy ; Recognition, Psychology ; Time series classification ; WiFi channel state information</subject><ispartof>Neural networks, 2022-02, Vol.146, p.11-21</ispartof><rights>2021 Elsevier Ltd</rights><rights>Copyright © 2021 Elsevier Ltd. All rights reserved.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c408t-ac9a727383669186024010529eba517ed43e70895416444458f3331e03c3a2873</citedby><cites>FETCH-LOGICAL-c408t-ac9a727383669186024010529eba517ed43e70895416444458f3331e03c3a2873</cites><orcidid>0000-0002-9403-8071 ; 0000-0001-7150-1396 ; 0000-0003-2230-4390 ; 0000-0002-9128-068X ; 0000-0002-8866-9192</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://www.sciencedirect.com/science/article/pii/S0893608021004391$$EHTML$$P50$$Gelsevier$$H</linktohtml><link.rule.ids>314,776,780,3537,27901,27902,65306</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/34839089$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Yadav, Santosh Kumar</creatorcontrib><creatorcontrib>Sai, Siva</creatorcontrib><creatorcontrib>Gundewar, Akshay</creatorcontrib><creatorcontrib>Rathore, Heena</creatorcontrib><creatorcontrib>Tiwari, Kamlesh</creatorcontrib><creatorcontrib>Pandey, Hari Mohan</creatorcontrib><creatorcontrib>Mathur, Mohit</creatorcontrib><title>CSITime: Privacy-preserving human activity recognition using WiFi channel state information</title><title>Neural networks</title><addtitle>Neural Netw</addtitle><description>Human activity recognition (HAR) is an important task in many applications such as smart homes, sports analysis, healthcare services, etc. Popular modalities for human activity recognition involving computer vision and inertial sensors are in the literature for solving HAR, however, they face serious limitations with respect to different illumination, background, clutter, obtrusiveness, and other factors. In recent years, WiFi channel state information (CSI) based activity recognition is gaining momentum due to its many advantages including easy deployability, and cost-effectiveness. This work proposes CSITime, a modified InceptionTime network architecture, a generic architecture for CSI-based human activity recognition. We perceive CSI activity recognition as a multi-variate time series problem. The methodology of CSITime is threefold. First, we pre-process CSI signals followed by data augmentation using two label-mixing strategies — mixup and cutmix to enhance the neural network’s learning. Second, in the basic block of CSITime, features from multiple convolutional kernels are concatenated and passed through a self-attention layer followed by a fully connected layer with Mish activation. CSITime network consists of six such blocks followed by a global average pooling layer and a final fully connected layer for the final classification. Third, in the training of the neural network, instead of adopting general training procedures such as early stopping, we use one-cycle policy and cosine annealing to monitor the learning rate. The proposed model has been tested on publicly available benchmark datasets, i.e., ARIL, StanWiFi, and SignFi datasets. The proposed CSITime has achieved accuracy of 98.20%, 98%, and 95.42% on ARIL, StanWiFi, and SignFi datasets, respectively, for WiFi-based activity recognition. This is an improvement on state-of-the-art accuracies by 3.3%, 0.67%, and 0.82% on ARIL, StanWiFi, and SignFi datasets, respectively. In lab-5 users’ scenario of the SignFi dataset, which has the training and testing data from different distributions, our model achieved accuracy was 2.17% higher than state-of-the-art, which shows the comparative robustness of our model.</description><subject>Algorithms</subject><subject>Data augmentation</subject><subject>Human Activities</subject><subject>Human activity recognition</subject><subject>Humans</subject><subject>Neural Networks, Computer</subject><subject>Privacy</subject><subject>Recognition, Psychology</subject><subject>Time series classification</subject><subject>WiFi channel state information</subject><issn>0893-6080</issn><issn>1879-2782</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><sourceid>EIF</sourceid><recordid>eNp9kE1rGzEQhkVoaNy0_yCUPfay2xlpLWl7CAQTt4FAAknpoQchy-NExqt1JK3B_z4yTnqsLnPQ887Hw9gFQoOA8vu6CTQGyg0Hjg1iA4gnbIJadTVXmn9gE9CdqCVoOGOfUloDgNSt-MjORKtFV34n7O_s4ebR9_Sjuo9-Z92-3kZKFHc-PFXPY29DZV32O5_3VSQ3PAWf_RCqMR2AP37uK_dsQ6BNlbLNVPmwGmJvD9Bndrqym0Rf3uo5-z2_fpz9qm_vft7Mrm5r14LOtXWdVVwJLaTsUEvgLSBMeUcLO0VFy1aQKstOW5RteVO9EkIggXDCcq3EOft27LuNw8tIKZveJ0ebjQ00jMlwCSUllZIFbY-oi0NKkVZmG31v494gmINWszZHreag1SCaorXEvr5NGBc9Lf-F3j0W4PIIULlz5yma5DwFR0tfrGWzHPz_J7wC-sCJ4w</recordid><startdate>202202</startdate><enddate>202202</enddate><creator>Yadav, Santosh Kumar</creator><creator>Sai, Siva</creator><creator>Gundewar, Akshay</creator><creator>Rathore, Heena</creator><creator>Tiwari, Kamlesh</creator><creator>Pandey, Hari Mohan</creator><creator>Mathur, Mohit</creator><general>Elsevier Ltd</general><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7X8</scope><orcidid>https://orcid.org/0000-0002-9403-8071</orcidid><orcidid>https://orcid.org/0000-0001-7150-1396</orcidid><orcidid>https://orcid.org/0000-0003-2230-4390</orcidid><orcidid>https://orcid.org/0000-0002-9128-068X</orcidid><orcidid>https://orcid.org/0000-0002-8866-9192</orcidid></search><sort><creationdate>202202</creationdate><title>CSITime: Privacy-preserving human activity recognition using WiFi channel state information</title><author>Yadav, Santosh Kumar ; Sai, Siva ; Gundewar, Akshay ; Rathore, Heena ; Tiwari, Kamlesh ; Pandey, Hari Mohan ; Mathur, Mohit</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c408t-ac9a727383669186024010529eba517ed43e70895416444458f3331e03c3a2873</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>Algorithms</topic><topic>Data augmentation</topic><topic>Human Activities</topic><topic>Human activity recognition</topic><topic>Humans</topic><topic>Neural Networks, Computer</topic><topic>Privacy</topic><topic>Recognition, Psychology</topic><topic>Time series classification</topic><topic>WiFi channel state information</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Yadav, Santosh Kumar</creatorcontrib><creatorcontrib>Sai, Siva</creatorcontrib><creatorcontrib>Gundewar, Akshay</creatorcontrib><creatorcontrib>Rathore, Heena</creatorcontrib><creatorcontrib>Tiwari, Kamlesh</creatorcontrib><creatorcontrib>Pandey, Hari Mohan</creatorcontrib><creatorcontrib>Mathur, Mohit</creatorcontrib><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>MEDLINE - Academic</collection><jtitle>Neural networks</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Yadav, Santosh Kumar</au><au>Sai, Siva</au><au>Gundewar, Akshay</au><au>Rathore, Heena</au><au>Tiwari, Kamlesh</au><au>Pandey, Hari Mohan</au><au>Mathur, Mohit</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>CSITime: Privacy-preserving human activity recognition using WiFi channel state information</atitle><jtitle>Neural networks</jtitle><addtitle>Neural Netw</addtitle><date>2022-02</date><risdate>2022</risdate><volume>146</volume><spage>11</spage><epage>21</epage><pages>11-21</pages><issn>0893-6080</issn><eissn>1879-2782</eissn><abstract>Human activity recognition (HAR) is an important task in many applications such as smart homes, sports analysis, healthcare services, etc. Popular modalities for human activity recognition involving computer vision and inertial sensors are in the literature for solving HAR, however, they face serious limitations with respect to different illumination, background, clutter, obtrusiveness, and other factors. In recent years, WiFi channel state information (CSI) based activity recognition is gaining momentum due to its many advantages including easy deployability, and cost-effectiveness. This work proposes CSITime, a modified InceptionTime network architecture, a generic architecture for CSI-based human activity recognition. We perceive CSI activity recognition as a multi-variate time series problem. The methodology of CSITime is threefold. First, we pre-process CSI signals followed by data augmentation using two label-mixing strategies — mixup and cutmix to enhance the neural network’s learning. Second, in the basic block of CSITime, features from multiple convolutional kernels are concatenated and passed through a self-attention layer followed by a fully connected layer with Mish activation. CSITime network consists of six such blocks followed by a global average pooling layer and a final fully connected layer for the final classification. Third, in the training of the neural network, instead of adopting general training procedures such as early stopping, we use one-cycle policy and cosine annealing to monitor the learning rate. The proposed model has been tested on publicly available benchmark datasets, i.e., ARIL, StanWiFi, and SignFi datasets. The proposed CSITime has achieved accuracy of 98.20%, 98%, and 95.42% on ARIL, StanWiFi, and SignFi datasets, respectively, for WiFi-based activity recognition. This is an improvement on state-of-the-art accuracies by 3.3%, 0.67%, and 0.82% on ARIL, StanWiFi, and SignFi datasets, respectively. In lab-5 users’ scenario of the SignFi dataset, which has the training and testing data from different distributions, our model achieved accuracy was 2.17% higher than state-of-the-art, which shows the comparative robustness of our model.</abstract><cop>United States</cop><pub>Elsevier Ltd</pub><pmid>34839089</pmid><doi>10.1016/j.neunet.2021.11.011</doi><tpages>11</tpages><orcidid>https://orcid.org/0000-0002-9403-8071</orcidid><orcidid>https://orcid.org/0000-0001-7150-1396</orcidid><orcidid>https://orcid.org/0000-0003-2230-4390</orcidid><orcidid>https://orcid.org/0000-0002-9128-068X</orcidid><orcidid>https://orcid.org/0000-0002-8866-9192</orcidid><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | ISSN: 0893-6080 |
ispartof | Neural networks, 2022-02, Vol.146, p.11-21 |
issn | 0893-6080 1879-2782 |
language | eng |
recordid | cdi_proquest_miscellaneous_2604456776 |
source | MEDLINE; Elsevier ScienceDirect Journals |
subjects | Algorithms Data augmentation Human Activities Human activity recognition Humans Neural Networks, Computer Privacy Recognition, Psychology Time series classification WiFi channel state information |
title | CSITime: Privacy-preserving human activity recognition using WiFi channel state information |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-31T12%3A13%3A51IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=CSITime:%20Privacy-preserving%20human%20activity%20recognition%20using%20WiFi%20channel%20state%20information&rft.jtitle=Neural%20networks&rft.au=Yadav,%20Santosh%20Kumar&rft.date=2022-02&rft.volume=146&rft.spage=11&rft.epage=21&rft.pages=11-21&rft.issn=0893-6080&rft.eissn=1879-2782&rft_id=info:doi/10.1016/j.neunet.2021.11.011&rft_dat=%3Cproquest_cross%3E2604456776%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2604456776&rft_id=info:pmid/34839089&rft_els_id=S0893608021004391&rfr_iscdi=true |