CSITime: Privacy-preserving human activity recognition using WiFi channel state information

Human activity recognition (HAR) is an important task in many applications such as smart homes, sports analysis, healthcare services, etc. Popular modalities for human activity recognition involving computer vision and inertial sensors are in the literature for solving HAR, however, they face seriou...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Neural networks 2022-02, Vol.146, p.11-21
Hauptverfasser: Yadav, Santosh Kumar, Sai, Siva, Gundewar, Akshay, Rathore, Heena, Tiwari, Kamlesh, Pandey, Hari Mohan, Mathur, Mohit
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 21
container_issue
container_start_page 11
container_title Neural networks
container_volume 146
creator Yadav, Santosh Kumar
Sai, Siva
Gundewar, Akshay
Rathore, Heena
Tiwari, Kamlesh
Pandey, Hari Mohan
Mathur, Mohit
description Human activity recognition (HAR) is an important task in many applications such as smart homes, sports analysis, healthcare services, etc. Popular modalities for human activity recognition involving computer vision and inertial sensors are in the literature for solving HAR, however, they face serious limitations with respect to different illumination, background, clutter, obtrusiveness, and other factors. In recent years, WiFi channel state information (CSI) based activity recognition is gaining momentum due to its many advantages including easy deployability, and cost-effectiveness. This work proposes CSITime, a modified InceptionTime network architecture, a generic architecture for CSI-based human activity recognition. We perceive CSI activity recognition as a multi-variate time series problem. The methodology of CSITime is threefold. First, we pre-process CSI signals followed by data augmentation using two label-mixing strategies — mixup and cutmix to enhance the neural network’s learning. Second, in the basic block of CSITime, features from multiple convolutional kernels are concatenated and passed through a self-attention layer followed by a fully connected layer with Mish activation. CSITime network consists of six such blocks followed by a global average pooling layer and a final fully connected layer for the final classification. Third, in the training of the neural network, instead of adopting general training procedures such as early stopping, we use one-cycle policy and cosine annealing to monitor the learning rate. The proposed model has been tested on publicly available benchmark datasets, i.e., ARIL, StanWiFi, and SignFi datasets. The proposed CSITime has achieved accuracy of 98.20%, 98%, and 95.42% on ARIL, StanWiFi, and SignFi datasets, respectively, for WiFi-based activity recognition. This is an improvement on state-of-the-art accuracies by 3.3%, 0.67%, and 0.82% on ARIL, StanWiFi, and SignFi datasets, respectively. In lab-5 users’ scenario of the SignFi dataset, which has the training and testing data from different distributions, our model achieved accuracy was 2.17% higher than state-of-the-art, which shows the comparative robustness of our model.
doi_str_mv 10.1016/j.neunet.2021.11.011
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_2604456776</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S0893608021004391</els_id><sourcerecordid>2604456776</sourcerecordid><originalsourceid>FETCH-LOGICAL-c408t-ac9a727383669186024010529eba517ed43e70895416444458f3331e03c3a2873</originalsourceid><addsrcrecordid>eNp9kE1rGzEQhkVoaNy0_yCUPfay2xlpLWl7CAQTt4FAAknpoQchy-NExqt1JK3B_z4yTnqsLnPQ887Hw9gFQoOA8vu6CTQGyg0Hjg1iA4gnbIJadTVXmn9gE9CdqCVoOGOfUloDgNSt-MjORKtFV34n7O_s4ebR9_Sjuo9-Z92-3kZKFHc-PFXPY29DZV32O5_3VSQ3PAWf_RCqMR2AP37uK_dsQ6BNlbLNVPmwGmJvD9Bndrqym0Rf3uo5-z2_fpz9qm_vft7Mrm5r14LOtXWdVVwJLaTsUEvgLSBMeUcLO0VFy1aQKstOW5RteVO9EkIggXDCcq3EOft27LuNw8tIKZveJ0ebjQ00jMlwCSUllZIFbY-oi0NKkVZmG31v494gmINWszZHreag1SCaorXEvr5NGBc9Lf-F3j0W4PIIULlz5yma5DwFR0tfrGWzHPz_J7wC-sCJ4w</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2604456776</pqid></control><display><type>article</type><title>CSITime: Privacy-preserving human activity recognition using WiFi channel state information</title><source>MEDLINE</source><source>Elsevier ScienceDirect Journals</source><creator>Yadav, Santosh Kumar ; Sai, Siva ; Gundewar, Akshay ; Rathore, Heena ; Tiwari, Kamlesh ; Pandey, Hari Mohan ; Mathur, Mohit</creator><creatorcontrib>Yadav, Santosh Kumar ; Sai, Siva ; Gundewar, Akshay ; Rathore, Heena ; Tiwari, Kamlesh ; Pandey, Hari Mohan ; Mathur, Mohit</creatorcontrib><description>Human activity recognition (HAR) is an important task in many applications such as smart homes, sports analysis, healthcare services, etc. Popular modalities for human activity recognition involving computer vision and inertial sensors are in the literature for solving HAR, however, they face serious limitations with respect to different illumination, background, clutter, obtrusiveness, and other factors. In recent years, WiFi channel state information (CSI) based activity recognition is gaining momentum due to its many advantages including easy deployability, and cost-effectiveness. This work proposes CSITime, a modified InceptionTime network architecture, a generic architecture for CSI-based human activity recognition. We perceive CSI activity recognition as a multi-variate time series problem. The methodology of CSITime is threefold. First, we pre-process CSI signals followed by data augmentation using two label-mixing strategies — mixup and cutmix to enhance the neural network’s learning. Second, in the basic block of CSITime, features from multiple convolutional kernels are concatenated and passed through a self-attention layer followed by a fully connected layer with Mish activation. CSITime network consists of six such blocks followed by a global average pooling layer and a final fully connected layer for the final classification. Third, in the training of the neural network, instead of adopting general training procedures such as early stopping, we use one-cycle policy and cosine annealing to monitor the learning rate. The proposed model has been tested on publicly available benchmark datasets, i.e., ARIL, StanWiFi, and SignFi datasets. The proposed CSITime has achieved accuracy of 98.20%, 98%, and 95.42% on ARIL, StanWiFi, and SignFi datasets, respectively, for WiFi-based activity recognition. This is an improvement on state-of-the-art accuracies by 3.3%, 0.67%, and 0.82% on ARIL, StanWiFi, and SignFi datasets, respectively. In lab-5 users’ scenario of the SignFi dataset, which has the training and testing data from different distributions, our model achieved accuracy was 2.17% higher than state-of-the-art, which shows the comparative robustness of our model.</description><identifier>ISSN: 0893-6080</identifier><identifier>EISSN: 1879-2782</identifier><identifier>DOI: 10.1016/j.neunet.2021.11.011</identifier><identifier>PMID: 34839089</identifier><language>eng</language><publisher>United States: Elsevier Ltd</publisher><subject>Algorithms ; Data augmentation ; Human Activities ; Human activity recognition ; Humans ; Neural Networks, Computer ; Privacy ; Recognition, Psychology ; Time series classification ; WiFi channel state information</subject><ispartof>Neural networks, 2022-02, Vol.146, p.11-21</ispartof><rights>2021 Elsevier Ltd</rights><rights>Copyright © 2021 Elsevier Ltd. All rights reserved.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c408t-ac9a727383669186024010529eba517ed43e70895416444458f3331e03c3a2873</citedby><cites>FETCH-LOGICAL-c408t-ac9a727383669186024010529eba517ed43e70895416444458f3331e03c3a2873</cites><orcidid>0000-0002-9403-8071 ; 0000-0001-7150-1396 ; 0000-0003-2230-4390 ; 0000-0002-9128-068X ; 0000-0002-8866-9192</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://www.sciencedirect.com/science/article/pii/S0893608021004391$$EHTML$$P50$$Gelsevier$$H</linktohtml><link.rule.ids>314,776,780,3537,27901,27902,65306</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/34839089$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Yadav, Santosh Kumar</creatorcontrib><creatorcontrib>Sai, Siva</creatorcontrib><creatorcontrib>Gundewar, Akshay</creatorcontrib><creatorcontrib>Rathore, Heena</creatorcontrib><creatorcontrib>Tiwari, Kamlesh</creatorcontrib><creatorcontrib>Pandey, Hari Mohan</creatorcontrib><creatorcontrib>Mathur, Mohit</creatorcontrib><title>CSITime: Privacy-preserving human activity recognition using WiFi channel state information</title><title>Neural networks</title><addtitle>Neural Netw</addtitle><description>Human activity recognition (HAR) is an important task in many applications such as smart homes, sports analysis, healthcare services, etc. Popular modalities for human activity recognition involving computer vision and inertial sensors are in the literature for solving HAR, however, they face serious limitations with respect to different illumination, background, clutter, obtrusiveness, and other factors. In recent years, WiFi channel state information (CSI) based activity recognition is gaining momentum due to its many advantages including easy deployability, and cost-effectiveness. This work proposes CSITime, a modified InceptionTime network architecture, a generic architecture for CSI-based human activity recognition. We perceive CSI activity recognition as a multi-variate time series problem. The methodology of CSITime is threefold. First, we pre-process CSI signals followed by data augmentation using two label-mixing strategies — mixup and cutmix to enhance the neural network’s learning. Second, in the basic block of CSITime, features from multiple convolutional kernels are concatenated and passed through a self-attention layer followed by a fully connected layer with Mish activation. CSITime network consists of six such blocks followed by a global average pooling layer and a final fully connected layer for the final classification. Third, in the training of the neural network, instead of adopting general training procedures such as early stopping, we use one-cycle policy and cosine annealing to monitor the learning rate. The proposed model has been tested on publicly available benchmark datasets, i.e., ARIL, StanWiFi, and SignFi datasets. The proposed CSITime has achieved accuracy of 98.20%, 98%, and 95.42% on ARIL, StanWiFi, and SignFi datasets, respectively, for WiFi-based activity recognition. This is an improvement on state-of-the-art accuracies by 3.3%, 0.67%, and 0.82% on ARIL, StanWiFi, and SignFi datasets, respectively. In lab-5 users’ scenario of the SignFi dataset, which has the training and testing data from different distributions, our model achieved accuracy was 2.17% higher than state-of-the-art, which shows the comparative robustness of our model.</description><subject>Algorithms</subject><subject>Data augmentation</subject><subject>Human Activities</subject><subject>Human activity recognition</subject><subject>Humans</subject><subject>Neural Networks, Computer</subject><subject>Privacy</subject><subject>Recognition, Psychology</subject><subject>Time series classification</subject><subject>WiFi channel state information</subject><issn>0893-6080</issn><issn>1879-2782</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><sourceid>EIF</sourceid><recordid>eNp9kE1rGzEQhkVoaNy0_yCUPfay2xlpLWl7CAQTt4FAAknpoQchy-NExqt1JK3B_z4yTnqsLnPQ887Hw9gFQoOA8vu6CTQGyg0Hjg1iA4gnbIJadTVXmn9gE9CdqCVoOGOfUloDgNSt-MjORKtFV34n7O_s4ebR9_Sjuo9-Z92-3kZKFHc-PFXPY29DZV32O5_3VSQ3PAWf_RCqMR2AP37uK_dsQ6BNlbLNVPmwGmJvD9Bndrqym0Rf3uo5-z2_fpz9qm_vft7Mrm5r14LOtXWdVVwJLaTsUEvgLSBMeUcLO0VFy1aQKstOW5RteVO9EkIggXDCcq3EOft27LuNw8tIKZveJ0ebjQ00jMlwCSUllZIFbY-oi0NKkVZmG31v494gmINWszZHreag1SCaorXEvr5NGBc9Lf-F3j0W4PIIULlz5yma5DwFR0tfrGWzHPz_J7wC-sCJ4w</recordid><startdate>202202</startdate><enddate>202202</enddate><creator>Yadav, Santosh Kumar</creator><creator>Sai, Siva</creator><creator>Gundewar, Akshay</creator><creator>Rathore, Heena</creator><creator>Tiwari, Kamlesh</creator><creator>Pandey, Hari Mohan</creator><creator>Mathur, Mohit</creator><general>Elsevier Ltd</general><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7X8</scope><orcidid>https://orcid.org/0000-0002-9403-8071</orcidid><orcidid>https://orcid.org/0000-0001-7150-1396</orcidid><orcidid>https://orcid.org/0000-0003-2230-4390</orcidid><orcidid>https://orcid.org/0000-0002-9128-068X</orcidid><orcidid>https://orcid.org/0000-0002-8866-9192</orcidid></search><sort><creationdate>202202</creationdate><title>CSITime: Privacy-preserving human activity recognition using WiFi channel state information</title><author>Yadav, Santosh Kumar ; Sai, Siva ; Gundewar, Akshay ; Rathore, Heena ; Tiwari, Kamlesh ; Pandey, Hari Mohan ; Mathur, Mohit</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c408t-ac9a727383669186024010529eba517ed43e70895416444458f3331e03c3a2873</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>Algorithms</topic><topic>Data augmentation</topic><topic>Human Activities</topic><topic>Human activity recognition</topic><topic>Humans</topic><topic>Neural Networks, Computer</topic><topic>Privacy</topic><topic>Recognition, Psychology</topic><topic>Time series classification</topic><topic>WiFi channel state information</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Yadav, Santosh Kumar</creatorcontrib><creatorcontrib>Sai, Siva</creatorcontrib><creatorcontrib>Gundewar, Akshay</creatorcontrib><creatorcontrib>Rathore, Heena</creatorcontrib><creatorcontrib>Tiwari, Kamlesh</creatorcontrib><creatorcontrib>Pandey, Hari Mohan</creatorcontrib><creatorcontrib>Mathur, Mohit</creatorcontrib><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>MEDLINE - Academic</collection><jtitle>Neural networks</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Yadav, Santosh Kumar</au><au>Sai, Siva</au><au>Gundewar, Akshay</au><au>Rathore, Heena</au><au>Tiwari, Kamlesh</au><au>Pandey, Hari Mohan</au><au>Mathur, Mohit</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>CSITime: Privacy-preserving human activity recognition using WiFi channel state information</atitle><jtitle>Neural networks</jtitle><addtitle>Neural Netw</addtitle><date>2022-02</date><risdate>2022</risdate><volume>146</volume><spage>11</spage><epage>21</epage><pages>11-21</pages><issn>0893-6080</issn><eissn>1879-2782</eissn><abstract>Human activity recognition (HAR) is an important task in many applications such as smart homes, sports analysis, healthcare services, etc. Popular modalities for human activity recognition involving computer vision and inertial sensors are in the literature for solving HAR, however, they face serious limitations with respect to different illumination, background, clutter, obtrusiveness, and other factors. In recent years, WiFi channel state information (CSI) based activity recognition is gaining momentum due to its many advantages including easy deployability, and cost-effectiveness. This work proposes CSITime, a modified InceptionTime network architecture, a generic architecture for CSI-based human activity recognition. We perceive CSI activity recognition as a multi-variate time series problem. The methodology of CSITime is threefold. First, we pre-process CSI signals followed by data augmentation using two label-mixing strategies — mixup and cutmix to enhance the neural network’s learning. Second, in the basic block of CSITime, features from multiple convolutional kernels are concatenated and passed through a self-attention layer followed by a fully connected layer with Mish activation. CSITime network consists of six such blocks followed by a global average pooling layer and a final fully connected layer for the final classification. Third, in the training of the neural network, instead of adopting general training procedures such as early stopping, we use one-cycle policy and cosine annealing to monitor the learning rate. The proposed model has been tested on publicly available benchmark datasets, i.e., ARIL, StanWiFi, and SignFi datasets. The proposed CSITime has achieved accuracy of 98.20%, 98%, and 95.42% on ARIL, StanWiFi, and SignFi datasets, respectively, for WiFi-based activity recognition. This is an improvement on state-of-the-art accuracies by 3.3%, 0.67%, and 0.82% on ARIL, StanWiFi, and SignFi datasets, respectively. In lab-5 users’ scenario of the SignFi dataset, which has the training and testing data from different distributions, our model achieved accuracy was 2.17% higher than state-of-the-art, which shows the comparative robustness of our model.</abstract><cop>United States</cop><pub>Elsevier Ltd</pub><pmid>34839089</pmid><doi>10.1016/j.neunet.2021.11.011</doi><tpages>11</tpages><orcidid>https://orcid.org/0000-0002-9403-8071</orcidid><orcidid>https://orcid.org/0000-0001-7150-1396</orcidid><orcidid>https://orcid.org/0000-0003-2230-4390</orcidid><orcidid>https://orcid.org/0000-0002-9128-068X</orcidid><orcidid>https://orcid.org/0000-0002-8866-9192</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 0893-6080
ispartof Neural networks, 2022-02, Vol.146, p.11-21
issn 0893-6080
1879-2782
language eng
recordid cdi_proquest_miscellaneous_2604456776
source MEDLINE; Elsevier ScienceDirect Journals
subjects Algorithms
Data augmentation
Human Activities
Human activity recognition
Humans
Neural Networks, Computer
Privacy
Recognition, Psychology
Time series classification
WiFi channel state information
title CSITime: Privacy-preserving human activity recognition using WiFi channel state information
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-31T12%3A13%3A51IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=CSITime:%20Privacy-preserving%20human%20activity%20recognition%20using%20WiFi%20channel%20state%20information&rft.jtitle=Neural%20networks&rft.au=Yadav,%20Santosh%20Kumar&rft.date=2022-02&rft.volume=146&rft.spage=11&rft.epage=21&rft.pages=11-21&rft.issn=0893-6080&rft.eissn=1879-2782&rft_id=info:doi/10.1016/j.neunet.2021.11.011&rft_dat=%3Cproquest_cross%3E2604456776%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2604456776&rft_id=info:pmid/34839089&rft_els_id=S0893608021004391&rfr_iscdi=true