A Self-Supervised Human Activity Recognition Approach via Body Sensor Networks in Smart City

In smart cities, pervasive sensing and wearable computing techniques are increasingly being employed to monitor and recognize human activities through body sensor networks, which have been widely used in urban safety, healthcare, and manufacturing. However, most researchers regard human activity rec...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE sensors journal 2024-03, Vol.24 (5), p.1-1
Hauptverfasser: Zhou, Yu, Xie, Chuanshi, Sun, Shilong, Zhang, Xiao, Wang, Yufan
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 1
container_issue 5
container_start_page 1
container_title IEEE sensors journal
container_volume 24
creator Zhou, Yu
Xie, Chuanshi
Sun, Shilong
Zhang, Xiao
Wang, Yufan
description In smart cities, pervasive sensing and wearable computing techniques are increasingly being employed to monitor and recognize human activities through body sensor networks, which have been widely used in urban safety, healthcare, and manufacturing. However, most researchers regard human activity recognition (HAR) as a high-cost research task requiring a large amount of labeled data, which is often unrealistic in real-world applications. To address this problem, we propose a self-supervised learning framework for HAR (SS-HAR). SS-HAR initially takes the unlabeled data generated by data augmentation as the input of the network, mines the supervised information of the unlabeled data under the effect of self-supervised learning, and uses the obtained backbone network as a feature extractor to extract activity features for subsequent classification. After that, we use part of the labeled data as the training set and extract the activity features using the backbone network for training and fitting the classifier. Then we utilize the rest of the data to verify the feasibility and effectiveness of the proposed self-supervised learning method. We have conducted multiple experiments on three publicly available datasets and one self-collected basketball activity dataset SZU_HAD_Basketball. The experimental results show that the SS-HAR method is able to achieve higher classification accuracy and stability than supervised and semi-supervised methods. Specifically, on the UCI dataset, SS-HAR achieves better classification performance compared to other approaches which improve the classification accuracy by 1% over the supervised method and by 5%-6% over the semi-supervised method respectively.
doi_str_mv 10.1109/JSEN.2023.3282601
format Article
fullrecord <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_ieee_primary_10147042</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>10147042</ieee_id><sourcerecordid>2932574637</sourcerecordid><originalsourceid>FETCH-LOGICAL-c209t-c1b450aa0d5f54f9359038339b62bf268584550087d8972129fc4956aa193bc23</originalsourceid><addsrcrecordid>eNpNkF1LwzAUhoMoOKc_QPAi4HVnPpvkcg51yphgFbwQQtqmmrm1NWkn-_embBdencPhfc45PABcYjTBGKmbp-xuOSGI0AklkqQIH4ER5lwmWDB5PPQUJYyK91NwFsIKIawEFyPwMYWZXVdJ1rfWb12wJZz3G1PDadG5ret28MUWzWftOtfEYdv6xhRfcOsMvG3KXYTr0Hi4tN1v478DdDXMNsZ3cBbZc3BSmXWwF4c6Bm_3d6-zebJ4fnicTRdJQZDqkgLnjCNjUMkrzipFuUJUUqrylOQVSSWXjHOEpCilEgQTVRVM8dQYrGheEDoG1_u98buf3oZOr5re1_GkJooSLlhKRUzhfarwTQjeVrr1Lv660xjpQaIeJOpBoj5IjMzVnnHW2n95zARihP4BXOJsTg</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2932574637</pqid></control><display><type>article</type><title>A Self-Supervised Human Activity Recognition Approach via Body Sensor Networks in Smart City</title><source>IEEE Electronic Library (IEL)</source><creator>Zhou, Yu ; Xie, Chuanshi ; Sun, Shilong ; Zhang, Xiao ; Wang, Yufan</creator><creatorcontrib>Zhou, Yu ; Xie, Chuanshi ; Sun, Shilong ; Zhang, Xiao ; Wang, Yufan</creatorcontrib><description>In smart cities, pervasive sensing and wearable computing techniques are increasingly being employed to monitor and recognize human activities through body sensor networks, which have been widely used in urban safety, healthcare, and manufacturing. However, most researchers regard human activity recognition (HAR) as a high-cost research task requiring a large amount of labeled data, which is often unrealistic in real-world applications. To address this problem, we propose a self-supervised learning framework for HAR (SS-HAR). SS-HAR initially takes the unlabeled data generated by data augmentation as the input of the network, mines the supervised information of the unlabeled data under the effect of self-supervised learning, and uses the obtained backbone network as a feature extractor to extract activity features for subsequent classification. After that, we use part of the labeled data as the training set and extract the activity features using the backbone network for training and fitting the classifier. Then we utilize the rest of the data to verify the feasibility and effectiveness of the proposed self-supervised learning method. We have conducted multiple experiments on three publicly available datasets and one self-collected basketball activity dataset SZU_HAD_Basketball. The experimental results show that the SS-HAR method is able to achieve higher classification accuracy and stability than supervised and semi-supervised methods. Specifically, on the UCI dataset, SS-HAR achieves better classification performance compared to other approaches which improve the classification accuracy by 1% over the supervised method and by 5%-6% over the semi-supervised method respectively.</description><identifier>ISSN: 1530-437X</identifier><identifier>EISSN: 1558-1748</identifier><identifier>DOI: 10.1109/JSEN.2023.3282601</identifier><identifier>CODEN: ISJEAZ</identifier><language>eng</language><publisher>New York: IEEE</publisher><subject>Body area networks ; Cities ; Classification ; Computer networks ; Data augmentation ; Data mining ; Datasets ; Deep learning ; Feature extraction ; Human activity recognition ; Limited labeled data ; Machine learning ; Self-supervised learning ; Sensors ; Smart cities ; Smart city ; Training ; Wearable sensors</subject><ispartof>IEEE sensors journal, 2024-03, Vol.24 (5), p.1-1</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2024</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c209t-c1b450aa0d5f54f9359038339b62bf268584550087d8972129fc4956aa193bc23</citedby><cites>FETCH-LOGICAL-c209t-c1b450aa0d5f54f9359038339b62bf268584550087d8972129fc4956aa193bc23</cites><orcidid>0000-0003-0460-4592 ; 0000-0001-6394-5181 ; 0000-0002-3224-0063</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/10147042$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,776,780,792,27901,27902,54733</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/10147042$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Zhou, Yu</creatorcontrib><creatorcontrib>Xie, Chuanshi</creatorcontrib><creatorcontrib>Sun, Shilong</creatorcontrib><creatorcontrib>Zhang, Xiao</creatorcontrib><creatorcontrib>Wang, Yufan</creatorcontrib><title>A Self-Supervised Human Activity Recognition Approach via Body Sensor Networks in Smart City</title><title>IEEE sensors journal</title><addtitle>JSEN</addtitle><description>In smart cities, pervasive sensing and wearable computing techniques are increasingly being employed to monitor and recognize human activities through body sensor networks, which have been widely used in urban safety, healthcare, and manufacturing. However, most researchers regard human activity recognition (HAR) as a high-cost research task requiring a large amount of labeled data, which is often unrealistic in real-world applications. To address this problem, we propose a self-supervised learning framework for HAR (SS-HAR). SS-HAR initially takes the unlabeled data generated by data augmentation as the input of the network, mines the supervised information of the unlabeled data under the effect of self-supervised learning, and uses the obtained backbone network as a feature extractor to extract activity features for subsequent classification. After that, we use part of the labeled data as the training set and extract the activity features using the backbone network for training and fitting the classifier. Then we utilize the rest of the data to verify the feasibility and effectiveness of the proposed self-supervised learning method. We have conducted multiple experiments on three publicly available datasets and one self-collected basketball activity dataset SZU_HAD_Basketball. The experimental results show that the SS-HAR method is able to achieve higher classification accuracy and stability than supervised and semi-supervised methods. Specifically, on the UCI dataset, SS-HAR achieves better classification performance compared to other approaches which improve the classification accuracy by 1% over the supervised method and by 5%-6% over the semi-supervised method respectively.</description><subject>Body area networks</subject><subject>Cities</subject><subject>Classification</subject><subject>Computer networks</subject><subject>Data augmentation</subject><subject>Data mining</subject><subject>Datasets</subject><subject>Deep learning</subject><subject>Feature extraction</subject><subject>Human activity recognition</subject><subject>Limited labeled data</subject><subject>Machine learning</subject><subject>Self-supervised learning</subject><subject>Sensors</subject><subject>Smart cities</subject><subject>Smart city</subject><subject>Training</subject><subject>Wearable sensors</subject><issn>1530-437X</issn><issn>1558-1748</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNpNkF1LwzAUhoMoOKc_QPAi4HVnPpvkcg51yphgFbwQQtqmmrm1NWkn-_embBdencPhfc45PABcYjTBGKmbp-xuOSGI0AklkqQIH4ER5lwmWDB5PPQUJYyK91NwFsIKIawEFyPwMYWZXVdJ1rfWb12wJZz3G1PDadG5ret28MUWzWftOtfEYdv6xhRfcOsMvG3KXYTr0Hi4tN1v478DdDXMNsZ3cBbZc3BSmXWwF4c6Bm_3d6-zebJ4fnicTRdJQZDqkgLnjCNjUMkrzipFuUJUUqrylOQVSSWXjHOEpCilEgQTVRVM8dQYrGheEDoG1_u98buf3oZOr5re1_GkJooSLlhKRUzhfarwTQjeVrr1Lv660xjpQaIeJOpBoj5IjMzVnnHW2n95zARihP4BXOJsTg</recordid><startdate>20240301</startdate><enddate>20240301</enddate><creator>Zhou, Yu</creator><creator>Xie, Chuanshi</creator><creator>Sun, Shilong</creator><creator>Zhang, Xiao</creator><creator>Wang, Yufan</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SP</scope><scope>7U5</scope><scope>8FD</scope><scope>L7M</scope><orcidid>https://orcid.org/0000-0003-0460-4592</orcidid><orcidid>https://orcid.org/0000-0001-6394-5181</orcidid><orcidid>https://orcid.org/0000-0002-3224-0063</orcidid></search><sort><creationdate>20240301</creationdate><title>A Self-Supervised Human Activity Recognition Approach via Body Sensor Networks in Smart City</title><author>Zhou, Yu ; Xie, Chuanshi ; Sun, Shilong ; Zhang, Xiao ; Wang, Yufan</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c209t-c1b450aa0d5f54f9359038339b62bf268584550087d8972129fc4956aa193bc23</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Body area networks</topic><topic>Cities</topic><topic>Classification</topic><topic>Computer networks</topic><topic>Data augmentation</topic><topic>Data mining</topic><topic>Datasets</topic><topic>Deep learning</topic><topic>Feature extraction</topic><topic>Human activity recognition</topic><topic>Limited labeled data</topic><topic>Machine learning</topic><topic>Self-supervised learning</topic><topic>Sensors</topic><topic>Smart cities</topic><topic>Smart city</topic><topic>Training</topic><topic>Wearable sensors</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Zhou, Yu</creatorcontrib><creatorcontrib>Xie, Chuanshi</creatorcontrib><creatorcontrib>Sun, Shilong</creatorcontrib><creatorcontrib>Zhang, Xiao</creatorcontrib><creatorcontrib>Wang, Yufan</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Electronics &amp; Communications Abstracts</collection><collection>Solid State and Superconductivity Abstracts</collection><collection>Technology Research Database</collection><collection>Advanced Technologies Database with Aerospace</collection><jtitle>IEEE sensors journal</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Zhou, Yu</au><au>Xie, Chuanshi</au><au>Sun, Shilong</au><au>Zhang, Xiao</au><au>Wang, Yufan</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>A Self-Supervised Human Activity Recognition Approach via Body Sensor Networks in Smart City</atitle><jtitle>IEEE sensors journal</jtitle><stitle>JSEN</stitle><date>2024-03-01</date><risdate>2024</risdate><volume>24</volume><issue>5</issue><spage>1</spage><epage>1</epage><pages>1-1</pages><issn>1530-437X</issn><eissn>1558-1748</eissn><coden>ISJEAZ</coden><abstract>In smart cities, pervasive sensing and wearable computing techniques are increasingly being employed to monitor and recognize human activities through body sensor networks, which have been widely used in urban safety, healthcare, and manufacturing. However, most researchers regard human activity recognition (HAR) as a high-cost research task requiring a large amount of labeled data, which is often unrealistic in real-world applications. To address this problem, we propose a self-supervised learning framework for HAR (SS-HAR). SS-HAR initially takes the unlabeled data generated by data augmentation as the input of the network, mines the supervised information of the unlabeled data under the effect of self-supervised learning, and uses the obtained backbone network as a feature extractor to extract activity features for subsequent classification. After that, we use part of the labeled data as the training set and extract the activity features using the backbone network for training and fitting the classifier. Then we utilize the rest of the data to verify the feasibility and effectiveness of the proposed self-supervised learning method. We have conducted multiple experiments on three publicly available datasets and one self-collected basketball activity dataset SZU_HAD_Basketball. The experimental results show that the SS-HAR method is able to achieve higher classification accuracy and stability than supervised and semi-supervised methods. Specifically, on the UCI dataset, SS-HAR achieves better classification performance compared to other approaches which improve the classification accuracy by 1% over the supervised method and by 5%-6% over the semi-supervised method respectively.</abstract><cop>New York</cop><pub>IEEE</pub><doi>10.1109/JSEN.2023.3282601</doi><tpages>1</tpages><orcidid>https://orcid.org/0000-0003-0460-4592</orcidid><orcidid>https://orcid.org/0000-0001-6394-5181</orcidid><orcidid>https://orcid.org/0000-0002-3224-0063</orcidid></addata></record>
fulltext fulltext_linktorsrc
identifier ISSN: 1530-437X
ispartof IEEE sensors journal, 2024-03, Vol.24 (5), p.1-1
issn 1530-437X
1558-1748
language eng
recordid cdi_ieee_primary_10147042
source IEEE Electronic Library (IEL)
subjects Body area networks
Cities
Classification
Computer networks
Data augmentation
Data mining
Datasets
Deep learning
Feature extraction
Human activity recognition
Limited labeled data
Machine learning
Self-supervised learning
Sensors
Smart cities
Smart city
Training
Wearable sensors
title A Self-Supervised Human Activity Recognition Approach via Body Sensor Networks in Smart City
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-13T16%3A19%3A39IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=A%20Self-Supervised%20Human%20Activity%20Recognition%20Approach%20via%20Body%20Sensor%20Networks%20in%20Smart%20City&rft.jtitle=IEEE%20sensors%20journal&rft.au=Zhou,%20Yu&rft.date=2024-03-01&rft.volume=24&rft.issue=5&rft.spage=1&rft.epage=1&rft.pages=1-1&rft.issn=1530-437X&rft.eissn=1558-1748&rft.coden=ISJEAZ&rft_id=info:doi/10.1109/JSEN.2023.3282601&rft_dat=%3Cproquest_RIE%3E2932574637%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2932574637&rft_id=info:pmid/&rft_ieee_id=10147042&rfr_iscdi=true