Human Daily Activity Recognition Performed Using Wearable Inertial Sensors Combined With Deep Learning Algorithms

This study proposed a wearable device capable of recognizing six human daily activities (walking, walking upstairs, walking downstairs, sitting, standing, and lying) through a deep learning algorithm. Existing wearable devices are mainly watches or wristbands, and almost none are to be worn on the w...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE access 2020, Vol.8, p.174105-174114
Hauptverfasser: Yen, Chih-Ta, Liao, Jia-Xian, Huang, Yi-Kai
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 174114
container_issue
container_start_page 174105
container_title IEEE access
container_volume 8
creator Yen, Chih-Ta
Liao, Jia-Xian
Huang, Yi-Kai
description This study proposed a wearable device capable of recognizing six human daily activities (walking, walking upstairs, walking downstairs, sitting, standing, and lying) through a deep learning algorithm. Existing wearable devices are mainly watches or wristbands, and almost none are to be worn on the waist. Wearable devices in the forms of watches and wristbands are unfriendly to patients who are critically ill, such as patients undergoing dialysis. Patients undergoing dialysis have artificial blood vessels on their arm, and they cannot perform intense exercise. For this type of users, general hand wearable devices cannot correctly identify wearers' activities. Therefore, we proposed a waist wearable device and these types of daily life activities to assess their exercise. The hardware of the wearable device consisted of an inertial sensor, which included a microcontroller, a three-axis accelerometer, and a three-axis gyroscope. The activity recognition algorithm of the software used motion signals acquisition, signal normalization, and a feature learning method. The feature learning method was based on a 1D convolutional neural network that automatically performed feature extraction and classification from raw data. One part of the experimental data was from the dataset of the University of California (UCI), and the other part was recorded by this study. To capture the data recorded, the wearable inertial sensing device was attached to the waists of 21 experimental participants who performed six common movements in a laboratorial environment, and the subsequent records were collected to verify the validity of the proposed deep learning algorithm in relation to the inertial sensor of the wearable device. For the six common activities in the UCI dataset and the data recorded, the recognition rates in the training sample reached 98.93% and 97.19%, respectively, and the recognition rates in the testing sample were 95.99% and 93.77%, respectively.
doi_str_mv 10.1109/ACCESS.2020.3025938
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_crossref_primary_10_1109_ACCESS_2020_3025938</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>9203887</ieee_id><doaj_id>oai_doaj_org_article_6f62b076ea7b4fa8b5d59a1296dc44d7</doaj_id><sourcerecordid>2454678765</sourcerecordid><originalsourceid>FETCH-LOGICAL-c408t-97b0b4cde2eaab8ea8aa722a9cd4305982090c5758f08bc824dc315837a469013</originalsourceid><addsrcrecordid>eNpNUV1r3DAQNKWFhiS_IC-CPN9V1oclPR5O2hwcJOQa8ijW8vqiw7Yukq9w_766OoTuyy7DzOzAFMVNSZdlSc2PVV3fb7dLRhldcsqk4fpLccHKyiy45NXX_-7vxXVKe5pHZ0iqi-L94TjASO7A9yeycpP_46cTeUYXdqOffBjJE8YuxAFb8pL8uCOvCBGaHsl6xDh56MkWxxRiInUYGj9m4quf3sgd4oFsMnk8q1b9LsQMD-mq-NZBn_D6Y18WLz_vf9cPi83jr3W92iycoHpaGNXQRrgWGQI0GkEDKMbAuFZwKo1m1FAnldQd1Y3TTLSOl1JzBaIytOSXxXr2bQPs7SH6AeLJBvD2HxDizkLO73q0VVexhqoKQTWiA93IVhoomalaJ0Srstft7HWI4f2IabL7cIxjjm-ZkKJSWlUys_jMcjGkFLH7_FpSe67KzlXZc1X2o6qsuplVHhE_FYZRrrXifwEL-o_8</addsrcrecordid><sourcetype>Open Website</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2454678765</pqid></control><display><type>article</type><title>Human Daily Activity Recognition Performed Using Wearable Inertial Sensors Combined With Deep Learning Algorithms</title><source>IEEE Open Access Journals</source><source>DOAJ Directory of Open Access Journals</source><source>Elektronische Zeitschriftenbibliothek - Frei zugängliche E-Journals</source><creator>Yen, Chih-Ta ; Liao, Jia-Xian ; Huang, Yi-Kai</creator><creatorcontrib>Yen, Chih-Ta ; Liao, Jia-Xian ; Huang, Yi-Kai</creatorcontrib><description>This study proposed a wearable device capable of recognizing six human daily activities (walking, walking upstairs, walking downstairs, sitting, standing, and lying) through a deep learning algorithm. Existing wearable devices are mainly watches or wristbands, and almost none are to be worn on the waist. Wearable devices in the forms of watches and wristbands are unfriendly to patients who are critically ill, such as patients undergoing dialysis. Patients undergoing dialysis have artificial blood vessels on their arm, and they cannot perform intense exercise. For this type of users, general hand wearable devices cannot correctly identify wearers' activities. Therefore, we proposed a waist wearable device and these types of daily life activities to assess their exercise. The hardware of the wearable device consisted of an inertial sensor, which included a microcontroller, a three-axis accelerometer, and a three-axis gyroscope. The activity recognition algorithm of the software used motion signals acquisition, signal normalization, and a feature learning method. The feature learning method was based on a 1D convolutional neural network that automatically performed feature extraction and classification from raw data. One part of the experimental data was from the dataset of the University of California (UCI), and the other part was recorded by this study. To capture the data recorded, the wearable inertial sensing device was attached to the waists of 21 experimental participants who performed six common movements in a laboratorial environment, and the subsequent records were collected to verify the validity of the proposed deep learning algorithm in relation to the inertial sensor of the wearable device. For the six common activities in the UCI dataset and the data recorded, the recognition rates in the training sample reached 98.93% and 97.19%, respectively, and the recognition rates in the testing sample were 95.99% and 93.77%, respectively.</description><identifier>ISSN: 2169-3536</identifier><identifier>EISSN: 2169-3536</identifier><identifier>DOI: 10.1109/ACCESS.2020.3025938</identifier><identifier>CODEN: IAECCG</identifier><language>eng</language><publisher>Piscataway: IEEE</publisher><subject>Accelerometers ; Activity recognition ; Algorithms ; Artificial neural networks ; Biomedical monitoring ; Blood vessels ; classifier ; convolutional neural network (CNN) ; Datasets ; Deep learning ; Dialysis ; Feature extraction ; human activity recognition (HAR) ; Human performance ; Inertial sensing devices ; inertial sensor ; Legged locomotion ; Machine learning ; Microcontrollers ; Teaching methods ; Three axis ; Walking ; Watches ; Wearable computers ; Wearable device ; Wearable sensors ; Wearable technology</subject><ispartof>IEEE access, 2020, Vol.8, p.174105-174114</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2020</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c408t-97b0b4cde2eaab8ea8aa722a9cd4305982090c5758f08bc824dc315837a469013</citedby><cites>FETCH-LOGICAL-c408t-97b0b4cde2eaab8ea8aa722a9cd4305982090c5758f08bc824dc315837a469013</cites><orcidid>0000-0003-0831-6774</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/9203887$$EHTML$$P50$$Gieee$$Hfree_for_read</linktohtml><link.rule.ids>314,780,784,864,2101,4023,27632,27922,27923,27924,54932</link.rule.ids></links><search><creatorcontrib>Yen, Chih-Ta</creatorcontrib><creatorcontrib>Liao, Jia-Xian</creatorcontrib><creatorcontrib>Huang, Yi-Kai</creatorcontrib><title>Human Daily Activity Recognition Performed Using Wearable Inertial Sensors Combined With Deep Learning Algorithms</title><title>IEEE access</title><addtitle>Access</addtitle><description>This study proposed a wearable device capable of recognizing six human daily activities (walking, walking upstairs, walking downstairs, sitting, standing, and lying) through a deep learning algorithm. Existing wearable devices are mainly watches or wristbands, and almost none are to be worn on the waist. Wearable devices in the forms of watches and wristbands are unfriendly to patients who are critically ill, such as patients undergoing dialysis. Patients undergoing dialysis have artificial blood vessels on their arm, and they cannot perform intense exercise. For this type of users, general hand wearable devices cannot correctly identify wearers' activities. Therefore, we proposed a waist wearable device and these types of daily life activities to assess their exercise. The hardware of the wearable device consisted of an inertial sensor, which included a microcontroller, a three-axis accelerometer, and a three-axis gyroscope. The activity recognition algorithm of the software used motion signals acquisition, signal normalization, and a feature learning method. The feature learning method was based on a 1D convolutional neural network that automatically performed feature extraction and classification from raw data. One part of the experimental data was from the dataset of the University of California (UCI), and the other part was recorded by this study. To capture the data recorded, the wearable inertial sensing device was attached to the waists of 21 experimental participants who performed six common movements in a laboratorial environment, and the subsequent records were collected to verify the validity of the proposed deep learning algorithm in relation to the inertial sensor of the wearable device. For the six common activities in the UCI dataset and the data recorded, the recognition rates in the training sample reached 98.93% and 97.19%, respectively, and the recognition rates in the testing sample were 95.99% and 93.77%, respectively.</description><subject>Accelerometers</subject><subject>Activity recognition</subject><subject>Algorithms</subject><subject>Artificial neural networks</subject><subject>Biomedical monitoring</subject><subject>Blood vessels</subject><subject>classifier</subject><subject>convolutional neural network (CNN)</subject><subject>Datasets</subject><subject>Deep learning</subject><subject>Dialysis</subject><subject>Feature extraction</subject><subject>human activity recognition (HAR)</subject><subject>Human performance</subject><subject>Inertial sensing devices</subject><subject>inertial sensor</subject><subject>Legged locomotion</subject><subject>Machine learning</subject><subject>Microcontrollers</subject><subject>Teaching methods</subject><subject>Three axis</subject><subject>Walking</subject><subject>Watches</subject><subject>Wearable computers</subject><subject>Wearable device</subject><subject>Wearable sensors</subject><subject>Wearable technology</subject><issn>2169-3536</issn><issn>2169-3536</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2020</creationdate><recordtype>article</recordtype><sourceid>ESBDL</sourceid><sourceid>RIE</sourceid><sourceid>DOA</sourceid><recordid>eNpNUV1r3DAQNKWFhiS_IC-CPN9V1oclPR5O2hwcJOQa8ijW8vqiw7Yukq9w_766OoTuyy7DzOzAFMVNSZdlSc2PVV3fb7dLRhldcsqk4fpLccHKyiy45NXX_-7vxXVKe5pHZ0iqi-L94TjASO7A9yeycpP_46cTeUYXdqOffBjJE8YuxAFb8pL8uCOvCBGaHsl6xDh56MkWxxRiInUYGj9m4quf3sgd4oFsMnk8q1b9LsQMD-mq-NZBn_D6Y18WLz_vf9cPi83jr3W92iycoHpaGNXQRrgWGQI0GkEDKMbAuFZwKo1m1FAnldQd1Y3TTLSOl1JzBaIytOSXxXr2bQPs7SH6AeLJBvD2HxDizkLO73q0VVexhqoKQTWiA93IVhoomalaJ0Srstft7HWI4f2IabL7cIxjjm-ZkKJSWlUys_jMcjGkFLH7_FpSe67KzlXZc1X2o6qsuplVHhE_FYZRrrXifwEL-o_8</recordid><startdate>2020</startdate><enddate>2020</enddate><creator>Yen, Chih-Ta</creator><creator>Liao, Jia-Xian</creator><creator>Huang, Yi-Kai</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>ESBDL</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7SP</scope><scope>7SR</scope><scope>8BQ</scope><scope>8FD</scope><scope>JG9</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>DOA</scope><orcidid>https://orcid.org/0000-0003-0831-6774</orcidid></search><sort><creationdate>2020</creationdate><title>Human Daily Activity Recognition Performed Using Wearable Inertial Sensors Combined With Deep Learning Algorithms</title><author>Yen, Chih-Ta ; Liao, Jia-Xian ; Huang, Yi-Kai</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c408t-97b0b4cde2eaab8ea8aa722a9cd4305982090c5758f08bc824dc315837a469013</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2020</creationdate><topic>Accelerometers</topic><topic>Activity recognition</topic><topic>Algorithms</topic><topic>Artificial neural networks</topic><topic>Biomedical monitoring</topic><topic>Blood vessels</topic><topic>classifier</topic><topic>convolutional neural network (CNN)</topic><topic>Datasets</topic><topic>Deep learning</topic><topic>Dialysis</topic><topic>Feature extraction</topic><topic>human activity recognition (HAR)</topic><topic>Human performance</topic><topic>Inertial sensing devices</topic><topic>inertial sensor</topic><topic>Legged locomotion</topic><topic>Machine learning</topic><topic>Microcontrollers</topic><topic>Teaching methods</topic><topic>Three axis</topic><topic>Walking</topic><topic>Watches</topic><topic>Wearable computers</topic><topic>Wearable device</topic><topic>Wearable sensors</topic><topic>Wearable technology</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Yen, Chih-Ta</creatorcontrib><creatorcontrib>Liao, Jia-Xian</creatorcontrib><creatorcontrib>Huang, Yi-Kai</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE Open Access Journals</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics &amp; Communications Abstracts</collection><collection>Engineered Materials Abstracts</collection><collection>METADEX</collection><collection>Technology Research Database</collection><collection>Materials Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>DOAJ Directory of Open Access Journals</collection><jtitle>IEEE access</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Yen, Chih-Ta</au><au>Liao, Jia-Xian</au><au>Huang, Yi-Kai</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Human Daily Activity Recognition Performed Using Wearable Inertial Sensors Combined With Deep Learning Algorithms</atitle><jtitle>IEEE access</jtitle><stitle>Access</stitle><date>2020</date><risdate>2020</risdate><volume>8</volume><spage>174105</spage><epage>174114</epage><pages>174105-174114</pages><issn>2169-3536</issn><eissn>2169-3536</eissn><coden>IAECCG</coden><abstract>This study proposed a wearable device capable of recognizing six human daily activities (walking, walking upstairs, walking downstairs, sitting, standing, and lying) through a deep learning algorithm. Existing wearable devices are mainly watches or wristbands, and almost none are to be worn on the waist. Wearable devices in the forms of watches and wristbands are unfriendly to patients who are critically ill, such as patients undergoing dialysis. Patients undergoing dialysis have artificial blood vessels on their arm, and they cannot perform intense exercise. For this type of users, general hand wearable devices cannot correctly identify wearers' activities. Therefore, we proposed a waist wearable device and these types of daily life activities to assess their exercise. The hardware of the wearable device consisted of an inertial sensor, which included a microcontroller, a three-axis accelerometer, and a three-axis gyroscope. The activity recognition algorithm of the software used motion signals acquisition, signal normalization, and a feature learning method. The feature learning method was based on a 1D convolutional neural network that automatically performed feature extraction and classification from raw data. One part of the experimental data was from the dataset of the University of California (UCI), and the other part was recorded by this study. To capture the data recorded, the wearable inertial sensing device was attached to the waists of 21 experimental participants who performed six common movements in a laboratorial environment, and the subsequent records were collected to verify the validity of the proposed deep learning algorithm in relation to the inertial sensor of the wearable device. For the six common activities in the UCI dataset and the data recorded, the recognition rates in the training sample reached 98.93% and 97.19%, respectively, and the recognition rates in the testing sample were 95.99% and 93.77%, respectively.</abstract><cop>Piscataway</cop><pub>IEEE</pub><doi>10.1109/ACCESS.2020.3025938</doi><tpages>10</tpages><orcidid>https://orcid.org/0000-0003-0831-6774</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 2169-3536
ispartof IEEE access, 2020, Vol.8, p.174105-174114
issn 2169-3536
2169-3536
language eng
recordid cdi_crossref_primary_10_1109_ACCESS_2020_3025938
source IEEE Open Access Journals; DOAJ Directory of Open Access Journals; Elektronische Zeitschriftenbibliothek - Frei zugängliche E-Journals
subjects Accelerometers
Activity recognition
Algorithms
Artificial neural networks
Biomedical monitoring
Blood vessels
classifier
convolutional neural network (CNN)
Datasets
Deep learning
Dialysis
Feature extraction
human activity recognition (HAR)
Human performance
Inertial sensing devices
inertial sensor
Legged locomotion
Machine learning
Microcontrollers
Teaching methods
Three axis
Walking
Watches
Wearable computers
Wearable device
Wearable sensors
Wearable technology
title Human Daily Activity Recognition Performed Using Wearable Inertial Sensors Combined With Deep Learning Algorithms
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-08T18%3A11%3A35IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Human%20Daily%20Activity%20Recognition%20Performed%20Using%20Wearable%20Inertial%20Sensors%20Combined%20With%20Deep%20Learning%20Algorithms&rft.jtitle=IEEE%20access&rft.au=Yen,%20Chih-Ta&rft.date=2020&rft.volume=8&rft.spage=174105&rft.epage=174114&rft.pages=174105-174114&rft.issn=2169-3536&rft.eissn=2169-3536&rft.coden=IAECCG&rft_id=info:doi/10.1109/ACCESS.2020.3025938&rft_dat=%3Cproquest_cross%3E2454678765%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2454678765&rft_id=info:pmid/&rft_ieee_id=9203887&rft_doaj_id=oai_doaj_org_article_6f62b076ea7b4fa8b5d59a1296dc44d7&rfr_iscdi=true