Temporal Multi-features Representation Learning-Based Clustering for Time-Series Data

Time-series clustering remains a challenge in data mining. Although novel deep-learning-based representation learning integrated with deep clustering methods have considerably enhanced the performance of time-series clustering, efficiently capturing the various temporal patterns inherent in the data...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE access 2024-01, Vol.12, p.1-1
Hauptverfasser: Lee, Jaehoon, Kim, Dohee, Sim, Sunghyun
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 1
container_issue
container_start_page 1
container_title IEEE access
container_volume 12
creator Lee, Jaehoon
Kim, Dohee
Sim, Sunghyun
description Time-series clustering remains a challenge in data mining. Although novel deep-learning-based representation learning integrated with deep clustering methods have considerably enhanced the performance of time-series clustering, efficiently capturing the various temporal patterns inherent in the data is difficult in representation learning for time-series data. In this study, we proposed a novel representation learning method called temporal multi-features representation learning (TMRL) to capture various temporal patterns embedded in time-series data. Based on TMRL, we introduce the temporal multi-features representation clustering (TMRC) framework for performing time-series clustering. The proposed framework decomposes the input time-series data into k temporal patterns and uses k LSTM autoencoders to extract specialized features for each decomposed diverse temporal pattern through TMRL. Variational-mode decomposition is used to extract temporal multi-features. Finally, temporal multi-features derived from TMRL are ensembled for time-series clustering. To evaluate the superiority of the proposed method, comparative experiments were conducted with 36 publicly available time-series datasets against 16 baseline models. In the comparative experiments, we achieved the highest RI and normalized mutual information values in 12 time-series datasets. Particularly, on datasets consisting of eight types of activities and spectral types, the proposed method attained the highest RI and NMI values in six datasets. Furthermore, visualization results of the learned features through TMRL demonstrated superior representation learning compared with existing methods. These results indicated that the proposed TMRC framework is highly suitable for the learning representations of time-series data and can be effectively used for time-series clustering.
doi_str_mv 10.1109/ACCESS.2024.3417348
format Article
fullrecord <record><control><sourceid>proquest_doaj_</sourceid><recordid>TN_cdi_proquest_journals_3073299150</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>10565866</ieee_id><doaj_id>oai_doaj_org_article_daad5f77e76546e48f4f35f082e927c9</doaj_id><sourcerecordid>3073299150</sourcerecordid><originalsourceid>FETCH-LOGICAL-c289t-cdf3bddd2b708fc9bfb1b8ac05f58bb61b910e57582b1552a7fbc136a87c8fd63</originalsourceid><addsrcrecordid>eNpNUctqHDEQHEICMba_IDkM5DwbPUavozOxHcOaQHZ9Fnq0zCyzo42kOeTvLWeM2b5Ud9FV3VBN8wWjDcZIfb8ZhtvdbkMQ6Te0x4L28kNzQTBXHWWUfzzrPzfXOR9QLVkpJi6apz0cTzGZqX1cpjJ2AUxZEuT2D5wqwFxMGePcbsGkeZyfux8mg2-HackFUiXaEFO7H4_Q7epchT9NMVfNp2CmDNdveNk83d3uh1_d9vf9w3Cz7RyRqnTOB2q998QKJINTNlhspXGIBSat5dgqjIAJJonFjBEjgnWYciOFk8Fzetk8rL4-moM-pfFo0j8dzaj_EzE9a5PK6CbQ3hjPghAgOOs59DL0gbKAJAFFhFPV69vqdUrx7wK56ENc0lzf1xQJSpTCDNUtum65FHNOEN6vYqRf49BrHPo1Dv0WR1V9XVUjAJwpGGeSc_oCcbyHSg</addsrcrecordid><sourcetype>Open Website</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>3073299150</pqid></control><display><type>article</type><title>Temporal Multi-features Representation Learning-Based Clustering for Time-Series Data</title><source>IEEE Open Access Journals</source><source>DOAJ Directory of Open Access Journals</source><source>EZB-FREE-00999 freely available EZB journals</source><creator>Lee, Jaehoon ; Kim, Dohee ; Sim, Sunghyun</creator><creatorcontrib>Lee, Jaehoon ; Kim, Dohee ; Sim, Sunghyun</creatorcontrib><description>Time-series clustering remains a challenge in data mining. Although novel deep-learning-based representation learning integrated with deep clustering methods have considerably enhanced the performance of time-series clustering, efficiently capturing the various temporal patterns inherent in the data is difficult in representation learning for time-series data. In this study, we proposed a novel representation learning method called temporal multi-features representation learning (TMRL) to capture various temporal patterns embedded in time-series data. Based on TMRL, we introduce the temporal multi-features representation clustering (TMRC) framework for performing time-series clustering. The proposed framework decomposes the input time-series data into k temporal patterns and uses k LSTM autoencoders to extract specialized features for each decomposed diverse temporal pattern through TMRL. Variational-mode decomposition is used to extract temporal multi-features. Finally, temporal multi-features derived from TMRL are ensembled for time-series clustering. To evaluate the superiority of the proposed method, comparative experiments were conducted with 36 publicly available time-series datasets against 16 baseline models. In the comparative experiments, we achieved the highest RI and normalized mutual information values in 12 time-series datasets. Particularly, on datasets consisting of eight types of activities and spectral types, the proposed method attained the highest RI and NMI values in six datasets. Furthermore, visualization results of the learned features through TMRL demonstrated superior representation learning compared with existing methods. These results indicated that the proposed TMRC framework is highly suitable for the learning representations of time-series data and can be effectively used for time-series clustering.</description><identifier>ISSN: 2169-3536</identifier><identifier>EISSN: 2169-3536</identifier><identifier>DOI: 10.1109/ACCESS.2024.3417348</identifier><identifier>CODEN: IAECCG</identifier><language>eng</language><publisher>Piscataway: IEEE</publisher><subject>Clustering ; Clustering algorithms ; Clustering methods ; Data mining ; Datasets ; Decomposition ; Deep learning ; Distortion measurement ; Feature extraction ; Representation learning ; Representations ; Temporal Multi-features Representation (TMRC) ; Temporal Multi-features Representation Learning (TMRL) ; Time series ; Time series analysis ; Time-series Clustering ; Variational Mode Decomposition (VMD)</subject><ispartof>IEEE access, 2024-01, Vol.12, p.1-1</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2024</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-c289t-cdf3bddd2b708fc9bfb1b8ac05f58bb61b910e57582b1552a7fbc136a87c8fd63</cites><orcidid>0000-0002-3410-8744 ; 0000-0002-8153-1422 ; 0009-0002-2445-8545</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/10565866$$EHTML$$P50$$Gieee$$Hfree_for_read</linktohtml><link.rule.ids>314,780,784,864,2102,27633,27924,27925,54933</link.rule.ids></links><search><creatorcontrib>Lee, Jaehoon</creatorcontrib><creatorcontrib>Kim, Dohee</creatorcontrib><creatorcontrib>Sim, Sunghyun</creatorcontrib><title>Temporal Multi-features Representation Learning-Based Clustering for Time-Series Data</title><title>IEEE access</title><addtitle>Access</addtitle><description>Time-series clustering remains a challenge in data mining. Although novel deep-learning-based representation learning integrated with deep clustering methods have considerably enhanced the performance of time-series clustering, efficiently capturing the various temporal patterns inherent in the data is difficult in representation learning for time-series data. In this study, we proposed a novel representation learning method called temporal multi-features representation learning (TMRL) to capture various temporal patterns embedded in time-series data. Based on TMRL, we introduce the temporal multi-features representation clustering (TMRC) framework for performing time-series clustering. The proposed framework decomposes the input time-series data into k temporal patterns and uses k LSTM autoencoders to extract specialized features for each decomposed diverse temporal pattern through TMRL. Variational-mode decomposition is used to extract temporal multi-features. Finally, temporal multi-features derived from TMRL are ensembled for time-series clustering. To evaluate the superiority of the proposed method, comparative experiments were conducted with 36 publicly available time-series datasets against 16 baseline models. In the comparative experiments, we achieved the highest RI and normalized mutual information values in 12 time-series datasets. Particularly, on datasets consisting of eight types of activities and spectral types, the proposed method attained the highest RI and NMI values in six datasets. Furthermore, visualization results of the learned features through TMRL demonstrated superior representation learning compared with existing methods. These results indicated that the proposed TMRC framework is highly suitable for the learning representations of time-series data and can be effectively used for time-series clustering.</description><subject>Clustering</subject><subject>Clustering algorithms</subject><subject>Clustering methods</subject><subject>Data mining</subject><subject>Datasets</subject><subject>Decomposition</subject><subject>Deep learning</subject><subject>Distortion measurement</subject><subject>Feature extraction</subject><subject>Representation learning</subject><subject>Representations</subject><subject>Temporal Multi-features Representation (TMRC)</subject><subject>Temporal Multi-features Representation Learning (TMRL)</subject><subject>Time series</subject><subject>Time series analysis</subject><subject>Time-series Clustering</subject><subject>Variational Mode Decomposition (VMD)</subject><issn>2169-3536</issn><issn>2169-3536</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><sourceid>ESBDL</sourceid><sourceid>RIE</sourceid><sourceid>DOA</sourceid><recordid>eNpNUctqHDEQHEICMba_IDkM5DwbPUavozOxHcOaQHZ9Fnq0zCyzo42kOeTvLWeM2b5Ud9FV3VBN8wWjDcZIfb8ZhtvdbkMQ6Te0x4L28kNzQTBXHWWUfzzrPzfXOR9QLVkpJi6apz0cTzGZqX1cpjJ2AUxZEuT2D5wqwFxMGePcbsGkeZyfux8mg2-HackFUiXaEFO7H4_Q7epchT9NMVfNp2CmDNdveNk83d3uh1_d9vf9w3Cz7RyRqnTOB2q998QKJINTNlhspXGIBSat5dgqjIAJJonFjBEjgnWYciOFk8Fzetk8rL4-moM-pfFo0j8dzaj_EzE9a5PK6CbQ3hjPghAgOOs59DL0gbKAJAFFhFPV69vqdUrx7wK56ENc0lzf1xQJSpTCDNUtum65FHNOEN6vYqRf49BrHPo1Dv0WR1V9XVUjAJwpGGeSc_oCcbyHSg</recordid><startdate>20240101</startdate><enddate>20240101</enddate><creator>Lee, Jaehoon</creator><creator>Kim, Dohee</creator><creator>Sim, Sunghyun</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>ESBDL</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7SP</scope><scope>7SR</scope><scope>8BQ</scope><scope>8FD</scope><scope>JG9</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>DOA</scope><orcidid>https://orcid.org/0000-0002-3410-8744</orcidid><orcidid>https://orcid.org/0000-0002-8153-1422</orcidid><orcidid>https://orcid.org/0009-0002-2445-8545</orcidid></search><sort><creationdate>20240101</creationdate><title>Temporal Multi-features Representation Learning-Based Clustering for Time-Series Data</title><author>Lee, Jaehoon ; Kim, Dohee ; Sim, Sunghyun</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c289t-cdf3bddd2b708fc9bfb1b8ac05f58bb61b910e57582b1552a7fbc136a87c8fd63</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Clustering</topic><topic>Clustering algorithms</topic><topic>Clustering methods</topic><topic>Data mining</topic><topic>Datasets</topic><topic>Decomposition</topic><topic>Deep learning</topic><topic>Distortion measurement</topic><topic>Feature extraction</topic><topic>Representation learning</topic><topic>Representations</topic><topic>Temporal Multi-features Representation (TMRC)</topic><topic>Temporal Multi-features Representation Learning (TMRL)</topic><topic>Time series</topic><topic>Time series analysis</topic><topic>Time-series Clustering</topic><topic>Variational Mode Decomposition (VMD)</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Lee, Jaehoon</creatorcontrib><creatorcontrib>Kim, Dohee</creatorcontrib><creatorcontrib>Sim, Sunghyun</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE Open Access Journals</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics &amp; Communications Abstracts</collection><collection>Engineered Materials Abstracts</collection><collection>METADEX</collection><collection>Technology Research Database</collection><collection>Materials Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>DOAJ Directory of Open Access Journals</collection><jtitle>IEEE access</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Lee, Jaehoon</au><au>Kim, Dohee</au><au>Sim, Sunghyun</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Temporal Multi-features Representation Learning-Based Clustering for Time-Series Data</atitle><jtitle>IEEE access</jtitle><stitle>Access</stitle><date>2024-01-01</date><risdate>2024</risdate><volume>12</volume><spage>1</spage><epage>1</epage><pages>1-1</pages><issn>2169-3536</issn><eissn>2169-3536</eissn><coden>IAECCG</coden><abstract>Time-series clustering remains a challenge in data mining. Although novel deep-learning-based representation learning integrated with deep clustering methods have considerably enhanced the performance of time-series clustering, efficiently capturing the various temporal patterns inherent in the data is difficult in representation learning for time-series data. In this study, we proposed a novel representation learning method called temporal multi-features representation learning (TMRL) to capture various temporal patterns embedded in time-series data. Based on TMRL, we introduce the temporal multi-features representation clustering (TMRC) framework for performing time-series clustering. The proposed framework decomposes the input time-series data into k temporal patterns and uses k LSTM autoencoders to extract specialized features for each decomposed diverse temporal pattern through TMRL. Variational-mode decomposition is used to extract temporal multi-features. Finally, temporal multi-features derived from TMRL are ensembled for time-series clustering. To evaluate the superiority of the proposed method, comparative experiments were conducted with 36 publicly available time-series datasets against 16 baseline models. In the comparative experiments, we achieved the highest RI and normalized mutual information values in 12 time-series datasets. Particularly, on datasets consisting of eight types of activities and spectral types, the proposed method attained the highest RI and NMI values in six datasets. Furthermore, visualization results of the learned features through TMRL demonstrated superior representation learning compared with existing methods. These results indicated that the proposed TMRC framework is highly suitable for the learning representations of time-series data and can be effectively used for time-series clustering.</abstract><cop>Piscataway</cop><pub>IEEE</pub><doi>10.1109/ACCESS.2024.3417348</doi><tpages>1</tpages><orcidid>https://orcid.org/0000-0002-3410-8744</orcidid><orcidid>https://orcid.org/0000-0002-8153-1422</orcidid><orcidid>https://orcid.org/0009-0002-2445-8545</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 2169-3536
ispartof IEEE access, 2024-01, Vol.12, p.1-1
issn 2169-3536
2169-3536
language eng
recordid cdi_proquest_journals_3073299150
source IEEE Open Access Journals; DOAJ Directory of Open Access Journals; EZB-FREE-00999 freely available EZB journals
subjects Clustering
Clustering algorithms
Clustering methods
Data mining
Datasets
Decomposition
Deep learning
Distortion measurement
Feature extraction
Representation learning
Representations
Temporal Multi-features Representation (TMRC)
Temporal Multi-features Representation Learning (TMRL)
Time series
Time series analysis
Time-series Clustering
Variational Mode Decomposition (VMD)
title Temporal Multi-features Representation Learning-Based Clustering for Time-Series Data
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-04T17%3A36%3A04IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_doaj_&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Temporal%20Multi-features%20Representation%20Learning-Based%20Clustering%20for%20Time-Series%20Data&rft.jtitle=IEEE%20access&rft.au=Lee,%20Jaehoon&rft.date=2024-01-01&rft.volume=12&rft.spage=1&rft.epage=1&rft.pages=1-1&rft.issn=2169-3536&rft.eissn=2169-3536&rft.coden=IAECCG&rft_id=info:doi/10.1109/ACCESS.2024.3417348&rft_dat=%3Cproquest_doaj_%3E3073299150%3C/proquest_doaj_%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=3073299150&rft_id=info:pmid/&rft_ieee_id=10565866&rft_doaj_id=oai_doaj_org_article_daad5f77e76546e48f4f35f082e927c9&rfr_iscdi=true