Unsupervised deep learning and analysis of harmonic variation patterns using big data from multiple locations
•A novel framework employing unsupervised deep learning and clustering for harmonic voltage variations.•Identification of common underlying patterns from harmonic voltage data at multiple locations.•Criterion for training a deep learning algorithm from data at one location, that is effective for fea...
Gespeichert in:
Veröffentlicht in: | Electric power systems research 2021-05, Vol.194, p.107042, Article 107042 |
---|---|
Hauptverfasser: | , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | |
---|---|
container_issue | |
container_start_page | 107042 |
container_title | Electric power systems research |
container_volume | 194 |
creator | Ge, Chenjie Oliveira, Roger A.D. Gu, Irene Y.H. Bollen, Math H.J. |
description | •A novel framework employing unsupervised deep learning and clustering for harmonic voltage variations.•Identification of common underlying patterns from harmonic voltage data at multiple locations.•Criterion for training a deep learning algorithm from data at one location, that is effective for feature extraction of data at all locations.•Empirical analysis approaches for obtaining pattern distribution maps, typical waveform sequences of different classes, and 2D feature maps by nonlinear embedding of high-dimensional feature vectors.•Results demonstrate practical applicability of the method for large harmonic voltage data analytics.•The method can be applied as the basis for a range of power-quality phenomena, like RMS voltage, frequency, unbalance, rapid voltage changes, and harmonic currents.
This paper addresses the issue of automatically seeking and identifying daily, weekly and seasonal patterns in harmonic voltage from measurement data at multiple locations. We propose a novel framework that employs deep autoencoder (DAE) followed by k-mean clustering. The DAE is used for extracting principal features from time series of harmonic voltages. A new strategy is used for training the encoder in DAE from data at one selected location that is effective for subsequent feature extraction from data at multiple locations. To analyze the patterns, several empirical analysis approaches are applied on the clustered principal features, including the distribution of daily patterns over the week and the year, representative waveform sequences of individual classes, and feature maps for visualizing high-dimensional feature space through low-dimensional embedding. The proposed scheme has been tested on a dataset containing harmonic measurements at 10 low-voltage locations in Sweden for the whole year of 2017. Results show distinct principal patterns for most harmonics that can be related to the use of equipment causing harmonic distortion. This information can assist network operators in finding the origin of harmonic distortion and deciding about mitigation actions. The proposed scheme is the first to provide a useful analysis tool and insight for finding and analyzing underlying patterns from harmonic variation data at multiple locations.
[Display omitted] |
doi_str_mv | 10.1016/j.epsr.2021.107042 |
format | Article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2551714587</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S0378779621000225</els_id><sourcerecordid>2551714587</sourcerecordid><originalsourceid>FETCH-LOGICAL-c485t-d1f3514c3d3a7ec69a2be001101bd2fd93ecd00f5bb9eb89210f6e3c434385873</originalsourceid><addsrcrecordid>eNqNkV2L1DAUhosoOK7-Aa8CXuqM-WiaFrxZRt0VFrzQ9faQJiczGdqmJuks--9tt8veKV6EQHifl5zzFMVbRneMsurjaYdjijtOOZsfFC35s2LDaiW2nJbV82JDhaq3SjXVy-JVSidKadUouSn62yFNI8azT2iJRRxJhzoOfjgQPdj56O4--USCI0cd-zB4Q846ep19GMioc8Y4JDKlhWj9gVidNXEx9KSfuuzHDkkXzEM8vS5eON0lfPN4XxS3X7_83F9vb75ffdtf3mxNWcu8tcwJyUojrNAKTdVo3iKlbB61tdzZRqCxlDrZtg22dcMZdRUKU4pS1HKe-qL4sfamOxynFsboex3vIWgPEdM8oDmCOequx5ggIZhaGjSuAqVQQSk5BV2VAmQjGiqtkxzZ3Prhr62f_a9LCPEAXZ6g5oot8XdrfIzh94QpwylMcd5nAi4lU6xcv8rXlIkhpYjuqZZRWNzCCRa3sLiF1e0MvV-hO2yDS8bjYPAJXOQKLuqK0WVpc7r-__Te5wdX-zANeUY_rSjOts4eIzzi1kc0GWzw__rnH4uqz_Q</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2551714587</pqid></control><display><type>article</type><title>Unsupervised deep learning and analysis of harmonic variation patterns using big data from multiple locations</title><source>SWEPUB Freely available online</source><source>Web of Science - Science Citation Index Expanded - 2021<img src="https://exlibris-pub.s3.amazonaws.com/fromwos-v2.jpg" /></source><source>Access via ScienceDirect (Elsevier)</source><creator>Ge, Chenjie ; Oliveira, Roger A.D. ; Gu, Irene Y.H. ; Bollen, Math H.J.</creator><creatorcontrib>Ge, Chenjie ; Oliveira, Roger A.D. ; Gu, Irene Y.H. ; Bollen, Math H.J.</creatorcontrib><description>•A novel framework employing unsupervised deep learning and clustering for harmonic voltage variations.•Identification of common underlying patterns from harmonic voltage data at multiple locations.•Criterion for training a deep learning algorithm from data at one location, that is effective for feature extraction of data at all locations.•Empirical analysis approaches for obtaining pattern distribution maps, typical waveform sequences of different classes, and 2D feature maps by nonlinear embedding of high-dimensional feature vectors.•Results demonstrate practical applicability of the method for large harmonic voltage data analytics.•The method can be applied as the basis for a range of power-quality phenomena, like RMS voltage, frequency, unbalance, rapid voltage changes, and harmonic currents.
This paper addresses the issue of automatically seeking and identifying daily, weekly and seasonal patterns in harmonic voltage from measurement data at multiple locations. We propose a novel framework that employs deep autoencoder (DAE) followed by k-mean clustering. The DAE is used for extracting principal features from time series of harmonic voltages. A new strategy is used for training the encoder in DAE from data at one selected location that is effective for subsequent feature extraction from data at multiple locations. To analyze the patterns, several empirical analysis approaches are applied on the clustered principal features, including the distribution of daily patterns over the week and the year, representative waveform sequences of individual classes, and feature maps for visualizing high-dimensional feature space through low-dimensional embedding. The proposed scheme has been tested on a dataset containing harmonic measurements at 10 low-voltage locations in Sweden for the whole year of 2017. Results show distinct principal patterns for most harmonics that can be related to the use of equipment causing harmonic distortion. This information can assist network operators in finding the origin of harmonic distortion and deciding about mitigation actions. The proposed scheme is the first to provide a useful analysis tool and insight for finding and analyzing underlying patterns from harmonic variation data at multiple locations.
[Display omitted]</description><identifier>ISSN: 0378-7796</identifier><identifier>ISSN: 1873-2046</identifier><identifier>EISSN: 1873-2046</identifier><identifier>DOI: 10.1016/j.epsr.2021.107042</identifier><language>eng</language><publisher>LAUSANNE: Elsevier B.V</publisher><subject>Autoencoder ; Big Data ; Big data analytics ; Clustering ; Coders ; Electric potential ; Electric Power distribution ; Electric Power Engineering ; Elkraftteknik ; Empirical analysis ; Engineering ; Engineering, Electrical & Electronic ; Feature extraction ; Feature maps ; Harmonic analysis ; Harmonic distortion ; Kim, Daniel Dae ; Machine learning ; Pattern analysis ; Power quality ; Power system harmonics ; Science & Technology ; Sequences ; Technology ; Unsupervised deep learning ; Variation data ; Voltage ; Waveform analysis ; Waveforms</subject><ispartof>Electric power systems research, 2021-05, Vol.194, p.107042, Article 107042</ispartof><rights>2021 The Authors</rights><rights>Copyright Elsevier Science Ltd. May 2021</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>true</woscitedreferencessubscribed><woscitedreferencescount>11</woscitedreferencescount><woscitedreferencesoriginalsourcerecordid>wos000632386100011</woscitedreferencesoriginalsourcerecordid><citedby>FETCH-LOGICAL-c485t-d1f3514c3d3a7ec69a2be001101bd2fd93ecd00f5bb9eb89210f6e3c434385873</citedby><cites>FETCH-LOGICAL-c485t-d1f3514c3d3a7ec69a2be001101bd2fd93ecd00f5bb9eb89210f6e3c434385873</cites><orcidid>0000-0003-4759-7038</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://dx.doi.org/10.1016/j.epsr.2021.107042$$EHTML$$P50$$Gelsevier$$Hfree_for_read</linktohtml><link.rule.ids>230,315,554,782,786,887,3552,27931,27932,39265,46002</link.rule.ids><backlink>$$Uhttps://urn.kb.se/resolve?urn=urn:nbn:se:ltu:diva-82711$$DView record from Swedish Publication Index$$Hfree_for_read</backlink><backlink>$$Uhttps://research.chalmers.se/publication/522222$$DView record from Swedish Publication Index$$Hfree_for_read</backlink></links><search><creatorcontrib>Ge, Chenjie</creatorcontrib><creatorcontrib>Oliveira, Roger A.D.</creatorcontrib><creatorcontrib>Gu, Irene Y.H.</creatorcontrib><creatorcontrib>Bollen, Math H.J.</creatorcontrib><title>Unsupervised deep learning and analysis of harmonic variation patterns using big data from multiple locations</title><title>Electric power systems research</title><addtitle>ELECTR POW SYST RES</addtitle><description>•A novel framework employing unsupervised deep learning and clustering for harmonic voltage variations.•Identification of common underlying patterns from harmonic voltage data at multiple locations.•Criterion for training a deep learning algorithm from data at one location, that is effective for feature extraction of data at all locations.•Empirical analysis approaches for obtaining pattern distribution maps, typical waveform sequences of different classes, and 2D feature maps by nonlinear embedding of high-dimensional feature vectors.•Results demonstrate practical applicability of the method for large harmonic voltage data analytics.•The method can be applied as the basis for a range of power-quality phenomena, like RMS voltage, frequency, unbalance, rapid voltage changes, and harmonic currents.
This paper addresses the issue of automatically seeking and identifying daily, weekly and seasonal patterns in harmonic voltage from measurement data at multiple locations. We propose a novel framework that employs deep autoencoder (DAE) followed by k-mean clustering. The DAE is used for extracting principal features from time series of harmonic voltages. A new strategy is used for training the encoder in DAE from data at one selected location that is effective for subsequent feature extraction from data at multiple locations. To analyze the patterns, several empirical analysis approaches are applied on the clustered principal features, including the distribution of daily patterns over the week and the year, representative waveform sequences of individual classes, and feature maps for visualizing high-dimensional feature space through low-dimensional embedding. The proposed scheme has been tested on a dataset containing harmonic measurements at 10 low-voltage locations in Sweden for the whole year of 2017. Results show distinct principal patterns for most harmonics that can be related to the use of equipment causing harmonic distortion. This information can assist network operators in finding the origin of harmonic distortion and deciding about mitigation actions. The proposed scheme is the first to provide a useful analysis tool and insight for finding and analyzing underlying patterns from harmonic variation data at multiple locations.
[Display omitted]</description><subject>Autoencoder</subject><subject>Big Data</subject><subject>Big data analytics</subject><subject>Clustering</subject><subject>Coders</subject><subject>Electric potential</subject><subject>Electric Power distribution</subject><subject>Electric Power Engineering</subject><subject>Elkraftteknik</subject><subject>Empirical analysis</subject><subject>Engineering</subject><subject>Engineering, Electrical & Electronic</subject><subject>Feature extraction</subject><subject>Feature maps</subject><subject>Harmonic analysis</subject><subject>Harmonic distortion</subject><subject>Kim, Daniel Dae</subject><subject>Machine learning</subject><subject>Pattern analysis</subject><subject>Power quality</subject><subject>Power system harmonics</subject><subject>Science & Technology</subject><subject>Sequences</subject><subject>Technology</subject><subject>Unsupervised deep learning</subject><subject>Variation data</subject><subject>Voltage</subject><subject>Waveform analysis</subject><subject>Waveforms</subject><issn>0378-7796</issn><issn>1873-2046</issn><issn>1873-2046</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2021</creationdate><recordtype>article</recordtype><sourceid>HGBXW</sourceid><sourceid>D8T</sourceid><recordid>eNqNkV2L1DAUhosoOK7-Aa8CXuqM-WiaFrxZRt0VFrzQ9faQJiczGdqmJuks--9tt8veKV6EQHifl5zzFMVbRneMsurjaYdjijtOOZsfFC35s2LDaiW2nJbV82JDhaq3SjXVy-JVSidKadUouSn62yFNI8azT2iJRRxJhzoOfjgQPdj56O4--USCI0cd-zB4Q846ep19GMioc8Y4JDKlhWj9gVidNXEx9KSfuuzHDkkXzEM8vS5eON0lfPN4XxS3X7_83F9vb75ffdtf3mxNWcu8tcwJyUojrNAKTdVo3iKlbB61tdzZRqCxlDrZtg22dcMZdRUKU4pS1HKe-qL4sfamOxynFsboex3vIWgPEdM8oDmCOequx5ggIZhaGjSuAqVQQSk5BV2VAmQjGiqtkxzZ3Prhr62f_a9LCPEAXZ6g5oot8XdrfIzh94QpwylMcd5nAi4lU6xcv8rXlIkhpYjuqZZRWNzCCRa3sLiF1e0MvV-hO2yDS8bjYPAJXOQKLuqK0WVpc7r-__Te5wdX-zANeUY_rSjOts4eIzzi1kc0GWzw__rnH4uqz_Q</recordid><startdate>20210501</startdate><enddate>20210501</enddate><creator>Ge, Chenjie</creator><creator>Oliveira, Roger A.D.</creator><creator>Gu, Irene Y.H.</creator><creator>Bollen, Math H.J.</creator><general>Elsevier B.V</general><general>Elsevier</general><general>Elsevier Science Ltd</general><scope>6I.</scope><scope>AAFTH</scope><scope>BLEPL</scope><scope>DTL</scope><scope>HGBXW</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SP</scope><scope>8FD</scope><scope>FR3</scope><scope>KR7</scope><scope>L7M</scope><scope>ADTPV</scope><scope>AOWAS</scope><scope>ABBSD</scope><scope>D8T</scope><scope>F1S</scope><scope>ZZAVC</scope><orcidid>https://orcid.org/0000-0003-4759-7038</orcidid></search><sort><creationdate>20210501</creationdate><title>Unsupervised deep learning and analysis of harmonic variation patterns using big data from multiple locations</title><author>Ge, Chenjie ; Oliveira, Roger A.D. ; Gu, Irene Y.H. ; Bollen, Math H.J.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c485t-d1f3514c3d3a7ec69a2be001101bd2fd93ecd00f5bb9eb89210f6e3c434385873</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2021</creationdate><topic>Autoencoder</topic><topic>Big Data</topic><topic>Big data analytics</topic><topic>Clustering</topic><topic>Coders</topic><topic>Electric potential</topic><topic>Electric Power distribution</topic><topic>Electric Power Engineering</topic><topic>Elkraftteknik</topic><topic>Empirical analysis</topic><topic>Engineering</topic><topic>Engineering, Electrical & Electronic</topic><topic>Feature extraction</topic><topic>Feature maps</topic><topic>Harmonic analysis</topic><topic>Harmonic distortion</topic><topic>Kim, Daniel Dae</topic><topic>Machine learning</topic><topic>Pattern analysis</topic><topic>Power quality</topic><topic>Power system harmonics</topic><topic>Science & Technology</topic><topic>Sequences</topic><topic>Technology</topic><topic>Unsupervised deep learning</topic><topic>Variation data</topic><topic>Voltage</topic><topic>Waveform analysis</topic><topic>Waveforms</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Ge, Chenjie</creatorcontrib><creatorcontrib>Oliveira, Roger A.D.</creatorcontrib><creatorcontrib>Gu, Irene Y.H.</creatorcontrib><creatorcontrib>Bollen, Math H.J.</creatorcontrib><collection>ScienceDirect Open Access Titles</collection><collection>Elsevier:ScienceDirect:Open Access</collection><collection>Web of Science Core Collection</collection><collection>Science Citation Index Expanded</collection><collection>Web of Science - Science Citation Index Expanded - 2021</collection><collection>CrossRef</collection><collection>Electronics & Communications Abstracts</collection><collection>Technology Research Database</collection><collection>Engineering Research Database</collection><collection>Civil Engineering Abstracts</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>SwePub</collection><collection>SwePub Articles</collection><collection>SWEPUB Chalmers tekniska högskola full text</collection><collection>SWEPUB Freely available online</collection><collection>SWEPUB Chalmers tekniska högskola</collection><collection>SwePub Articles full text</collection><jtitle>Electric power systems research</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Ge, Chenjie</au><au>Oliveira, Roger A.D.</au><au>Gu, Irene Y.H.</au><au>Bollen, Math H.J.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Unsupervised deep learning and analysis of harmonic variation patterns using big data from multiple locations</atitle><jtitle>Electric power systems research</jtitle><stitle>ELECTR POW SYST RES</stitle><date>2021-05-01</date><risdate>2021</risdate><volume>194</volume><spage>107042</spage><pages>107042-</pages><artnum>107042</artnum><issn>0378-7796</issn><issn>1873-2046</issn><eissn>1873-2046</eissn><abstract>•A novel framework employing unsupervised deep learning and clustering for harmonic voltage variations.•Identification of common underlying patterns from harmonic voltage data at multiple locations.•Criterion for training a deep learning algorithm from data at one location, that is effective for feature extraction of data at all locations.•Empirical analysis approaches for obtaining pattern distribution maps, typical waveform sequences of different classes, and 2D feature maps by nonlinear embedding of high-dimensional feature vectors.•Results demonstrate practical applicability of the method for large harmonic voltage data analytics.•The method can be applied as the basis for a range of power-quality phenomena, like RMS voltage, frequency, unbalance, rapid voltage changes, and harmonic currents.
This paper addresses the issue of automatically seeking and identifying daily, weekly and seasonal patterns in harmonic voltage from measurement data at multiple locations. We propose a novel framework that employs deep autoencoder (DAE) followed by k-mean clustering. The DAE is used for extracting principal features from time series of harmonic voltages. A new strategy is used for training the encoder in DAE from data at one selected location that is effective for subsequent feature extraction from data at multiple locations. To analyze the patterns, several empirical analysis approaches are applied on the clustered principal features, including the distribution of daily patterns over the week and the year, representative waveform sequences of individual classes, and feature maps for visualizing high-dimensional feature space through low-dimensional embedding. The proposed scheme has been tested on a dataset containing harmonic measurements at 10 low-voltage locations in Sweden for the whole year of 2017. Results show distinct principal patterns for most harmonics that can be related to the use of equipment causing harmonic distortion. This information can assist network operators in finding the origin of harmonic distortion and deciding about mitigation actions. The proposed scheme is the first to provide a useful analysis tool and insight for finding and analyzing underlying patterns from harmonic variation data at multiple locations.
[Display omitted]</abstract><cop>LAUSANNE</cop><pub>Elsevier B.V</pub><doi>10.1016/j.epsr.2021.107042</doi><tpages>10</tpages><orcidid>https://orcid.org/0000-0003-4759-7038</orcidid><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | ISSN: 0378-7796 |
ispartof | Electric power systems research, 2021-05, Vol.194, p.107042, Article 107042 |
issn | 0378-7796 1873-2046 1873-2046 |
language | eng |
recordid | cdi_proquest_journals_2551714587 |
source | SWEPUB Freely available online; Web of Science - Science Citation Index Expanded - 2021<img src="https://exlibris-pub.s3.amazonaws.com/fromwos-v2.jpg" />; Access via ScienceDirect (Elsevier) |
subjects | Autoencoder Big Data Big data analytics Clustering Coders Electric potential Electric Power distribution Electric Power Engineering Elkraftteknik Empirical analysis Engineering Engineering, Electrical & Electronic Feature extraction Feature maps Harmonic analysis Harmonic distortion Kim, Daniel Dae Machine learning Pattern analysis Power quality Power system harmonics Science & Technology Sequences Technology Unsupervised deep learning Variation data Voltage Waveform analysis Waveforms |
title | Unsupervised deep learning and analysis of harmonic variation patterns using big data from multiple locations |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-04T14%3A08%3A56IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Unsupervised%20deep%20learning%20and%20analysis%20of%20harmonic%20variation%20patterns%20using%20big%20data%20from%20multiple%20locations&rft.jtitle=Electric%20power%20systems%20research&rft.au=Ge,%20Chenjie&rft.date=2021-05-01&rft.volume=194&rft.spage=107042&rft.pages=107042-&rft.artnum=107042&rft.issn=0378-7796&rft.eissn=1873-2046&rft_id=info:doi/10.1016/j.epsr.2021.107042&rft_dat=%3Cproquest_cross%3E2551714587%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2551714587&rft_id=info:pmid/&rft_els_id=S0378779621000225&rfr_iscdi=true |