Unsupervised deep learning and analysis of harmonic variation patterns using big data from multiple locations

•A novel framework employing unsupervised deep learning and clustering for harmonic voltage variations.•Identification of common underlying patterns from harmonic voltage data at multiple locations.•Criterion for training a deep learning algorithm from data at one location, that is effective for fea...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Electric power systems research 2021-05, Vol.194, p.107042, Article 107042
Hauptverfasser: Ge, Chenjie, Oliveira, Roger A.D., Gu, Irene Y.H., Bollen, Math H.J.
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page 107042
container_title Electric power systems research
container_volume 194
creator Ge, Chenjie
Oliveira, Roger A.D.
Gu, Irene Y.H.
Bollen, Math H.J.
description •A novel framework employing unsupervised deep learning and clustering for harmonic voltage variations.•Identification of common underlying patterns from harmonic voltage data at multiple locations.•Criterion for training a deep learning algorithm from data at one location, that is effective for feature extraction of data at all locations.•Empirical analysis approaches for obtaining pattern distribution maps, typical waveform sequences of different classes, and 2D feature maps by nonlinear embedding of high-dimensional feature vectors.•Results demonstrate practical applicability of the method for large harmonic voltage data analytics.•The method can be applied as the basis for a range of power-quality phenomena, like RMS voltage, frequency, unbalance, rapid voltage changes, and harmonic currents. This paper addresses the issue of automatically seeking and identifying daily, weekly and seasonal patterns in harmonic voltage from measurement data at multiple locations. We propose a novel framework that employs deep autoencoder (DAE) followed by k-mean clustering. The DAE is used for extracting principal features from time series of harmonic voltages. A new strategy is used for training the encoder in DAE from data at one selected location that is effective for subsequent feature extraction from data at multiple locations. To analyze the patterns, several empirical analysis approaches are applied on the clustered principal features, including the distribution of daily patterns over the week and the year, representative waveform sequences of individual classes, and feature maps for visualizing high-dimensional feature space through low-dimensional embedding. The proposed scheme has been tested on a dataset containing harmonic measurements at 10 low-voltage locations in Sweden for the whole year of 2017. Results show distinct principal patterns for most harmonics that can be related to the use of equipment causing harmonic distortion. This information can assist network operators in finding the origin of harmonic distortion and deciding about mitigation actions. The proposed scheme is the first to provide a useful analysis tool and insight for finding and analyzing underlying patterns from harmonic variation data at multiple locations. [Display omitted]
doi_str_mv 10.1016/j.epsr.2021.107042
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2551714587</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S0378779621000225</els_id><sourcerecordid>2551714587</sourcerecordid><originalsourceid>FETCH-LOGICAL-c485t-d1f3514c3d3a7ec69a2be001101bd2fd93ecd00f5bb9eb89210f6e3c434385873</originalsourceid><addsrcrecordid>eNqNkV2L1DAUhosoOK7-Aa8CXuqM-WiaFrxZRt0VFrzQ9faQJiczGdqmJuks--9tt8veKV6EQHifl5zzFMVbRneMsurjaYdjijtOOZsfFC35s2LDaiW2nJbV82JDhaq3SjXVy-JVSidKadUouSn62yFNI8azT2iJRRxJhzoOfjgQPdj56O4--USCI0cd-zB4Q846ep19GMioc8Y4JDKlhWj9gVidNXEx9KSfuuzHDkkXzEM8vS5eON0lfPN4XxS3X7_83F9vb75ffdtf3mxNWcu8tcwJyUojrNAKTdVo3iKlbB61tdzZRqCxlDrZtg22dcMZdRUKU4pS1HKe-qL4sfamOxynFsboex3vIWgPEdM8oDmCOequx5ggIZhaGjSuAqVQQSk5BV2VAmQjGiqtkxzZ3Prhr62f_a9LCPEAXZ6g5oot8XdrfIzh94QpwylMcd5nAi4lU6xcv8rXlIkhpYjuqZZRWNzCCRa3sLiF1e0MvV-hO2yDS8bjYPAJXOQKLuqK0WVpc7r-__Te5wdX-zANeUY_rSjOts4eIzzi1kc0GWzw__rnH4uqz_Q</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2551714587</pqid></control><display><type>article</type><title>Unsupervised deep learning and analysis of harmonic variation patterns using big data from multiple locations</title><source>SWEPUB Freely available online</source><source>Web of Science - Science Citation Index Expanded - 2021&lt;img src="https://exlibris-pub.s3.amazonaws.com/fromwos-v2.jpg" /&gt;</source><source>Access via ScienceDirect (Elsevier)</source><creator>Ge, Chenjie ; Oliveira, Roger A.D. ; Gu, Irene Y.H. ; Bollen, Math H.J.</creator><creatorcontrib>Ge, Chenjie ; Oliveira, Roger A.D. ; Gu, Irene Y.H. ; Bollen, Math H.J.</creatorcontrib><description>•A novel framework employing unsupervised deep learning and clustering for harmonic voltage variations.•Identification of common underlying patterns from harmonic voltage data at multiple locations.•Criterion for training a deep learning algorithm from data at one location, that is effective for feature extraction of data at all locations.•Empirical analysis approaches for obtaining pattern distribution maps, typical waveform sequences of different classes, and 2D feature maps by nonlinear embedding of high-dimensional feature vectors.•Results demonstrate practical applicability of the method for large harmonic voltage data analytics.•The method can be applied as the basis for a range of power-quality phenomena, like RMS voltage, frequency, unbalance, rapid voltage changes, and harmonic currents. This paper addresses the issue of automatically seeking and identifying daily, weekly and seasonal patterns in harmonic voltage from measurement data at multiple locations. We propose a novel framework that employs deep autoencoder (DAE) followed by k-mean clustering. The DAE is used for extracting principal features from time series of harmonic voltages. A new strategy is used for training the encoder in DAE from data at one selected location that is effective for subsequent feature extraction from data at multiple locations. To analyze the patterns, several empirical analysis approaches are applied on the clustered principal features, including the distribution of daily patterns over the week and the year, representative waveform sequences of individual classes, and feature maps for visualizing high-dimensional feature space through low-dimensional embedding. The proposed scheme has been tested on a dataset containing harmonic measurements at 10 low-voltage locations in Sweden for the whole year of 2017. Results show distinct principal patterns for most harmonics that can be related to the use of equipment causing harmonic distortion. This information can assist network operators in finding the origin of harmonic distortion and deciding about mitigation actions. The proposed scheme is the first to provide a useful analysis tool and insight for finding and analyzing underlying patterns from harmonic variation data at multiple locations. [Display omitted]</description><identifier>ISSN: 0378-7796</identifier><identifier>ISSN: 1873-2046</identifier><identifier>EISSN: 1873-2046</identifier><identifier>DOI: 10.1016/j.epsr.2021.107042</identifier><language>eng</language><publisher>LAUSANNE: Elsevier B.V</publisher><subject>Autoencoder ; Big Data ; Big data analytics ; Clustering ; Coders ; Electric potential ; Electric Power distribution ; Electric Power Engineering ; Elkraftteknik ; Empirical analysis ; Engineering ; Engineering, Electrical &amp; Electronic ; Feature extraction ; Feature maps ; Harmonic analysis ; Harmonic distortion ; Kim, Daniel Dae ; Machine learning ; Pattern analysis ; Power quality ; Power system harmonics ; Science &amp; Technology ; Sequences ; Technology ; Unsupervised deep learning ; Variation data ; Voltage ; Waveform analysis ; Waveforms</subject><ispartof>Electric power systems research, 2021-05, Vol.194, p.107042, Article 107042</ispartof><rights>2021 The Authors</rights><rights>Copyright Elsevier Science Ltd. May 2021</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>true</woscitedreferencessubscribed><woscitedreferencescount>11</woscitedreferencescount><woscitedreferencesoriginalsourcerecordid>wos000632386100011</woscitedreferencesoriginalsourcerecordid><citedby>FETCH-LOGICAL-c485t-d1f3514c3d3a7ec69a2be001101bd2fd93ecd00f5bb9eb89210f6e3c434385873</citedby><cites>FETCH-LOGICAL-c485t-d1f3514c3d3a7ec69a2be001101bd2fd93ecd00f5bb9eb89210f6e3c434385873</cites><orcidid>0000-0003-4759-7038</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://dx.doi.org/10.1016/j.epsr.2021.107042$$EHTML$$P50$$Gelsevier$$Hfree_for_read</linktohtml><link.rule.ids>230,315,554,782,786,887,3552,27931,27932,39265,46002</link.rule.ids><backlink>$$Uhttps://urn.kb.se/resolve?urn=urn:nbn:se:ltu:diva-82711$$DView record from Swedish Publication Index$$Hfree_for_read</backlink><backlink>$$Uhttps://research.chalmers.se/publication/522222$$DView record from Swedish Publication Index$$Hfree_for_read</backlink></links><search><creatorcontrib>Ge, Chenjie</creatorcontrib><creatorcontrib>Oliveira, Roger A.D.</creatorcontrib><creatorcontrib>Gu, Irene Y.H.</creatorcontrib><creatorcontrib>Bollen, Math H.J.</creatorcontrib><title>Unsupervised deep learning and analysis of harmonic variation patterns using big data from multiple locations</title><title>Electric power systems research</title><addtitle>ELECTR POW SYST RES</addtitle><description>•A novel framework employing unsupervised deep learning and clustering for harmonic voltage variations.•Identification of common underlying patterns from harmonic voltage data at multiple locations.•Criterion for training a deep learning algorithm from data at one location, that is effective for feature extraction of data at all locations.•Empirical analysis approaches for obtaining pattern distribution maps, typical waveform sequences of different classes, and 2D feature maps by nonlinear embedding of high-dimensional feature vectors.•Results demonstrate practical applicability of the method for large harmonic voltage data analytics.•The method can be applied as the basis for a range of power-quality phenomena, like RMS voltage, frequency, unbalance, rapid voltage changes, and harmonic currents. This paper addresses the issue of automatically seeking and identifying daily, weekly and seasonal patterns in harmonic voltage from measurement data at multiple locations. We propose a novel framework that employs deep autoencoder (DAE) followed by k-mean clustering. The DAE is used for extracting principal features from time series of harmonic voltages. A new strategy is used for training the encoder in DAE from data at one selected location that is effective for subsequent feature extraction from data at multiple locations. To analyze the patterns, several empirical analysis approaches are applied on the clustered principal features, including the distribution of daily patterns over the week and the year, representative waveform sequences of individual classes, and feature maps for visualizing high-dimensional feature space through low-dimensional embedding. The proposed scheme has been tested on a dataset containing harmonic measurements at 10 low-voltage locations in Sweden for the whole year of 2017. Results show distinct principal patterns for most harmonics that can be related to the use of equipment causing harmonic distortion. This information can assist network operators in finding the origin of harmonic distortion and deciding about mitigation actions. The proposed scheme is the first to provide a useful analysis tool and insight for finding and analyzing underlying patterns from harmonic variation data at multiple locations. [Display omitted]</description><subject>Autoencoder</subject><subject>Big Data</subject><subject>Big data analytics</subject><subject>Clustering</subject><subject>Coders</subject><subject>Electric potential</subject><subject>Electric Power distribution</subject><subject>Electric Power Engineering</subject><subject>Elkraftteknik</subject><subject>Empirical analysis</subject><subject>Engineering</subject><subject>Engineering, Electrical &amp; Electronic</subject><subject>Feature extraction</subject><subject>Feature maps</subject><subject>Harmonic analysis</subject><subject>Harmonic distortion</subject><subject>Kim, Daniel Dae</subject><subject>Machine learning</subject><subject>Pattern analysis</subject><subject>Power quality</subject><subject>Power system harmonics</subject><subject>Science &amp; Technology</subject><subject>Sequences</subject><subject>Technology</subject><subject>Unsupervised deep learning</subject><subject>Variation data</subject><subject>Voltage</subject><subject>Waveform analysis</subject><subject>Waveforms</subject><issn>0378-7796</issn><issn>1873-2046</issn><issn>1873-2046</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2021</creationdate><recordtype>article</recordtype><sourceid>HGBXW</sourceid><sourceid>D8T</sourceid><recordid>eNqNkV2L1DAUhosoOK7-Aa8CXuqM-WiaFrxZRt0VFrzQ9faQJiczGdqmJuks--9tt8veKV6EQHifl5zzFMVbRneMsurjaYdjijtOOZsfFC35s2LDaiW2nJbV82JDhaq3SjXVy-JVSidKadUouSn62yFNI8azT2iJRRxJhzoOfjgQPdj56O4--USCI0cd-zB4Q846ep19GMioc8Y4JDKlhWj9gVidNXEx9KSfuuzHDkkXzEM8vS5eON0lfPN4XxS3X7_83F9vb75ffdtf3mxNWcu8tcwJyUojrNAKTdVo3iKlbB61tdzZRqCxlDrZtg22dcMZdRUKU4pS1HKe-qL4sfamOxynFsboex3vIWgPEdM8oDmCOequx5ggIZhaGjSuAqVQQSk5BV2VAmQjGiqtkxzZ3Prhr62f_a9LCPEAXZ6g5oot8XdrfIzh94QpwylMcd5nAi4lU6xcv8rXlIkhpYjuqZZRWNzCCRa3sLiF1e0MvV-hO2yDS8bjYPAJXOQKLuqK0WVpc7r-__Te5wdX-zANeUY_rSjOts4eIzzi1kc0GWzw__rnH4uqz_Q</recordid><startdate>20210501</startdate><enddate>20210501</enddate><creator>Ge, Chenjie</creator><creator>Oliveira, Roger A.D.</creator><creator>Gu, Irene Y.H.</creator><creator>Bollen, Math H.J.</creator><general>Elsevier B.V</general><general>Elsevier</general><general>Elsevier Science Ltd</general><scope>6I.</scope><scope>AAFTH</scope><scope>BLEPL</scope><scope>DTL</scope><scope>HGBXW</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SP</scope><scope>8FD</scope><scope>FR3</scope><scope>KR7</scope><scope>L7M</scope><scope>ADTPV</scope><scope>AOWAS</scope><scope>ABBSD</scope><scope>D8T</scope><scope>F1S</scope><scope>ZZAVC</scope><orcidid>https://orcid.org/0000-0003-4759-7038</orcidid></search><sort><creationdate>20210501</creationdate><title>Unsupervised deep learning and analysis of harmonic variation patterns using big data from multiple locations</title><author>Ge, Chenjie ; Oliveira, Roger A.D. ; Gu, Irene Y.H. ; Bollen, Math H.J.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c485t-d1f3514c3d3a7ec69a2be001101bd2fd93ecd00f5bb9eb89210f6e3c434385873</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2021</creationdate><topic>Autoencoder</topic><topic>Big Data</topic><topic>Big data analytics</topic><topic>Clustering</topic><topic>Coders</topic><topic>Electric potential</topic><topic>Electric Power distribution</topic><topic>Electric Power Engineering</topic><topic>Elkraftteknik</topic><topic>Empirical analysis</topic><topic>Engineering</topic><topic>Engineering, Electrical &amp; Electronic</topic><topic>Feature extraction</topic><topic>Feature maps</topic><topic>Harmonic analysis</topic><topic>Harmonic distortion</topic><topic>Kim, Daniel Dae</topic><topic>Machine learning</topic><topic>Pattern analysis</topic><topic>Power quality</topic><topic>Power system harmonics</topic><topic>Science &amp; Technology</topic><topic>Sequences</topic><topic>Technology</topic><topic>Unsupervised deep learning</topic><topic>Variation data</topic><topic>Voltage</topic><topic>Waveform analysis</topic><topic>Waveforms</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Ge, Chenjie</creatorcontrib><creatorcontrib>Oliveira, Roger A.D.</creatorcontrib><creatorcontrib>Gu, Irene Y.H.</creatorcontrib><creatorcontrib>Bollen, Math H.J.</creatorcontrib><collection>ScienceDirect Open Access Titles</collection><collection>Elsevier:ScienceDirect:Open Access</collection><collection>Web of Science Core Collection</collection><collection>Science Citation Index Expanded</collection><collection>Web of Science - Science Citation Index Expanded - 2021</collection><collection>CrossRef</collection><collection>Electronics &amp; Communications Abstracts</collection><collection>Technology Research Database</collection><collection>Engineering Research Database</collection><collection>Civil Engineering Abstracts</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>SwePub</collection><collection>SwePub Articles</collection><collection>SWEPUB Chalmers tekniska högskola full text</collection><collection>SWEPUB Freely available online</collection><collection>SWEPUB Chalmers tekniska högskola</collection><collection>SwePub Articles full text</collection><jtitle>Electric power systems research</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Ge, Chenjie</au><au>Oliveira, Roger A.D.</au><au>Gu, Irene Y.H.</au><au>Bollen, Math H.J.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Unsupervised deep learning and analysis of harmonic variation patterns using big data from multiple locations</atitle><jtitle>Electric power systems research</jtitle><stitle>ELECTR POW SYST RES</stitle><date>2021-05-01</date><risdate>2021</risdate><volume>194</volume><spage>107042</spage><pages>107042-</pages><artnum>107042</artnum><issn>0378-7796</issn><issn>1873-2046</issn><eissn>1873-2046</eissn><abstract>•A novel framework employing unsupervised deep learning and clustering for harmonic voltage variations.•Identification of common underlying patterns from harmonic voltage data at multiple locations.•Criterion for training a deep learning algorithm from data at one location, that is effective for feature extraction of data at all locations.•Empirical analysis approaches for obtaining pattern distribution maps, typical waveform sequences of different classes, and 2D feature maps by nonlinear embedding of high-dimensional feature vectors.•Results demonstrate practical applicability of the method for large harmonic voltage data analytics.•The method can be applied as the basis for a range of power-quality phenomena, like RMS voltage, frequency, unbalance, rapid voltage changes, and harmonic currents. This paper addresses the issue of automatically seeking and identifying daily, weekly and seasonal patterns in harmonic voltage from measurement data at multiple locations. We propose a novel framework that employs deep autoencoder (DAE) followed by k-mean clustering. The DAE is used for extracting principal features from time series of harmonic voltages. A new strategy is used for training the encoder in DAE from data at one selected location that is effective for subsequent feature extraction from data at multiple locations. To analyze the patterns, several empirical analysis approaches are applied on the clustered principal features, including the distribution of daily patterns over the week and the year, representative waveform sequences of individual classes, and feature maps for visualizing high-dimensional feature space through low-dimensional embedding. The proposed scheme has been tested on a dataset containing harmonic measurements at 10 low-voltage locations in Sweden for the whole year of 2017. Results show distinct principal patterns for most harmonics that can be related to the use of equipment causing harmonic distortion. This information can assist network operators in finding the origin of harmonic distortion and deciding about mitigation actions. The proposed scheme is the first to provide a useful analysis tool and insight for finding and analyzing underlying patterns from harmonic variation data at multiple locations. [Display omitted]</abstract><cop>LAUSANNE</cop><pub>Elsevier B.V</pub><doi>10.1016/j.epsr.2021.107042</doi><tpages>10</tpages><orcidid>https://orcid.org/0000-0003-4759-7038</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 0378-7796
ispartof Electric power systems research, 2021-05, Vol.194, p.107042, Article 107042
issn 0378-7796
1873-2046
1873-2046
language eng
recordid cdi_proquest_journals_2551714587
source SWEPUB Freely available online; Web of Science - Science Citation Index Expanded - 2021<img src="https://exlibris-pub.s3.amazonaws.com/fromwos-v2.jpg" />; Access via ScienceDirect (Elsevier)
subjects Autoencoder
Big Data
Big data analytics
Clustering
Coders
Electric potential
Electric Power distribution
Electric Power Engineering
Elkraftteknik
Empirical analysis
Engineering
Engineering, Electrical & Electronic
Feature extraction
Feature maps
Harmonic analysis
Harmonic distortion
Kim, Daniel Dae
Machine learning
Pattern analysis
Power quality
Power system harmonics
Science & Technology
Sequences
Technology
Unsupervised deep learning
Variation data
Voltage
Waveform analysis
Waveforms
title Unsupervised deep learning and analysis of harmonic variation patterns using big data from multiple locations
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-04T14%3A08%3A56IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Unsupervised%20deep%20learning%20and%20analysis%20of%20harmonic%20variation%20patterns%20using%20big%20data%20from%20multiple%20locations&rft.jtitle=Electric%20power%20systems%20research&rft.au=Ge,%20Chenjie&rft.date=2021-05-01&rft.volume=194&rft.spage=107042&rft.pages=107042-&rft.artnum=107042&rft.issn=0378-7796&rft.eissn=1873-2046&rft_id=info:doi/10.1016/j.epsr.2021.107042&rft_dat=%3Cproquest_cross%3E2551714587%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2551714587&rft_id=info:pmid/&rft_els_id=S0378779621000225&rfr_iscdi=true