An ensemble Swin-LE model with residuals for rolling bearing fault diagnosis
Deep learning-based rolling bearing fault diagnosis has been widely used in practical production. In this paper, an ensemble Swin-LE Transformer model with residuals is proposed to address the problems of background noise interference, difficulty in fault feature extraction and insufficient generali...
Gespeichert in:
Veröffentlicht in: | Journal of the Brazilian Society of Mechanical Sciences and Engineering 2024-04, Vol.46 (4), Article 211 |
---|---|
Hauptverfasser: | , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | |
---|---|
container_issue | 4 |
container_start_page | |
container_title | Journal of the Brazilian Society of Mechanical Sciences and Engineering |
container_volume | 46 |
creator | Zhang, Xiaoyi Li, Lijun Shi, Hui Dong, Zengshou |
description | Deep learning-based rolling bearing fault diagnosis has been widely used in practical production. In this paper, an ensemble Swin-LE Transformer model with residuals is proposed to address the problems of background noise interference, difficulty in fault feature extraction and insufficient generalisation of the model. A local enhancement module is proposed and applied to the Swin Transformer, named Swin-LE Transformer, to enhance the model fault feature extraction and thus improve the diagnostic accuracy. An ensemble learning architecture with residuals is also proposed based on complete ensemble empirical modal decomposition with adaptive noise (CEEMDAN). The architecture structure uses the original signal as the residual structure for fusion voting to improve the overall generalisation capability of the model. The performance of the Swin-LE Transformer under this architecture is analysed against the original Swin Transformer and networks such as ViT and YOLO through experimental simulations on different bearing datasets, and the results show that the proposed ensemble Swin-LE Transformer achieves an accuracy of 98.62
%
, which is higher than the original network by 2.4
%
. Based on this, a multi-noise set was designed to verify the performance of the proposed architecture. The experimental results show that the proposed fusion architecture is still 2.94
%
higher at SNR-10 dB compared to the single-vote ensemble learning model, demonstrating its improved robustness. |
doi_str_mv | 10.1007/s40430-024-04759-4 |
format | Article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_3033880759</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>3033880759</sourcerecordid><originalsourceid>FETCH-LOGICAL-c319t-d8981e4da3685b4502d5a120f95c984b30fc3d07404eeb94037d1a939366518c3</originalsourceid><addsrcrecordid>eNp9kEtPwzAQhC0EEuXxBzhZ4mxYZ-3EPlZVeUiROABny4mdkipNip2o4t_jEiRunGYPM7Oaj5AbDnccoLiPAgQCg0wwEIXUTJyQBVeQM8w1P013XigmVaHOyUWMWwDMZC4XpFz21PfR76rO09dD27NyTXeD8x09tOMHDT62brJdpM0QaBi6ru03tPI2HLWxUzdS19pNP8Q2XpGzJln99a9ekveH9dvqiZUvj8-rZclq5HpkTmnFvXAWcyUrISFz0vIMGi1rrUSF0NTooEibvK-0ACwctxo15rnkqsZLcjv37sPwOfk4mu0whT69NAiISkFCkFzZ7KrDEGPwjdmHdmfDl-FgjtTMTM0kauaHmhEphHMo7o8Lffir_if1DflYbkM</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>3033880759</pqid></control><display><type>article</type><title>An ensemble Swin-LE model with residuals for rolling bearing fault diagnosis</title><source>SpringerLink Journals - AutoHoldings</source><creator>Zhang, Xiaoyi ; Li, Lijun ; Shi, Hui ; Dong, Zengshou</creator><creatorcontrib>Zhang, Xiaoyi ; Li, Lijun ; Shi, Hui ; Dong, Zengshou</creatorcontrib><description>Deep learning-based rolling bearing fault diagnosis has been widely used in practical production. In this paper, an ensemble Swin-LE Transformer model with residuals is proposed to address the problems of background noise interference, difficulty in fault feature extraction and insufficient generalisation of the model. A local enhancement module is proposed and applied to the Swin Transformer, named Swin-LE Transformer, to enhance the model fault feature extraction and thus improve the diagnostic accuracy. An ensemble learning architecture with residuals is also proposed based on complete ensemble empirical modal decomposition with adaptive noise (CEEMDAN). The architecture structure uses the original signal as the residual structure for fusion voting to improve the overall generalisation capability of the model. The performance of the Swin-LE Transformer under this architecture is analysed against the original Swin Transformer and networks such as ViT and YOLO through experimental simulations on different bearing datasets, and the results show that the proposed ensemble Swin-LE Transformer achieves an accuracy of 98.62
%
, which is higher than the original network by 2.4
%
. Based on this, a multi-noise set was designed to verify the performance of the proposed architecture. The experimental results show that the proposed fusion architecture is still 2.94
%
higher at SNR-10 dB compared to the single-vote ensemble learning model, demonstrating its improved robustness.</description><identifier>ISSN: 1678-5878</identifier><identifier>EISSN: 1806-3691</identifier><identifier>DOI: 10.1007/s40430-024-04759-4</identifier><language>eng</language><publisher>Berlin/Heidelberg: Springer Berlin Heidelberg</publisher><subject>Accuracy ; Background noise ; Deep learning ; Empirical analysis ; Engineering ; Ensemble learning ; Fault diagnosis ; Feature extraction ; Mechanical Engineering ; Roller bearings ; Technical Paper ; Transformers</subject><ispartof>Journal of the Brazilian Society of Mechanical Sciences and Engineering, 2024-04, Vol.46 (4), Article 211</ispartof><rights>The Author(s), under exclusive licence to The Brazilian Society of Mechanical Sciences and Engineering 2024. Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.</rights><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c319t-d8981e4da3685b4502d5a120f95c984b30fc3d07404eeb94037d1a939366518c3</citedby><cites>FETCH-LOGICAL-c319t-d8981e4da3685b4502d5a120f95c984b30fc3d07404eeb94037d1a939366518c3</cites><orcidid>0000-0002-0553-2378</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://link.springer.com/content/pdf/10.1007/s40430-024-04759-4$$EPDF$$P50$$Gspringer$$H</linktopdf><linktohtml>$$Uhttps://link.springer.com/10.1007/s40430-024-04759-4$$EHTML$$P50$$Gspringer$$H</linktohtml><link.rule.ids>314,776,780,27903,27904,41467,42536,51297</link.rule.ids></links><search><creatorcontrib>Zhang, Xiaoyi</creatorcontrib><creatorcontrib>Li, Lijun</creatorcontrib><creatorcontrib>Shi, Hui</creatorcontrib><creatorcontrib>Dong, Zengshou</creatorcontrib><title>An ensemble Swin-LE model with residuals for rolling bearing fault diagnosis</title><title>Journal of the Brazilian Society of Mechanical Sciences and Engineering</title><addtitle>J Braz. Soc. Mech. Sci. Eng</addtitle><description>Deep learning-based rolling bearing fault diagnosis has been widely used in practical production. In this paper, an ensemble Swin-LE Transformer model with residuals is proposed to address the problems of background noise interference, difficulty in fault feature extraction and insufficient generalisation of the model. A local enhancement module is proposed and applied to the Swin Transformer, named Swin-LE Transformer, to enhance the model fault feature extraction and thus improve the diagnostic accuracy. An ensemble learning architecture with residuals is also proposed based on complete ensemble empirical modal decomposition with adaptive noise (CEEMDAN). The architecture structure uses the original signal as the residual structure for fusion voting to improve the overall generalisation capability of the model. The performance of the Swin-LE Transformer under this architecture is analysed against the original Swin Transformer and networks such as ViT and YOLO through experimental simulations on different bearing datasets, and the results show that the proposed ensemble Swin-LE Transformer achieves an accuracy of 98.62
%
, which is higher than the original network by 2.4
%
. Based on this, a multi-noise set was designed to verify the performance of the proposed architecture. The experimental results show that the proposed fusion architecture is still 2.94
%
higher at SNR-10 dB compared to the single-vote ensemble learning model, demonstrating its improved robustness.</description><subject>Accuracy</subject><subject>Background noise</subject><subject>Deep learning</subject><subject>Empirical analysis</subject><subject>Engineering</subject><subject>Ensemble learning</subject><subject>Fault diagnosis</subject><subject>Feature extraction</subject><subject>Mechanical Engineering</subject><subject>Roller bearings</subject><subject>Technical Paper</subject><subject>Transformers</subject><issn>1678-5878</issn><issn>1806-3691</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><recordid>eNp9kEtPwzAQhC0EEuXxBzhZ4mxYZ-3EPlZVeUiROABny4mdkipNip2o4t_jEiRunGYPM7Oaj5AbDnccoLiPAgQCg0wwEIXUTJyQBVeQM8w1P013XigmVaHOyUWMWwDMZC4XpFz21PfR76rO09dD27NyTXeD8x09tOMHDT62brJdpM0QaBi6ru03tPI2HLWxUzdS19pNP8Q2XpGzJln99a9ekveH9dvqiZUvj8-rZclq5HpkTmnFvXAWcyUrISFz0vIMGi1rrUSF0NTooEibvK-0ACwctxo15rnkqsZLcjv37sPwOfk4mu0whT69NAiISkFCkFzZ7KrDEGPwjdmHdmfDl-FgjtTMTM0kauaHmhEphHMo7o8Lffir_if1DflYbkM</recordid><startdate>20240401</startdate><enddate>20240401</enddate><creator>Zhang, Xiaoyi</creator><creator>Li, Lijun</creator><creator>Shi, Hui</creator><creator>Dong, Zengshou</creator><general>Springer Berlin Heidelberg</general><general>Springer Nature B.V</general><scope>AAYXX</scope><scope>CITATION</scope><orcidid>https://orcid.org/0000-0002-0553-2378</orcidid></search><sort><creationdate>20240401</creationdate><title>An ensemble Swin-LE model with residuals for rolling bearing fault diagnosis</title><author>Zhang, Xiaoyi ; Li, Lijun ; Shi, Hui ; Dong, Zengshou</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c319t-d8981e4da3685b4502d5a120f95c984b30fc3d07404eeb94037d1a939366518c3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Accuracy</topic><topic>Background noise</topic><topic>Deep learning</topic><topic>Empirical analysis</topic><topic>Engineering</topic><topic>Ensemble learning</topic><topic>Fault diagnosis</topic><topic>Feature extraction</topic><topic>Mechanical Engineering</topic><topic>Roller bearings</topic><topic>Technical Paper</topic><topic>Transformers</topic><toplevel>online_resources</toplevel><creatorcontrib>Zhang, Xiaoyi</creatorcontrib><creatorcontrib>Li, Lijun</creatorcontrib><creatorcontrib>Shi, Hui</creatorcontrib><creatorcontrib>Dong, Zengshou</creatorcontrib><collection>CrossRef</collection><jtitle>Journal of the Brazilian Society of Mechanical Sciences and Engineering</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Zhang, Xiaoyi</au><au>Li, Lijun</au><au>Shi, Hui</au><au>Dong, Zengshou</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>An ensemble Swin-LE model with residuals for rolling bearing fault diagnosis</atitle><jtitle>Journal of the Brazilian Society of Mechanical Sciences and Engineering</jtitle><stitle>J Braz. Soc. Mech. Sci. Eng</stitle><date>2024-04-01</date><risdate>2024</risdate><volume>46</volume><issue>4</issue><artnum>211</artnum><issn>1678-5878</issn><eissn>1806-3691</eissn><abstract>Deep learning-based rolling bearing fault diagnosis has been widely used in practical production. In this paper, an ensemble Swin-LE Transformer model with residuals is proposed to address the problems of background noise interference, difficulty in fault feature extraction and insufficient generalisation of the model. A local enhancement module is proposed and applied to the Swin Transformer, named Swin-LE Transformer, to enhance the model fault feature extraction and thus improve the diagnostic accuracy. An ensemble learning architecture with residuals is also proposed based on complete ensemble empirical modal decomposition with adaptive noise (CEEMDAN). The architecture structure uses the original signal as the residual structure for fusion voting to improve the overall generalisation capability of the model. The performance of the Swin-LE Transformer under this architecture is analysed against the original Swin Transformer and networks such as ViT and YOLO through experimental simulations on different bearing datasets, and the results show that the proposed ensemble Swin-LE Transformer achieves an accuracy of 98.62
%
, which is higher than the original network by 2.4
%
. Based on this, a multi-noise set was designed to verify the performance of the proposed architecture. The experimental results show that the proposed fusion architecture is still 2.94
%
higher at SNR-10 dB compared to the single-vote ensemble learning model, demonstrating its improved robustness.</abstract><cop>Berlin/Heidelberg</cop><pub>Springer Berlin Heidelberg</pub><doi>10.1007/s40430-024-04759-4</doi><orcidid>https://orcid.org/0000-0002-0553-2378</orcidid></addata></record> |
fulltext | fulltext |
identifier | ISSN: 1678-5878 |
ispartof | Journal of the Brazilian Society of Mechanical Sciences and Engineering, 2024-04, Vol.46 (4), Article 211 |
issn | 1678-5878 1806-3691 |
language | eng |
recordid | cdi_proquest_journals_3033880759 |
source | SpringerLink Journals - AutoHoldings |
subjects | Accuracy Background noise Deep learning Empirical analysis Engineering Ensemble learning Fault diagnosis Feature extraction Mechanical Engineering Roller bearings Technical Paper Transformers |
title | An ensemble Swin-LE model with residuals for rolling bearing fault diagnosis |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-28T03%3A43%3A50IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=An%20ensemble%20Swin-LE%20model%20with%20residuals%20for%20rolling%20bearing%20fault%20diagnosis&rft.jtitle=Journal%20of%20the%20Brazilian%20Society%20of%20Mechanical%20Sciences%20and%20Engineering&rft.au=Zhang,%20Xiaoyi&rft.date=2024-04-01&rft.volume=46&rft.issue=4&rft.artnum=211&rft.issn=1678-5878&rft.eissn=1806-3691&rft_id=info:doi/10.1007/s40430-024-04759-4&rft_dat=%3Cproquest_cross%3E3033880759%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=3033880759&rft_id=info:pmid/&rfr_iscdi=true |