An ensemble Swin-LE model with residuals for rolling bearing fault diagnosis

Deep learning-based rolling bearing fault diagnosis has been widely used in practical production. In this paper, an ensemble Swin-LE Transformer model with residuals is proposed to address the problems of background noise interference, difficulty in fault feature extraction and insufficient generali...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Journal of the Brazilian Society of Mechanical Sciences and Engineering 2024-04, Vol.46 (4), Article 211
Hauptverfasser: Zhang, Xiaoyi, Li, Lijun, Shi, Hui, Dong, Zengshou
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue 4
container_start_page
container_title Journal of the Brazilian Society of Mechanical Sciences and Engineering
container_volume 46
creator Zhang, Xiaoyi
Li, Lijun
Shi, Hui
Dong, Zengshou
description Deep learning-based rolling bearing fault diagnosis has been widely used in practical production. In this paper, an ensemble Swin-LE Transformer model with residuals is proposed to address the problems of background noise interference, difficulty in fault feature extraction and insufficient generalisation of the model. A local enhancement module is proposed and applied to the Swin Transformer, named Swin-LE Transformer, to enhance the model fault feature extraction and thus improve the diagnostic accuracy. An ensemble learning architecture with residuals is also proposed based on complete ensemble empirical modal decomposition with adaptive noise (CEEMDAN). The architecture structure uses the original signal as the residual structure for fusion voting to improve the overall generalisation capability of the model. The performance of the Swin-LE Transformer under this architecture is analysed against the original Swin Transformer and networks such as ViT and YOLO through experimental simulations on different bearing datasets, and the results show that the proposed ensemble Swin-LE Transformer achieves an accuracy of 98.62 % , which is higher than the original network by 2.4 % . Based on this, a multi-noise set was designed to verify the performance of the proposed architecture. The experimental results show that the proposed fusion architecture is still 2.94 % higher at SNR-10 dB compared to the single-vote ensemble learning model, demonstrating its improved robustness.
doi_str_mv 10.1007/s40430-024-04759-4
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_3033880759</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>3033880759</sourcerecordid><originalsourceid>FETCH-LOGICAL-c319t-d8981e4da3685b4502d5a120f95c984b30fc3d07404eeb94037d1a939366518c3</originalsourceid><addsrcrecordid>eNp9kEtPwzAQhC0EEuXxBzhZ4mxYZ-3EPlZVeUiROABny4mdkipNip2o4t_jEiRunGYPM7Oaj5AbDnccoLiPAgQCg0wwEIXUTJyQBVeQM8w1P013XigmVaHOyUWMWwDMZC4XpFz21PfR76rO09dD27NyTXeD8x09tOMHDT62brJdpM0QaBi6ru03tPI2HLWxUzdS19pNP8Q2XpGzJln99a9ekveH9dvqiZUvj8-rZclq5HpkTmnFvXAWcyUrISFz0vIMGi1rrUSF0NTooEibvK-0ACwctxo15rnkqsZLcjv37sPwOfk4mu0whT69NAiISkFCkFzZ7KrDEGPwjdmHdmfDl-FgjtTMTM0kauaHmhEphHMo7o8Lffir_if1DflYbkM</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>3033880759</pqid></control><display><type>article</type><title>An ensemble Swin-LE model with residuals for rolling bearing fault diagnosis</title><source>SpringerLink Journals - AutoHoldings</source><creator>Zhang, Xiaoyi ; Li, Lijun ; Shi, Hui ; Dong, Zengshou</creator><creatorcontrib>Zhang, Xiaoyi ; Li, Lijun ; Shi, Hui ; Dong, Zengshou</creatorcontrib><description>Deep learning-based rolling bearing fault diagnosis has been widely used in practical production. In this paper, an ensemble Swin-LE Transformer model with residuals is proposed to address the problems of background noise interference, difficulty in fault feature extraction and insufficient generalisation of the model. A local enhancement module is proposed and applied to the Swin Transformer, named Swin-LE Transformer, to enhance the model fault feature extraction and thus improve the diagnostic accuracy. An ensemble learning architecture with residuals is also proposed based on complete ensemble empirical modal decomposition with adaptive noise (CEEMDAN). The architecture structure uses the original signal as the residual structure for fusion voting to improve the overall generalisation capability of the model. The performance of the Swin-LE Transformer under this architecture is analysed against the original Swin Transformer and networks such as ViT and YOLO through experimental simulations on different bearing datasets, and the results show that the proposed ensemble Swin-LE Transformer achieves an accuracy of 98.62 % , which is higher than the original network by 2.4 % . Based on this, a multi-noise set was designed to verify the performance of the proposed architecture. The experimental results show that the proposed fusion architecture is still 2.94 % higher at SNR-10 dB compared to the single-vote ensemble learning model, demonstrating its improved robustness.</description><identifier>ISSN: 1678-5878</identifier><identifier>EISSN: 1806-3691</identifier><identifier>DOI: 10.1007/s40430-024-04759-4</identifier><language>eng</language><publisher>Berlin/Heidelberg: Springer Berlin Heidelberg</publisher><subject>Accuracy ; Background noise ; Deep learning ; Empirical analysis ; Engineering ; Ensemble learning ; Fault diagnosis ; Feature extraction ; Mechanical Engineering ; Roller bearings ; Technical Paper ; Transformers</subject><ispartof>Journal of the Brazilian Society of Mechanical Sciences and Engineering, 2024-04, Vol.46 (4), Article 211</ispartof><rights>The Author(s), under exclusive licence to The Brazilian Society of Mechanical Sciences and Engineering 2024. Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.</rights><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c319t-d8981e4da3685b4502d5a120f95c984b30fc3d07404eeb94037d1a939366518c3</citedby><cites>FETCH-LOGICAL-c319t-d8981e4da3685b4502d5a120f95c984b30fc3d07404eeb94037d1a939366518c3</cites><orcidid>0000-0002-0553-2378</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://link.springer.com/content/pdf/10.1007/s40430-024-04759-4$$EPDF$$P50$$Gspringer$$H</linktopdf><linktohtml>$$Uhttps://link.springer.com/10.1007/s40430-024-04759-4$$EHTML$$P50$$Gspringer$$H</linktohtml><link.rule.ids>314,776,780,27903,27904,41467,42536,51297</link.rule.ids></links><search><creatorcontrib>Zhang, Xiaoyi</creatorcontrib><creatorcontrib>Li, Lijun</creatorcontrib><creatorcontrib>Shi, Hui</creatorcontrib><creatorcontrib>Dong, Zengshou</creatorcontrib><title>An ensemble Swin-LE model with residuals for rolling bearing fault diagnosis</title><title>Journal of the Brazilian Society of Mechanical Sciences and Engineering</title><addtitle>J Braz. Soc. Mech. Sci. Eng</addtitle><description>Deep learning-based rolling bearing fault diagnosis has been widely used in practical production. In this paper, an ensemble Swin-LE Transformer model with residuals is proposed to address the problems of background noise interference, difficulty in fault feature extraction and insufficient generalisation of the model. A local enhancement module is proposed and applied to the Swin Transformer, named Swin-LE Transformer, to enhance the model fault feature extraction and thus improve the diagnostic accuracy. An ensemble learning architecture with residuals is also proposed based on complete ensemble empirical modal decomposition with adaptive noise (CEEMDAN). The architecture structure uses the original signal as the residual structure for fusion voting to improve the overall generalisation capability of the model. The performance of the Swin-LE Transformer under this architecture is analysed against the original Swin Transformer and networks such as ViT and YOLO through experimental simulations on different bearing datasets, and the results show that the proposed ensemble Swin-LE Transformer achieves an accuracy of 98.62 % , which is higher than the original network by 2.4 % . Based on this, a multi-noise set was designed to verify the performance of the proposed architecture. The experimental results show that the proposed fusion architecture is still 2.94 % higher at SNR-10 dB compared to the single-vote ensemble learning model, demonstrating its improved robustness.</description><subject>Accuracy</subject><subject>Background noise</subject><subject>Deep learning</subject><subject>Empirical analysis</subject><subject>Engineering</subject><subject>Ensemble learning</subject><subject>Fault diagnosis</subject><subject>Feature extraction</subject><subject>Mechanical Engineering</subject><subject>Roller bearings</subject><subject>Technical Paper</subject><subject>Transformers</subject><issn>1678-5878</issn><issn>1806-3691</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><recordid>eNp9kEtPwzAQhC0EEuXxBzhZ4mxYZ-3EPlZVeUiROABny4mdkipNip2o4t_jEiRunGYPM7Oaj5AbDnccoLiPAgQCg0wwEIXUTJyQBVeQM8w1P013XigmVaHOyUWMWwDMZC4XpFz21PfR76rO09dD27NyTXeD8x09tOMHDT62brJdpM0QaBi6ru03tPI2HLWxUzdS19pNP8Q2XpGzJln99a9ekveH9dvqiZUvj8-rZclq5HpkTmnFvXAWcyUrISFz0vIMGi1rrUSF0NTooEibvK-0ACwctxo15rnkqsZLcjv37sPwOfk4mu0whT69NAiISkFCkFzZ7KrDEGPwjdmHdmfDl-FgjtTMTM0kauaHmhEphHMo7o8Lffir_if1DflYbkM</recordid><startdate>20240401</startdate><enddate>20240401</enddate><creator>Zhang, Xiaoyi</creator><creator>Li, Lijun</creator><creator>Shi, Hui</creator><creator>Dong, Zengshou</creator><general>Springer Berlin Heidelberg</general><general>Springer Nature B.V</general><scope>AAYXX</scope><scope>CITATION</scope><orcidid>https://orcid.org/0000-0002-0553-2378</orcidid></search><sort><creationdate>20240401</creationdate><title>An ensemble Swin-LE model with residuals for rolling bearing fault diagnosis</title><author>Zhang, Xiaoyi ; Li, Lijun ; Shi, Hui ; Dong, Zengshou</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c319t-d8981e4da3685b4502d5a120f95c984b30fc3d07404eeb94037d1a939366518c3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Accuracy</topic><topic>Background noise</topic><topic>Deep learning</topic><topic>Empirical analysis</topic><topic>Engineering</topic><topic>Ensemble learning</topic><topic>Fault diagnosis</topic><topic>Feature extraction</topic><topic>Mechanical Engineering</topic><topic>Roller bearings</topic><topic>Technical Paper</topic><topic>Transformers</topic><toplevel>online_resources</toplevel><creatorcontrib>Zhang, Xiaoyi</creatorcontrib><creatorcontrib>Li, Lijun</creatorcontrib><creatorcontrib>Shi, Hui</creatorcontrib><creatorcontrib>Dong, Zengshou</creatorcontrib><collection>CrossRef</collection><jtitle>Journal of the Brazilian Society of Mechanical Sciences and Engineering</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Zhang, Xiaoyi</au><au>Li, Lijun</au><au>Shi, Hui</au><au>Dong, Zengshou</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>An ensemble Swin-LE model with residuals for rolling bearing fault diagnosis</atitle><jtitle>Journal of the Brazilian Society of Mechanical Sciences and Engineering</jtitle><stitle>J Braz. Soc. Mech. Sci. Eng</stitle><date>2024-04-01</date><risdate>2024</risdate><volume>46</volume><issue>4</issue><artnum>211</artnum><issn>1678-5878</issn><eissn>1806-3691</eissn><abstract>Deep learning-based rolling bearing fault diagnosis has been widely used in practical production. In this paper, an ensemble Swin-LE Transformer model with residuals is proposed to address the problems of background noise interference, difficulty in fault feature extraction and insufficient generalisation of the model. A local enhancement module is proposed and applied to the Swin Transformer, named Swin-LE Transformer, to enhance the model fault feature extraction and thus improve the diagnostic accuracy. An ensemble learning architecture with residuals is also proposed based on complete ensemble empirical modal decomposition with adaptive noise (CEEMDAN). The architecture structure uses the original signal as the residual structure for fusion voting to improve the overall generalisation capability of the model. The performance of the Swin-LE Transformer under this architecture is analysed against the original Swin Transformer and networks such as ViT and YOLO through experimental simulations on different bearing datasets, and the results show that the proposed ensemble Swin-LE Transformer achieves an accuracy of 98.62 % , which is higher than the original network by 2.4 % . Based on this, a multi-noise set was designed to verify the performance of the proposed architecture. The experimental results show that the proposed fusion architecture is still 2.94 % higher at SNR-10 dB compared to the single-vote ensemble learning model, demonstrating its improved robustness.</abstract><cop>Berlin/Heidelberg</cop><pub>Springer Berlin Heidelberg</pub><doi>10.1007/s40430-024-04759-4</doi><orcidid>https://orcid.org/0000-0002-0553-2378</orcidid></addata></record>
fulltext fulltext
identifier ISSN: 1678-5878
ispartof Journal of the Brazilian Society of Mechanical Sciences and Engineering, 2024-04, Vol.46 (4), Article 211
issn 1678-5878
1806-3691
language eng
recordid cdi_proquest_journals_3033880759
source SpringerLink Journals - AutoHoldings
subjects Accuracy
Background noise
Deep learning
Empirical analysis
Engineering
Ensemble learning
Fault diagnosis
Feature extraction
Mechanical Engineering
Roller bearings
Technical Paper
Transformers
title An ensemble Swin-LE model with residuals for rolling bearing fault diagnosis
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-28T03%3A43%3A50IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=An%20ensemble%20Swin-LE%20model%20with%20residuals%20for%20rolling%20bearing%20fault%20diagnosis&rft.jtitle=Journal%20of%20the%20Brazilian%20Society%20of%20Mechanical%20Sciences%20and%20Engineering&rft.au=Zhang,%20Xiaoyi&rft.date=2024-04-01&rft.volume=46&rft.issue=4&rft.artnum=211&rft.issn=1678-5878&rft.eissn=1806-3691&rft_id=info:doi/10.1007/s40430-024-04759-4&rft_dat=%3Cproquest_cross%3E3033880759%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=3033880759&rft_id=info:pmid/&rfr_iscdi=true