Multi-Target Defect Identification for Railway Track Line Based on Image Processing and Improved YOLOv3 Model

The condition monitoring of railway track line is one of the essential tasks to ensure the safety of the railway transportation system. Railway track line is mainly composed of tracks, fasteners, sleepers, and so on. Given the requirements for rapid and accurate inspection, innovative and intelligen...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE access 2020, Vol.8, p.61973-61988
Hauptverfasser: Wei, Xiukun, Wei, Dehua, Suo, Da, Jia, Limin, Li, Yujie
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 61988
container_issue
container_start_page 61973
container_title IEEE access
container_volume 8
creator Wei, Xiukun
Wei, Dehua
Suo, Da
Jia, Limin
Li, Yujie
description The condition monitoring of railway track line is one of the essential tasks to ensure the safety of the railway transportation system. Railway track line is mainly composed of tracks, fasteners, sleepers, and so on. Given the requirements for rapid and accurate inspection, innovative and intelligent methods for multi-target defect identification of the railway track line using image processing and deep learning methods are proposed in this paper. Firstly, the track and fastener positioning method based on variance projection and wavelet transform is introduced. After that, a bag-of-visual-word (BOVW) model combined with spatial pyramid decomposition is proposed for railway track line multi-target defect detection with a detection accuracy of 96.26%. Secondly, an improved YOLOv3 model named TLMDDNet (Track Line Multi-target Defect Detection Network), integrating scale reduction and feature concatenation, is proposed to enhance detection accuracy and efficiency. Finally, to reduce model complexity and further improve the detection speed, with the help of dense connection structure, a lightweight design strategy for the TLMDDNet model named DC-TLMDDNet (Dense Connection Based TLMDDNet) is proposed, in which the DenseNet is applied to optimize feature extraction layers in the backbone network of TLMDDNet. The effectiveness of the proposed methods is demonstrated by the experimental results.
doi_str_mv 10.1109/ACCESS.2020.2984264
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_crossref_primary_10_1109_ACCESS_2020_2984264</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>9050731</ieee_id><doaj_id>oai_doaj_org_article_3c4e772c71154f0880ea23cb2cc61287</doaj_id><sourcerecordid>2453699734</sourcerecordid><originalsourceid>FETCH-LOGICAL-c408t-6797333844d228bfcf41c9f126b63f9d8ab5742b5bd5c953ab05c41afa5462c03</originalsourceid><addsrcrecordid>eNpNUU1P3DAQjVArgYBfwMVSz9n6M3aOdEvblRZtVZYDJ2vijFfeZmNqZ6n49zUEofpi6817b2b8quqK0QVjtP18vVze3N0tOOV0wVsjeSNPqjPOmrYWSjQf_nufVpc572k5pkBKn1WH2-MwhXoLaYcT-Yoe3URWPY5T8MHBFOJIfEzkF4ThLzyTbQL3m6zDiOQLZOxJqa8OsEPyM0WHOYdxR2DsC_iY4lMhPGzWmydBbmOPw0X10cOQ8fLtPq_uv91slz_q9eb7anm9rp2kZqob3WohhJGy59x03nnJXOsZb7pG-LY30Ckteae6XrlWCeiocpKBByUb7qg4r1azbx9hbx9TOEB6thGCfQVi2llIU3ADWuEkas2dZkxJT42hCFy4jjvXMG508fo0e5V9_hwxT3Yfj2ks41suy5-2ZVZZWGJmuRRzTujfuzJqX2Kyc0z2JSb7FlNRXc2qgIjvipYqqgUT_wA6RIyK</addsrcrecordid><sourcetype>Open Website</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2453699734</pqid></control><display><type>article</type><title>Multi-Target Defect Identification for Railway Track Line Based on Image Processing and Improved YOLOv3 Model</title><source>IEEE Open Access Journals</source><source>DOAJ Directory of Open Access Journals</source><source>EZB-FREE-00999 freely available EZB journals</source><creator>Wei, Xiukun ; Wei, Dehua ; Suo, Da ; Jia, Limin ; Li, Yujie</creator><creatorcontrib>Wei, Xiukun ; Wei, Dehua ; Suo, Da ; Jia, Limin ; Li, Yujie</creatorcontrib><description>The condition monitoring of railway track line is one of the essential tasks to ensure the safety of the railway transportation system. Railway track line is mainly composed of tracks, fasteners, sleepers, and so on. Given the requirements for rapid and accurate inspection, innovative and intelligent methods for multi-target defect identification of the railway track line using image processing and deep learning methods are proposed in this paper. Firstly, the track and fastener positioning method based on variance projection and wavelet transform is introduced. After that, a bag-of-visual-word (BOVW) model combined with spatial pyramid decomposition is proposed for railway track line multi-target defect detection with a detection accuracy of 96.26%. Secondly, an improved YOLOv3 model named TLMDDNet (Track Line Multi-target Defect Detection Network), integrating scale reduction and feature concatenation, is proposed to enhance detection accuracy and efficiency. Finally, to reduce model complexity and further improve the detection speed, with the help of dense connection structure, a lightweight design strategy for the TLMDDNet model named DC-TLMDDNet (Dense Connection Based TLMDDNet) is proposed, in which the DenseNet is applied to optimize feature extraction layers in the backbone network of TLMDDNet. The effectiveness of the proposed methods is demonstrated by the experimental results.</description><identifier>ISSN: 2169-3536</identifier><identifier>EISSN: 2169-3536</identifier><identifier>DOI: 10.1109/ACCESS.2020.2984264</identifier><identifier>CODEN: IAECCG</identifier><language>eng</language><publisher>Piscataway: IEEE</publisher><subject>Computer networks ; Condition monitoring ; Deep learning ; Fasteners ; Feature extraction ; Image processing ; Inspection ; Machine learning ; Model accuracy ; multi-target defect identification ; Multiple target tracking ; Rail transportation ; Rails ; Railway track line defects ; Railway tracks ; Target detection ; Target recognition ; Tracking ; Transportation networks ; Transportation systems ; Wavelet transforms ; YOLOv3</subject><ispartof>IEEE access, 2020, Vol.8, p.61973-61988</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2020</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c408t-6797333844d228bfcf41c9f126b63f9d8ab5742b5bd5c953ab05c41afa5462c03</citedby><cites>FETCH-LOGICAL-c408t-6797333844d228bfcf41c9f126b63f9d8ab5742b5bd5c953ab05c41afa5462c03</cites><orcidid>0000-0002-1561-0405 ; 0000-0003-0341-966X</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/9050731$$EHTML$$P50$$Gieee$$Hfree_for_read</linktohtml><link.rule.ids>314,780,784,864,2102,4024,27633,27923,27924,27925,54933</link.rule.ids></links><search><creatorcontrib>Wei, Xiukun</creatorcontrib><creatorcontrib>Wei, Dehua</creatorcontrib><creatorcontrib>Suo, Da</creatorcontrib><creatorcontrib>Jia, Limin</creatorcontrib><creatorcontrib>Li, Yujie</creatorcontrib><title>Multi-Target Defect Identification for Railway Track Line Based on Image Processing and Improved YOLOv3 Model</title><title>IEEE access</title><addtitle>Access</addtitle><description>The condition monitoring of railway track line is one of the essential tasks to ensure the safety of the railway transportation system. Railway track line is mainly composed of tracks, fasteners, sleepers, and so on. Given the requirements for rapid and accurate inspection, innovative and intelligent methods for multi-target defect identification of the railway track line using image processing and deep learning methods are proposed in this paper. Firstly, the track and fastener positioning method based on variance projection and wavelet transform is introduced. After that, a bag-of-visual-word (BOVW) model combined with spatial pyramid decomposition is proposed for railway track line multi-target defect detection with a detection accuracy of 96.26%. Secondly, an improved YOLOv3 model named TLMDDNet (Track Line Multi-target Defect Detection Network), integrating scale reduction and feature concatenation, is proposed to enhance detection accuracy and efficiency. Finally, to reduce model complexity and further improve the detection speed, with the help of dense connection structure, a lightweight design strategy for the TLMDDNet model named DC-TLMDDNet (Dense Connection Based TLMDDNet) is proposed, in which the DenseNet is applied to optimize feature extraction layers in the backbone network of TLMDDNet. The effectiveness of the proposed methods is demonstrated by the experimental results.</description><subject>Computer networks</subject><subject>Condition monitoring</subject><subject>Deep learning</subject><subject>Fasteners</subject><subject>Feature extraction</subject><subject>Image processing</subject><subject>Inspection</subject><subject>Machine learning</subject><subject>Model accuracy</subject><subject>multi-target defect identification</subject><subject>Multiple target tracking</subject><subject>Rail transportation</subject><subject>Rails</subject><subject>Railway track line defects</subject><subject>Railway tracks</subject><subject>Target detection</subject><subject>Target recognition</subject><subject>Tracking</subject><subject>Transportation networks</subject><subject>Transportation systems</subject><subject>Wavelet transforms</subject><subject>YOLOv3</subject><issn>2169-3536</issn><issn>2169-3536</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2020</creationdate><recordtype>article</recordtype><sourceid>ESBDL</sourceid><sourceid>RIE</sourceid><sourceid>DOA</sourceid><recordid>eNpNUU1P3DAQjVArgYBfwMVSz9n6M3aOdEvblRZtVZYDJ2vijFfeZmNqZ6n49zUEofpi6817b2b8quqK0QVjtP18vVze3N0tOOV0wVsjeSNPqjPOmrYWSjQf_nufVpc572k5pkBKn1WH2-MwhXoLaYcT-Yoe3URWPY5T8MHBFOJIfEzkF4ThLzyTbQL3m6zDiOQLZOxJqa8OsEPyM0WHOYdxR2DsC_iY4lMhPGzWmydBbmOPw0X10cOQ8fLtPq_uv91slz_q9eb7anm9rp2kZqob3WohhJGy59x03nnJXOsZb7pG-LY30Ckteae6XrlWCeiocpKBByUb7qg4r1azbx9hbx9TOEB6thGCfQVi2llIU3ADWuEkas2dZkxJT42hCFy4jjvXMG508fo0e5V9_hwxT3Yfj2ks41suy5-2ZVZZWGJmuRRzTujfuzJqX2Kyc0z2JSb7FlNRXc2qgIjvipYqqgUT_wA6RIyK</recordid><startdate>2020</startdate><enddate>2020</enddate><creator>Wei, Xiukun</creator><creator>Wei, Dehua</creator><creator>Suo, Da</creator><creator>Jia, Limin</creator><creator>Li, Yujie</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>ESBDL</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7SP</scope><scope>7SR</scope><scope>8BQ</scope><scope>8FD</scope><scope>JG9</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>DOA</scope><orcidid>https://orcid.org/0000-0002-1561-0405</orcidid><orcidid>https://orcid.org/0000-0003-0341-966X</orcidid></search><sort><creationdate>2020</creationdate><title>Multi-Target Defect Identification for Railway Track Line Based on Image Processing and Improved YOLOv3 Model</title><author>Wei, Xiukun ; Wei, Dehua ; Suo, Da ; Jia, Limin ; Li, Yujie</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c408t-6797333844d228bfcf41c9f126b63f9d8ab5742b5bd5c953ab05c41afa5462c03</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2020</creationdate><topic>Computer networks</topic><topic>Condition monitoring</topic><topic>Deep learning</topic><topic>Fasteners</topic><topic>Feature extraction</topic><topic>Image processing</topic><topic>Inspection</topic><topic>Machine learning</topic><topic>Model accuracy</topic><topic>multi-target defect identification</topic><topic>Multiple target tracking</topic><topic>Rail transportation</topic><topic>Rails</topic><topic>Railway track line defects</topic><topic>Railway tracks</topic><topic>Target detection</topic><topic>Target recognition</topic><topic>Tracking</topic><topic>Transportation networks</topic><topic>Transportation systems</topic><topic>Wavelet transforms</topic><topic>YOLOv3</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Wei, Xiukun</creatorcontrib><creatorcontrib>Wei, Dehua</creatorcontrib><creatorcontrib>Suo, Da</creatorcontrib><creatorcontrib>Jia, Limin</creatorcontrib><creatorcontrib>Li, Yujie</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE Open Access Journals</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics &amp; Communications Abstracts</collection><collection>Engineered Materials Abstracts</collection><collection>METADEX</collection><collection>Technology Research Database</collection><collection>Materials Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>DOAJ Directory of Open Access Journals</collection><jtitle>IEEE access</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Wei, Xiukun</au><au>Wei, Dehua</au><au>Suo, Da</au><au>Jia, Limin</au><au>Li, Yujie</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Multi-Target Defect Identification for Railway Track Line Based on Image Processing and Improved YOLOv3 Model</atitle><jtitle>IEEE access</jtitle><stitle>Access</stitle><date>2020</date><risdate>2020</risdate><volume>8</volume><spage>61973</spage><epage>61988</epage><pages>61973-61988</pages><issn>2169-3536</issn><eissn>2169-3536</eissn><coden>IAECCG</coden><abstract>The condition monitoring of railway track line is one of the essential tasks to ensure the safety of the railway transportation system. Railway track line is mainly composed of tracks, fasteners, sleepers, and so on. Given the requirements for rapid and accurate inspection, innovative and intelligent methods for multi-target defect identification of the railway track line using image processing and deep learning methods are proposed in this paper. Firstly, the track and fastener positioning method based on variance projection and wavelet transform is introduced. After that, a bag-of-visual-word (BOVW) model combined with spatial pyramid decomposition is proposed for railway track line multi-target defect detection with a detection accuracy of 96.26%. Secondly, an improved YOLOv3 model named TLMDDNet (Track Line Multi-target Defect Detection Network), integrating scale reduction and feature concatenation, is proposed to enhance detection accuracy and efficiency. Finally, to reduce model complexity and further improve the detection speed, with the help of dense connection structure, a lightweight design strategy for the TLMDDNet model named DC-TLMDDNet (Dense Connection Based TLMDDNet) is proposed, in which the DenseNet is applied to optimize feature extraction layers in the backbone network of TLMDDNet. The effectiveness of the proposed methods is demonstrated by the experimental results.</abstract><cop>Piscataway</cop><pub>IEEE</pub><doi>10.1109/ACCESS.2020.2984264</doi><tpages>16</tpages><orcidid>https://orcid.org/0000-0002-1561-0405</orcidid><orcidid>https://orcid.org/0000-0003-0341-966X</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 2169-3536
ispartof IEEE access, 2020, Vol.8, p.61973-61988
issn 2169-3536
2169-3536
language eng
recordid cdi_crossref_primary_10_1109_ACCESS_2020_2984264
source IEEE Open Access Journals; DOAJ Directory of Open Access Journals; EZB-FREE-00999 freely available EZB journals
subjects Computer networks
Condition monitoring
Deep learning
Fasteners
Feature extraction
Image processing
Inspection
Machine learning
Model accuracy
multi-target defect identification
Multiple target tracking
Rail transportation
Rails
Railway track line defects
Railway tracks
Target detection
Target recognition
Tracking
Transportation networks
Transportation systems
Wavelet transforms
YOLOv3
title Multi-Target Defect Identification for Railway Track Line Based on Image Processing and Improved YOLOv3 Model
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-22T22%3A54%3A18IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Multi-Target%20Defect%20Identification%20for%20Railway%20Track%20Line%20Based%20on%20Image%20Processing%20and%20Improved%20YOLOv3%20Model&rft.jtitle=IEEE%20access&rft.au=Wei,%20Xiukun&rft.date=2020&rft.volume=8&rft.spage=61973&rft.epage=61988&rft.pages=61973-61988&rft.issn=2169-3536&rft.eissn=2169-3536&rft.coden=IAECCG&rft_id=info:doi/10.1109/ACCESS.2020.2984264&rft_dat=%3Cproquest_cross%3E2453699734%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2453699734&rft_id=info:pmid/&rft_ieee_id=9050731&rft_doaj_id=oai_doaj_org_article_3c4e772c71154f0880ea23cb2cc61287&rfr_iscdi=true