Segmentation of Track Surface Defects Based on Machine Vision and Neural Networks

Local failure of rail track commonly grow from surface defects. Hence, timely detection of surface defects helps to identify potential hazards on the track and reduce the occurrence of railroad accidents. Since track surface defects are scattered and diverse, and different service life leads to diff...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE sensors journal 2022-01, Vol.22 (2), p.1571-1582
Hauptverfasser: Yang, Hongfei, Wang, Yanzhang, Hu, Jiyong, He, Jiatang, Yao, Zongwei, Bi, Qiushi
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 1582
container_issue 2
container_start_page 1571
container_title IEEE sensors journal
container_volume 22
creator Yang, Hongfei
Wang, Yanzhang
Hu, Jiyong
He, Jiatang
Yao, Zongwei
Bi, Qiushi
description Local failure of rail track commonly grow from surface defects. Hence, timely detection of surface defects helps to identify potential hazards on the track and reduce the occurrence of railroad accidents. Since track surface defects are scattered and diverse, and different service life leads to different types of defects, it is crucial to detect surface defects in real time, with efficiency, reliability and robustness. To this end, a pixel-level defects segmentation method is proposed. In this paper, features are tessellated together at the Channel level to form denser features, allowing additional information on surface defects textures to be propagated among high-resolution layers. Dropout is performed on the weak correlations learned during the convolution, so that the convolution blocks can share a uniform weight matrix, reducing computation redundancy and model complexity. Firstly, the track datasets of different ages are categorized into four sets, then, the samples are normalized to grey scale by pre-processing, and fed into the proposed network for training. An evaluation of the proposed model on defective samples was performed to demonstrate the performance of the method, with an Accuracy of 97.47%, a Loss of 0.0061 and an Average Frame Rate of 0.033s. The results of different networks tested on the same dataset show that the proposed model exhibits strong stability, adaptability and robustness. In addition, the proposed model is assessed on two different datasets with distinct challenges, with Mean Intersection over Union yielding 2.13% and 3.77% boosts respectively.
doi_str_mv 10.1109/JSEN.2021.3133280
format Article
fullrecord <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_proquest_journals_2619023724</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>9643025</ieee_id><sourcerecordid>2619023724</sourcerecordid><originalsourceid>FETCH-LOGICAL-c341t-e665d6f5bfdf8d2b786a1f184209ed9c03b59bbb43612585fb5b5f9e6f65466f3</originalsourceid><addsrcrecordid>eNo9kEtLw0AUhQdRsFZ_gLgZcJ0672SWWuuLWpFWcTfMJHc0fSR1JkH89ya0uDp38Z1z4UPonJIRpURfPc0nsxEjjI445Zxl5AANqJRZQlORHfY3J4ng6ccxOolxSQjVqUwH6HUOnxuoGtuUdYVrjxfB5is8b4O3OeBb8JA3Ed_YCAXuiGebf5UV4Pcy9gVbFXgGbbDrLpqfOqziKTrydh3hbJ9D9HY3WYwfkunL_eP4eprkXNAmAaVkobx0vvBZwVyaKUs9zQQjGgqdE-6kds4JriiTmfROOuk1KK-kUMrzIbrc7W5D_d1CbMyybkPVvTRMUU0YT5noKLqj8lDHGMCbbSg3NvwaSkxvzvTmTG_O7M11nYtdpwSAf14rwQmT_A87mGlo</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2619023724</pqid></control><display><type>article</type><title>Segmentation of Track Surface Defects Based on Machine Vision and Neural Networks</title><source>IEEE Electronic Library (IEL)</source><creator>Yang, Hongfei ; Wang, Yanzhang ; Hu, Jiyong ; He, Jiatang ; Yao, Zongwei ; Bi, Qiushi</creator><creatorcontrib>Yang, Hongfei ; Wang, Yanzhang ; Hu, Jiyong ; He, Jiatang ; Yao, Zongwei ; Bi, Qiushi</creatorcontrib><description>Local failure of rail track commonly grow from surface defects. Hence, timely detection of surface defects helps to identify potential hazards on the track and reduce the occurrence of railroad accidents. Since track surface defects are scattered and diverse, and different service life leads to different types of defects, it is crucial to detect surface defects in real time, with efficiency, reliability and robustness. To this end, a pixel-level defects segmentation method is proposed. In this paper, features are tessellated together at the Channel level to form denser features, allowing additional information on surface defects textures to be propagated among high-resolution layers. Dropout is performed on the weak correlations learned during the convolution, so that the convolution blocks can share a uniform weight matrix, reducing computation redundancy and model complexity. Firstly, the track datasets of different ages are categorized into four sets, then, the samples are normalized to grey scale by pre-processing, and fed into the proposed network for training. An evaluation of the proposed model on defective samples was performed to demonstrate the performance of the method, with an Accuracy of 97.47%, a Loss of 0.0061 and an Average Frame Rate of 0.033s. The results of different networks tested on the same dataset show that the proposed model exhibits strong stability, adaptability and robustness. In addition, the proposed model is assessed on two different datasets with distinct challenges, with Mean Intersection over Union yielding 2.13% and 3.77% boosts respectively.</description><identifier>ISSN: 1530-437X</identifier><identifier>EISSN: 1558-1748</identifier><identifier>DOI: 10.1109/JSEN.2021.3133280</identifier><identifier>CODEN: ISJEAZ</identifier><language>eng</language><publisher>New York: IEEE</publisher><subject>Complex and diverse track surface ; Convolution ; Convolutional neural networks ; Datasets ; defects segmentation ; Feature extraction ; Hazard identification ; Image segmentation ; Machine vision ; Neural networks ; Object segmentation ; Rails ; Railway accidents ; Redundancy ; Robustness ; Segmentation ; Service life ; Stability analysis ; Steel ; Surface defects ; Surface texture ; track surface defects ; Weight reduction</subject><ispartof>IEEE sensors journal, 2022-01, Vol.22 (2), p.1571-1582</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2022</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c341t-e665d6f5bfdf8d2b786a1f184209ed9c03b59bbb43612585fb5b5f9e6f65466f3</citedby><cites>FETCH-LOGICAL-c341t-e665d6f5bfdf8d2b786a1f184209ed9c03b59bbb43612585fb5b5f9e6f65466f3</cites><orcidid>0000-0002-7016-8867 ; 0000-0003-4039-9215 ; 0000-0001-6997-3861 ; 0000-0002-0522-2468</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/9643025$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,780,784,796,27924,27925,54758</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/9643025$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Yang, Hongfei</creatorcontrib><creatorcontrib>Wang, Yanzhang</creatorcontrib><creatorcontrib>Hu, Jiyong</creatorcontrib><creatorcontrib>He, Jiatang</creatorcontrib><creatorcontrib>Yao, Zongwei</creatorcontrib><creatorcontrib>Bi, Qiushi</creatorcontrib><title>Segmentation of Track Surface Defects Based on Machine Vision and Neural Networks</title><title>IEEE sensors journal</title><addtitle>JSEN</addtitle><description>Local failure of rail track commonly grow from surface defects. Hence, timely detection of surface defects helps to identify potential hazards on the track and reduce the occurrence of railroad accidents. Since track surface defects are scattered and diverse, and different service life leads to different types of defects, it is crucial to detect surface defects in real time, with efficiency, reliability and robustness. To this end, a pixel-level defects segmentation method is proposed. In this paper, features are tessellated together at the Channel level to form denser features, allowing additional information on surface defects textures to be propagated among high-resolution layers. Dropout is performed on the weak correlations learned during the convolution, so that the convolution blocks can share a uniform weight matrix, reducing computation redundancy and model complexity. Firstly, the track datasets of different ages are categorized into four sets, then, the samples are normalized to grey scale by pre-processing, and fed into the proposed network for training. An evaluation of the proposed model on defective samples was performed to demonstrate the performance of the method, with an Accuracy of 97.47%, a Loss of 0.0061 and an Average Frame Rate of 0.033s. The results of different networks tested on the same dataset show that the proposed model exhibits strong stability, adaptability and robustness. In addition, the proposed model is assessed on two different datasets with distinct challenges, with Mean Intersection over Union yielding 2.13% and 3.77% boosts respectively.</description><subject>Complex and diverse track surface</subject><subject>Convolution</subject><subject>Convolutional neural networks</subject><subject>Datasets</subject><subject>defects segmentation</subject><subject>Feature extraction</subject><subject>Hazard identification</subject><subject>Image segmentation</subject><subject>Machine vision</subject><subject>Neural networks</subject><subject>Object segmentation</subject><subject>Rails</subject><subject>Railway accidents</subject><subject>Redundancy</subject><subject>Robustness</subject><subject>Segmentation</subject><subject>Service life</subject><subject>Stability analysis</subject><subject>Steel</subject><subject>Surface defects</subject><subject>Surface texture</subject><subject>track surface defects</subject><subject>Weight reduction</subject><issn>1530-437X</issn><issn>1558-1748</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNo9kEtLw0AUhQdRsFZ_gLgZcJ0672SWWuuLWpFWcTfMJHc0fSR1JkH89ya0uDp38Z1z4UPonJIRpURfPc0nsxEjjI445Zxl5AANqJRZQlORHfY3J4ng6ccxOolxSQjVqUwH6HUOnxuoGtuUdYVrjxfB5is8b4O3OeBb8JA3Ed_YCAXuiGebf5UV4Pcy9gVbFXgGbbDrLpqfOqziKTrydh3hbJ9D9HY3WYwfkunL_eP4eprkXNAmAaVkobx0vvBZwVyaKUs9zQQjGgqdE-6kds4JriiTmfROOuk1KK-kUMrzIbrc7W5D_d1CbMyybkPVvTRMUU0YT5noKLqj8lDHGMCbbSg3NvwaSkxvzvTmTG_O7M11nYtdpwSAf14rwQmT_A87mGlo</recordid><startdate>20220115</startdate><enddate>20220115</enddate><creator>Yang, Hongfei</creator><creator>Wang, Yanzhang</creator><creator>Hu, Jiyong</creator><creator>He, Jiatang</creator><creator>Yao, Zongwei</creator><creator>Bi, Qiushi</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SP</scope><scope>7U5</scope><scope>8FD</scope><scope>L7M</scope><orcidid>https://orcid.org/0000-0002-7016-8867</orcidid><orcidid>https://orcid.org/0000-0003-4039-9215</orcidid><orcidid>https://orcid.org/0000-0001-6997-3861</orcidid><orcidid>https://orcid.org/0000-0002-0522-2468</orcidid></search><sort><creationdate>20220115</creationdate><title>Segmentation of Track Surface Defects Based on Machine Vision and Neural Networks</title><author>Yang, Hongfei ; Wang, Yanzhang ; Hu, Jiyong ; He, Jiatang ; Yao, Zongwei ; Bi, Qiushi</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c341t-e665d6f5bfdf8d2b786a1f184209ed9c03b59bbb43612585fb5b5f9e6f65466f3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>Complex and diverse track surface</topic><topic>Convolution</topic><topic>Convolutional neural networks</topic><topic>Datasets</topic><topic>defects segmentation</topic><topic>Feature extraction</topic><topic>Hazard identification</topic><topic>Image segmentation</topic><topic>Machine vision</topic><topic>Neural networks</topic><topic>Object segmentation</topic><topic>Rails</topic><topic>Railway accidents</topic><topic>Redundancy</topic><topic>Robustness</topic><topic>Segmentation</topic><topic>Service life</topic><topic>Stability analysis</topic><topic>Steel</topic><topic>Surface defects</topic><topic>Surface texture</topic><topic>track surface defects</topic><topic>Weight reduction</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Yang, Hongfei</creatorcontrib><creatorcontrib>Wang, Yanzhang</creatorcontrib><creatorcontrib>Hu, Jiyong</creatorcontrib><creatorcontrib>He, Jiatang</creatorcontrib><creatorcontrib>Yao, Zongwei</creatorcontrib><creatorcontrib>Bi, Qiushi</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Electronics &amp; Communications Abstracts</collection><collection>Solid State and Superconductivity Abstracts</collection><collection>Technology Research Database</collection><collection>Advanced Technologies Database with Aerospace</collection><jtitle>IEEE sensors journal</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Yang, Hongfei</au><au>Wang, Yanzhang</au><au>Hu, Jiyong</au><au>He, Jiatang</au><au>Yao, Zongwei</au><au>Bi, Qiushi</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Segmentation of Track Surface Defects Based on Machine Vision and Neural Networks</atitle><jtitle>IEEE sensors journal</jtitle><stitle>JSEN</stitle><date>2022-01-15</date><risdate>2022</risdate><volume>22</volume><issue>2</issue><spage>1571</spage><epage>1582</epage><pages>1571-1582</pages><issn>1530-437X</issn><eissn>1558-1748</eissn><coden>ISJEAZ</coden><abstract>Local failure of rail track commonly grow from surface defects. Hence, timely detection of surface defects helps to identify potential hazards on the track and reduce the occurrence of railroad accidents. Since track surface defects are scattered and diverse, and different service life leads to different types of defects, it is crucial to detect surface defects in real time, with efficiency, reliability and robustness. To this end, a pixel-level defects segmentation method is proposed. In this paper, features are tessellated together at the Channel level to form denser features, allowing additional information on surface defects textures to be propagated among high-resolution layers. Dropout is performed on the weak correlations learned during the convolution, so that the convolution blocks can share a uniform weight matrix, reducing computation redundancy and model complexity. Firstly, the track datasets of different ages are categorized into four sets, then, the samples are normalized to grey scale by pre-processing, and fed into the proposed network for training. An evaluation of the proposed model on defective samples was performed to demonstrate the performance of the method, with an Accuracy of 97.47%, a Loss of 0.0061 and an Average Frame Rate of 0.033s. The results of different networks tested on the same dataset show that the proposed model exhibits strong stability, adaptability and robustness. In addition, the proposed model is assessed on two different datasets with distinct challenges, with Mean Intersection over Union yielding 2.13% and 3.77% boosts respectively.</abstract><cop>New York</cop><pub>IEEE</pub><doi>10.1109/JSEN.2021.3133280</doi><tpages>12</tpages><orcidid>https://orcid.org/0000-0002-7016-8867</orcidid><orcidid>https://orcid.org/0000-0003-4039-9215</orcidid><orcidid>https://orcid.org/0000-0001-6997-3861</orcidid><orcidid>https://orcid.org/0000-0002-0522-2468</orcidid></addata></record>
fulltext fulltext_linktorsrc
identifier ISSN: 1530-437X
ispartof IEEE sensors journal, 2022-01, Vol.22 (2), p.1571-1582
issn 1530-437X
1558-1748
language eng
recordid cdi_proquest_journals_2619023724
source IEEE Electronic Library (IEL)
subjects Complex and diverse track surface
Convolution
Convolutional neural networks
Datasets
defects segmentation
Feature extraction
Hazard identification
Image segmentation
Machine vision
Neural networks
Object segmentation
Rails
Railway accidents
Redundancy
Robustness
Segmentation
Service life
Stability analysis
Steel
Surface defects
Surface texture
track surface defects
Weight reduction
title Segmentation of Track Surface Defects Based on Machine Vision and Neural Networks
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-30T20%3A36%3A49IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Segmentation%20of%20Track%20Surface%20Defects%20Based%20on%20Machine%20Vision%20and%20Neural%20Networks&rft.jtitle=IEEE%20sensors%20journal&rft.au=Yang,%20Hongfei&rft.date=2022-01-15&rft.volume=22&rft.issue=2&rft.spage=1571&rft.epage=1582&rft.pages=1571-1582&rft.issn=1530-437X&rft.eissn=1558-1748&rft.coden=ISJEAZ&rft_id=info:doi/10.1109/JSEN.2021.3133280&rft_dat=%3Cproquest_RIE%3E2619023724%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2619023724&rft_id=info:pmid/&rft_ieee_id=9643025&rfr_iscdi=true