Detection of Scratch Defects on Metal Surfaces Based on MSDD-UNet

In this work, we enhanced the U-shaped network and proposed a method for detecting scratches on metal surfaces based on the Metal Surface Defect Detection U-Net (MSDD-UNet). Initially, we integrated a downsampling approach using a Space-To-Depth module and a lightweight channel attention module to a...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Electronics (Basel) 2024-08, Vol.13 (16), p.3241
Hauptverfasser: Liu, Yan, Qin, Yunbai, Lin, Zhonglan, Xia, Haiying, Wang, Cong
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue 16
container_start_page 3241
container_title Electronics (Basel)
container_volume 13
creator Liu, Yan
Qin, Yunbai
Lin, Zhonglan
Xia, Haiying
Wang, Cong
description In this work, we enhanced the U-shaped network and proposed a method for detecting scratches on metal surfaces based on the Metal Surface Defect Detection U-Net (MSDD-UNet). Initially, we integrated a downsampling approach using a Space-To-Depth module and a lightweight channel attention module to address the loss of contextual information in feature maps that results from multiple convolution and pooling operations. Building on this, we developed an improved attention module that utilizes image frequency decomposition and cross-channel self-attention mechanisms, as well as the strengths of convolutional encoders and self-attention blocks. Additionally, this attention module was integrated into the skip connections between the encoder and decoder. The purpose was to capture dense contextual information, highlight small and fine target areas, and assist in localizing micro and fine scratch defects. In response to the severe foreground–background class imbalance in scratch images, a hybrid loss function combining focal loss and D[sub.ice] loss was put forward to train the model for precise scratch segmentation. Finally, experiments were conducted on two surface defect datasets. The results reveal that our proposed method is more advantageous than other state-of-the-art scratch segmentation methods.
doi_str_mv 10.3390/electronics13163241
format Article
fullrecord <record><control><sourceid>gale_proqu</sourceid><recordid>TN_cdi_proquest_journals_3097932811</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><galeid>A807413593</galeid><sourcerecordid>A807413593</sourcerecordid><originalsourceid>FETCH-LOGICAL-g152t-17a3855d1a083f4ccf3cf061a2b21458bf4da92705c6f4dc70f5b7fe9227e9183</originalsourceid><addsrcrecordid>eNpNjc1OwzAQhC0EElXpE3CJxDnF641r-1ga_qQCh9Bz5TrrkirEELvvj0U5sHvY0aeZWcaugc8RDb-lnlwaw9C5CAgLFBWcsYngypRGGHH-T1-yWYwHnscAauQTtqwp5XgXhiL4onGjTe6jqMlnGItMXyjZvmiOo7eOYnFnI7W_vKnrcvNK6YpdeNtHmv3dKds83L-vnsr12-Pzarku9yBFKkFZ1FK2YLlGXznn0Xm-ACt2Aiqpd75qrRGKS7fI0inu5U55MkIoMqBxym5OvV9j-D5STNtDOI5DfrlFbpRBoQGya35y7W1P227wIY3W5W3ps3NhIN9lvtRcVYDSIP4AOYtdKA</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>3097932811</pqid></control><display><type>article</type><title>Detection of Scratch Defects on Metal Surfaces Based on MSDD-UNet</title><source>MDPI - Multidisciplinary Digital Publishing Institute</source><source>EZB-FREE-00999 freely available EZB journals</source><creator>Liu, Yan ; Qin, Yunbai ; Lin, Zhonglan ; Xia, Haiying ; Wang, Cong</creator><creatorcontrib>Liu, Yan ; Qin, Yunbai ; Lin, Zhonglan ; Xia, Haiying ; Wang, Cong</creatorcontrib><description>In this work, we enhanced the U-shaped network and proposed a method for detecting scratches on metal surfaces based on the Metal Surface Defect Detection U-Net (MSDD-UNet). Initially, we integrated a downsampling approach using a Space-To-Depth module and a lightweight channel attention module to address the loss of contextual information in feature maps that results from multiple convolution and pooling operations. Building on this, we developed an improved attention module that utilizes image frequency decomposition and cross-channel self-attention mechanisms, as well as the strengths of convolutional encoders and self-attention blocks. Additionally, this attention module was integrated into the skip connections between the encoder and decoder. The purpose was to capture dense contextual information, highlight small and fine target areas, and assist in localizing micro and fine scratch defects. In response to the severe foreground–background class imbalance in scratch images, a hybrid loss function combining focal loss and D[sub.ice] loss was put forward to train the model for precise scratch segmentation. Finally, experiments were conducted on two surface defect datasets. The results reveal that our proposed method is more advantageous than other state-of-the-art scratch segmentation methods.</description><identifier>ISSN: 2079-9292</identifier><identifier>EISSN: 2079-9292</identifier><identifier>DOI: 10.3390/electronics13163241</identifier><language>eng</language><publisher>Basel: MDPI AG</publisher><subject>Aesthetics ; Algorithms ; Coders ; Datasets ; Deep learning ; Defects ; Design ; Efficiency ; Feature maps ; Image enhancement ; Image segmentation ; Industrial production ; Manufacturing ; Metal surfaces ; Modules ; Neural networks ; Signal processing ; Surface defects ; Vision systems</subject><ispartof>Electronics (Basel), 2024-08, Vol.13 (16), p.3241</ispartof><rights>COPYRIGHT 2024 MDPI AG</rights><rights>2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,780,784,27924,27925</link.rule.ids></links><search><creatorcontrib>Liu, Yan</creatorcontrib><creatorcontrib>Qin, Yunbai</creatorcontrib><creatorcontrib>Lin, Zhonglan</creatorcontrib><creatorcontrib>Xia, Haiying</creatorcontrib><creatorcontrib>Wang, Cong</creatorcontrib><title>Detection of Scratch Defects on Metal Surfaces Based on MSDD-UNet</title><title>Electronics (Basel)</title><description>In this work, we enhanced the U-shaped network and proposed a method for detecting scratches on metal surfaces based on the Metal Surface Defect Detection U-Net (MSDD-UNet). Initially, we integrated a downsampling approach using a Space-To-Depth module and a lightweight channel attention module to address the loss of contextual information in feature maps that results from multiple convolution and pooling operations. Building on this, we developed an improved attention module that utilizes image frequency decomposition and cross-channel self-attention mechanisms, as well as the strengths of convolutional encoders and self-attention blocks. Additionally, this attention module was integrated into the skip connections between the encoder and decoder. The purpose was to capture dense contextual information, highlight small and fine target areas, and assist in localizing micro and fine scratch defects. In response to the severe foreground–background class imbalance in scratch images, a hybrid loss function combining focal loss and D[sub.ice] loss was put forward to train the model for precise scratch segmentation. Finally, experiments were conducted on two surface defect datasets. The results reveal that our proposed method is more advantageous than other state-of-the-art scratch segmentation methods.</description><subject>Aesthetics</subject><subject>Algorithms</subject><subject>Coders</subject><subject>Datasets</subject><subject>Deep learning</subject><subject>Defects</subject><subject>Design</subject><subject>Efficiency</subject><subject>Feature maps</subject><subject>Image enhancement</subject><subject>Image segmentation</subject><subject>Industrial production</subject><subject>Manufacturing</subject><subject>Metal surfaces</subject><subject>Modules</subject><subject>Neural networks</subject><subject>Signal processing</subject><subject>Surface defects</subject><subject>Vision systems</subject><issn>2079-9292</issn><issn>2079-9292</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><sourceid>ABUWG</sourceid><sourceid>AFKRA</sourceid><sourceid>AZQEC</sourceid><sourceid>BENPR</sourceid><sourceid>CCPQU</sourceid><sourceid>DWQXO</sourceid><recordid>eNpNjc1OwzAQhC0EElXpE3CJxDnF641r-1ga_qQCh9Bz5TrrkirEELvvj0U5sHvY0aeZWcaugc8RDb-lnlwaw9C5CAgLFBWcsYngypRGGHH-T1-yWYwHnscAauQTtqwp5XgXhiL4onGjTe6jqMlnGItMXyjZvmiOo7eOYnFnI7W_vKnrcvNK6YpdeNtHmv3dKds83L-vnsr12-Pzarku9yBFKkFZ1FK2YLlGXznn0Xm-ACt2Aiqpd75qrRGKS7fI0inu5U55MkIoMqBxym5OvV9j-D5STNtDOI5DfrlFbpRBoQGya35y7W1P227wIY3W5W3ps3NhIN9lvtRcVYDSIP4AOYtdKA</recordid><startdate>20240801</startdate><enddate>20240801</enddate><creator>Liu, Yan</creator><creator>Qin, Yunbai</creator><creator>Lin, Zhonglan</creator><creator>Xia, Haiying</creator><creator>Wang, Cong</creator><general>MDPI AG</general><scope>7SP</scope><scope>8FD</scope><scope>8FE</scope><scope>8FG</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>ARAPS</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>HCIFZ</scope><scope>L7M</scope><scope>P5Z</scope><scope>P62</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope></search><sort><creationdate>20240801</creationdate><title>Detection of Scratch Defects on Metal Surfaces Based on MSDD-UNet</title><author>Liu, Yan ; Qin, Yunbai ; Lin, Zhonglan ; Xia, Haiying ; Wang, Cong</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-g152t-17a3855d1a083f4ccf3cf061a2b21458bf4da92705c6f4dc70f5b7fe9227e9183</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Aesthetics</topic><topic>Algorithms</topic><topic>Coders</topic><topic>Datasets</topic><topic>Deep learning</topic><topic>Defects</topic><topic>Design</topic><topic>Efficiency</topic><topic>Feature maps</topic><topic>Image enhancement</topic><topic>Image segmentation</topic><topic>Industrial production</topic><topic>Manufacturing</topic><topic>Metal surfaces</topic><topic>Modules</topic><topic>Neural networks</topic><topic>Signal processing</topic><topic>Surface defects</topic><topic>Vision systems</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Liu, Yan</creatorcontrib><creatorcontrib>Qin, Yunbai</creatorcontrib><creatorcontrib>Lin, Zhonglan</creatorcontrib><creatorcontrib>Xia, Haiying</creatorcontrib><creatorcontrib>Wang, Cong</creatorcontrib><collection>Electronics &amp; Communications Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>Advanced Technologies &amp; Aerospace Collection</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>SciTech Premium Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Advanced Technologies &amp; Aerospace Database</collection><collection>ProQuest Advanced Technologies &amp; Aerospace Collection</collection><collection>Access via ProQuest (Open Access)</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><jtitle>Electronics (Basel)</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Liu, Yan</au><au>Qin, Yunbai</au><au>Lin, Zhonglan</au><au>Xia, Haiying</au><au>Wang, Cong</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Detection of Scratch Defects on Metal Surfaces Based on MSDD-UNet</atitle><jtitle>Electronics (Basel)</jtitle><date>2024-08-01</date><risdate>2024</risdate><volume>13</volume><issue>16</issue><spage>3241</spage><pages>3241-</pages><issn>2079-9292</issn><eissn>2079-9292</eissn><abstract>In this work, we enhanced the U-shaped network and proposed a method for detecting scratches on metal surfaces based on the Metal Surface Defect Detection U-Net (MSDD-UNet). Initially, we integrated a downsampling approach using a Space-To-Depth module and a lightweight channel attention module to address the loss of contextual information in feature maps that results from multiple convolution and pooling operations. Building on this, we developed an improved attention module that utilizes image frequency decomposition and cross-channel self-attention mechanisms, as well as the strengths of convolutional encoders and self-attention blocks. Additionally, this attention module was integrated into the skip connections between the encoder and decoder. The purpose was to capture dense contextual information, highlight small and fine target areas, and assist in localizing micro and fine scratch defects. In response to the severe foreground–background class imbalance in scratch images, a hybrid loss function combining focal loss and D[sub.ice] loss was put forward to train the model for precise scratch segmentation. Finally, experiments were conducted on two surface defect datasets. The results reveal that our proposed method is more advantageous than other state-of-the-art scratch segmentation methods.</abstract><cop>Basel</cop><pub>MDPI AG</pub><doi>10.3390/electronics13163241</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 2079-9292
ispartof Electronics (Basel), 2024-08, Vol.13 (16), p.3241
issn 2079-9292
2079-9292
language eng
recordid cdi_proquest_journals_3097932811
source MDPI - Multidisciplinary Digital Publishing Institute; EZB-FREE-00999 freely available EZB journals
subjects Aesthetics
Algorithms
Coders
Datasets
Deep learning
Defects
Design
Efficiency
Feature maps
Image enhancement
Image segmentation
Industrial production
Manufacturing
Metal surfaces
Modules
Neural networks
Signal processing
Surface defects
Vision systems
title Detection of Scratch Defects on Metal Surfaces Based on MSDD-UNet
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-26T05%3A14%3A43IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-gale_proqu&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Detection%20of%20Scratch%20Defects%20on%20Metal%20Surfaces%20Based%20on%20MSDD-UNet&rft.jtitle=Electronics%20(Basel)&rft.au=Liu,%20Yan&rft.date=2024-08-01&rft.volume=13&rft.issue=16&rft.spage=3241&rft.pages=3241-&rft.issn=2079-9292&rft.eissn=2079-9292&rft_id=info:doi/10.3390/electronics13163241&rft_dat=%3Cgale_proqu%3EA807413593%3C/gale_proqu%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=3097932811&rft_id=info:pmid/&rft_galeid=A807413593&rfr_iscdi=true