Detection of Scratch Defects on Metal Surfaces Based on MSDD-UNet
In this work, we enhanced the U-shaped network and proposed a method for detecting scratches on metal surfaces based on the Metal Surface Defect Detection U-Net (MSDD-UNet). Initially, we integrated a downsampling approach using a Space-To-Depth module and a lightweight channel attention module to a...
Gespeichert in:
Veröffentlicht in: | Electronics (Basel) 2024-08, Vol.13 (16), p.3241 |
---|---|
Hauptverfasser: | , , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | |
---|---|
container_issue | 16 |
container_start_page | 3241 |
container_title | Electronics (Basel) |
container_volume | 13 |
creator | Liu, Yan Qin, Yunbai Lin, Zhonglan Xia, Haiying Wang, Cong |
description | In this work, we enhanced the U-shaped network and proposed a method for detecting scratches on metal surfaces based on the Metal Surface Defect Detection U-Net (MSDD-UNet). Initially, we integrated a downsampling approach using a Space-To-Depth module and a lightweight channel attention module to address the loss of contextual information in feature maps that results from multiple convolution and pooling operations. Building on this, we developed an improved attention module that utilizes image frequency decomposition and cross-channel self-attention mechanisms, as well as the strengths of convolutional encoders and self-attention blocks. Additionally, this attention module was integrated into the skip connections between the encoder and decoder. The purpose was to capture dense contextual information, highlight small and fine target areas, and assist in localizing micro and fine scratch defects. In response to the severe foreground–background class imbalance in scratch images, a hybrid loss function combining focal loss and D[sub.ice] loss was put forward to train the model for precise scratch segmentation. Finally, experiments were conducted on two surface defect datasets. The results reveal that our proposed method is more advantageous than other state-of-the-art scratch segmentation methods. |
doi_str_mv | 10.3390/electronics13163241 |
format | Article |
fullrecord | <record><control><sourceid>gale_proqu</sourceid><recordid>TN_cdi_proquest_journals_3097932811</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><galeid>A807413593</galeid><sourcerecordid>A807413593</sourcerecordid><originalsourceid>FETCH-LOGICAL-g152t-17a3855d1a083f4ccf3cf061a2b21458bf4da92705c6f4dc70f5b7fe9227e9183</originalsourceid><addsrcrecordid>eNpNjc1OwzAQhC0EElXpE3CJxDnF641r-1ga_qQCh9Bz5TrrkirEELvvj0U5sHvY0aeZWcaugc8RDb-lnlwaw9C5CAgLFBWcsYngypRGGHH-T1-yWYwHnscAauQTtqwp5XgXhiL4onGjTe6jqMlnGItMXyjZvmiOo7eOYnFnI7W_vKnrcvNK6YpdeNtHmv3dKds83L-vnsr12-Pzarku9yBFKkFZ1FK2YLlGXznn0Xm-ACt2Aiqpd75qrRGKS7fI0inu5U55MkIoMqBxym5OvV9j-D5STNtDOI5DfrlFbpRBoQGya35y7W1P227wIY3W5W3ps3NhIN9lvtRcVYDSIP4AOYtdKA</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>3097932811</pqid></control><display><type>article</type><title>Detection of Scratch Defects on Metal Surfaces Based on MSDD-UNet</title><source>MDPI - Multidisciplinary Digital Publishing Institute</source><source>EZB-FREE-00999 freely available EZB journals</source><creator>Liu, Yan ; Qin, Yunbai ; Lin, Zhonglan ; Xia, Haiying ; Wang, Cong</creator><creatorcontrib>Liu, Yan ; Qin, Yunbai ; Lin, Zhonglan ; Xia, Haiying ; Wang, Cong</creatorcontrib><description>In this work, we enhanced the U-shaped network and proposed a method for detecting scratches on metal surfaces based on the Metal Surface Defect Detection U-Net (MSDD-UNet). Initially, we integrated a downsampling approach using a Space-To-Depth module and a lightweight channel attention module to address the loss of contextual information in feature maps that results from multiple convolution and pooling operations. Building on this, we developed an improved attention module that utilizes image frequency decomposition and cross-channel self-attention mechanisms, as well as the strengths of convolutional encoders and self-attention blocks. Additionally, this attention module was integrated into the skip connections between the encoder and decoder. The purpose was to capture dense contextual information, highlight small and fine target areas, and assist in localizing micro and fine scratch defects. In response to the severe foreground–background class imbalance in scratch images, a hybrid loss function combining focal loss and D[sub.ice] loss was put forward to train the model for precise scratch segmentation. Finally, experiments were conducted on two surface defect datasets. The results reveal that our proposed method is more advantageous than other state-of-the-art scratch segmentation methods.</description><identifier>ISSN: 2079-9292</identifier><identifier>EISSN: 2079-9292</identifier><identifier>DOI: 10.3390/electronics13163241</identifier><language>eng</language><publisher>Basel: MDPI AG</publisher><subject>Aesthetics ; Algorithms ; Coders ; Datasets ; Deep learning ; Defects ; Design ; Efficiency ; Feature maps ; Image enhancement ; Image segmentation ; Industrial production ; Manufacturing ; Metal surfaces ; Modules ; Neural networks ; Signal processing ; Surface defects ; Vision systems</subject><ispartof>Electronics (Basel), 2024-08, Vol.13 (16), p.3241</ispartof><rights>COPYRIGHT 2024 MDPI AG</rights><rights>2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,780,784,27924,27925</link.rule.ids></links><search><creatorcontrib>Liu, Yan</creatorcontrib><creatorcontrib>Qin, Yunbai</creatorcontrib><creatorcontrib>Lin, Zhonglan</creatorcontrib><creatorcontrib>Xia, Haiying</creatorcontrib><creatorcontrib>Wang, Cong</creatorcontrib><title>Detection of Scratch Defects on Metal Surfaces Based on MSDD-UNet</title><title>Electronics (Basel)</title><description>In this work, we enhanced the U-shaped network and proposed a method for detecting scratches on metal surfaces based on the Metal Surface Defect Detection U-Net (MSDD-UNet). Initially, we integrated a downsampling approach using a Space-To-Depth module and a lightweight channel attention module to address the loss of contextual information in feature maps that results from multiple convolution and pooling operations. Building on this, we developed an improved attention module that utilizes image frequency decomposition and cross-channel self-attention mechanisms, as well as the strengths of convolutional encoders and self-attention blocks. Additionally, this attention module was integrated into the skip connections between the encoder and decoder. The purpose was to capture dense contextual information, highlight small and fine target areas, and assist in localizing micro and fine scratch defects. In response to the severe foreground–background class imbalance in scratch images, a hybrid loss function combining focal loss and D[sub.ice] loss was put forward to train the model for precise scratch segmentation. Finally, experiments were conducted on two surface defect datasets. The results reveal that our proposed method is more advantageous than other state-of-the-art scratch segmentation methods.</description><subject>Aesthetics</subject><subject>Algorithms</subject><subject>Coders</subject><subject>Datasets</subject><subject>Deep learning</subject><subject>Defects</subject><subject>Design</subject><subject>Efficiency</subject><subject>Feature maps</subject><subject>Image enhancement</subject><subject>Image segmentation</subject><subject>Industrial production</subject><subject>Manufacturing</subject><subject>Metal surfaces</subject><subject>Modules</subject><subject>Neural networks</subject><subject>Signal processing</subject><subject>Surface defects</subject><subject>Vision systems</subject><issn>2079-9292</issn><issn>2079-9292</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><sourceid>ABUWG</sourceid><sourceid>AFKRA</sourceid><sourceid>AZQEC</sourceid><sourceid>BENPR</sourceid><sourceid>CCPQU</sourceid><sourceid>DWQXO</sourceid><recordid>eNpNjc1OwzAQhC0EElXpE3CJxDnF641r-1ga_qQCh9Bz5TrrkirEELvvj0U5sHvY0aeZWcaugc8RDb-lnlwaw9C5CAgLFBWcsYngypRGGHH-T1-yWYwHnscAauQTtqwp5XgXhiL4onGjTe6jqMlnGItMXyjZvmiOo7eOYnFnI7W_vKnrcvNK6YpdeNtHmv3dKds83L-vnsr12-Pzarku9yBFKkFZ1FK2YLlGXznn0Xm-ACt2Aiqpd75qrRGKS7fI0inu5U55MkIoMqBxym5OvV9j-D5STNtDOI5DfrlFbpRBoQGya35y7W1P227wIY3W5W3ps3NhIN9lvtRcVYDSIP4AOYtdKA</recordid><startdate>20240801</startdate><enddate>20240801</enddate><creator>Liu, Yan</creator><creator>Qin, Yunbai</creator><creator>Lin, Zhonglan</creator><creator>Xia, Haiying</creator><creator>Wang, Cong</creator><general>MDPI AG</general><scope>7SP</scope><scope>8FD</scope><scope>8FE</scope><scope>8FG</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>ARAPS</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>HCIFZ</scope><scope>L7M</scope><scope>P5Z</scope><scope>P62</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope></search><sort><creationdate>20240801</creationdate><title>Detection of Scratch Defects on Metal Surfaces Based on MSDD-UNet</title><author>Liu, Yan ; Qin, Yunbai ; Lin, Zhonglan ; Xia, Haiying ; Wang, Cong</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-g152t-17a3855d1a083f4ccf3cf061a2b21458bf4da92705c6f4dc70f5b7fe9227e9183</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Aesthetics</topic><topic>Algorithms</topic><topic>Coders</topic><topic>Datasets</topic><topic>Deep learning</topic><topic>Defects</topic><topic>Design</topic><topic>Efficiency</topic><topic>Feature maps</topic><topic>Image enhancement</topic><topic>Image segmentation</topic><topic>Industrial production</topic><topic>Manufacturing</topic><topic>Metal surfaces</topic><topic>Modules</topic><topic>Neural networks</topic><topic>Signal processing</topic><topic>Surface defects</topic><topic>Vision systems</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Liu, Yan</creatorcontrib><creatorcontrib>Qin, Yunbai</creatorcontrib><creatorcontrib>Lin, Zhonglan</creatorcontrib><creatorcontrib>Xia, Haiying</creatorcontrib><creatorcontrib>Wang, Cong</creatorcontrib><collection>Electronics & Communications Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>Advanced Technologies & Aerospace Collection</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>SciTech Premium Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Advanced Technologies & Aerospace Database</collection><collection>ProQuest Advanced Technologies & Aerospace Collection</collection><collection>Access via ProQuest (Open Access)</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><jtitle>Electronics (Basel)</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Liu, Yan</au><au>Qin, Yunbai</au><au>Lin, Zhonglan</au><au>Xia, Haiying</au><au>Wang, Cong</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Detection of Scratch Defects on Metal Surfaces Based on MSDD-UNet</atitle><jtitle>Electronics (Basel)</jtitle><date>2024-08-01</date><risdate>2024</risdate><volume>13</volume><issue>16</issue><spage>3241</spage><pages>3241-</pages><issn>2079-9292</issn><eissn>2079-9292</eissn><abstract>In this work, we enhanced the U-shaped network and proposed a method for detecting scratches on metal surfaces based on the Metal Surface Defect Detection U-Net (MSDD-UNet). Initially, we integrated a downsampling approach using a Space-To-Depth module and a lightweight channel attention module to address the loss of contextual information in feature maps that results from multiple convolution and pooling operations. Building on this, we developed an improved attention module that utilizes image frequency decomposition and cross-channel self-attention mechanisms, as well as the strengths of convolutional encoders and self-attention blocks. Additionally, this attention module was integrated into the skip connections between the encoder and decoder. The purpose was to capture dense contextual information, highlight small and fine target areas, and assist in localizing micro and fine scratch defects. In response to the severe foreground–background class imbalance in scratch images, a hybrid loss function combining focal loss and D[sub.ice] loss was put forward to train the model for precise scratch segmentation. Finally, experiments were conducted on two surface defect datasets. The results reveal that our proposed method is more advantageous than other state-of-the-art scratch segmentation methods.</abstract><cop>Basel</cop><pub>MDPI AG</pub><doi>10.3390/electronics13163241</doi><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | ISSN: 2079-9292 |
ispartof | Electronics (Basel), 2024-08, Vol.13 (16), p.3241 |
issn | 2079-9292 2079-9292 |
language | eng |
recordid | cdi_proquest_journals_3097932811 |
source | MDPI - Multidisciplinary Digital Publishing Institute; EZB-FREE-00999 freely available EZB journals |
subjects | Aesthetics Algorithms Coders Datasets Deep learning Defects Design Efficiency Feature maps Image enhancement Image segmentation Industrial production Manufacturing Metal surfaces Modules Neural networks Signal processing Surface defects Vision systems |
title | Detection of Scratch Defects on Metal Surfaces Based on MSDD-UNet |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-26T05%3A14%3A43IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-gale_proqu&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Detection%20of%20Scratch%20Defects%20on%20Metal%20Surfaces%20Based%20on%20MSDD-UNet&rft.jtitle=Electronics%20(Basel)&rft.au=Liu,%20Yan&rft.date=2024-08-01&rft.volume=13&rft.issue=16&rft.spage=3241&rft.pages=3241-&rft.issn=2079-9292&rft.eissn=2079-9292&rft_id=info:doi/10.3390/electronics13163241&rft_dat=%3Cgale_proqu%3EA807413593%3C/gale_proqu%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=3097932811&rft_id=info:pmid/&rft_galeid=A807413593&rfr_iscdi=true |