Voxel-wise segmentation for porosity investigation of additive manufactured parts with 3D unsupervised and (deeply) supervised neural networks

Additive Manufacturing (AM) has emerged as a manufacturing process that allows the direct production of samples from digital models. To ensure that quality standards are met in all samples of a batch, X-ray computed tomography (X-CT) is often used in combination with automated anomaly detection. For...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Applied intelligence (Dordrecht, Netherlands) Netherlands), 2024-12, Vol.54 (24), p.13160-13177
Hauptverfasser: Iuso, Domenico, Chatterjee, Soumick, Cornelissen, Sven, Verhees, Dries, Beenhouwer, Jan De, Sijbers, Jan
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 13177
container_issue 24
container_start_page 13160
container_title Applied intelligence (Dordrecht, Netherlands)
container_volume 54
creator Iuso, Domenico
Chatterjee, Soumick
Cornelissen, Sven
Verhees, Dries
Beenhouwer, Jan De
Sijbers, Jan
description Additive Manufacturing (AM) has emerged as a manufacturing process that allows the direct production of samples from digital models. To ensure that quality standards are met in all samples of a batch, X-ray computed tomography (X-CT) is often used in combination with automated anomaly detection. For the latter, deep learning (DL) anomaly detection techniques are increasingly used, as they can be trained to be robust to the material being analysed and resilient to poor image quality. Unfortunately, most recent and popular DL models have been developed for 2D image processing, thereby disregarding valuable volumetric information. Additionally, there is a notable absence of comparisons between supervised and unsupervised models for voxel-wise pore segmentation tasks. This study revisits recent supervised (UNet, UNet++, UNet 3+, MSS-UNet, ACC-UNet) and unsupervised (VAE, ceVAE, gmVAE, vqVAE, RV-VAE) DL models for porosity analysis of AM samples from X-CT images and extends them to accept 3D input data with a 3D-patch approach for lower computational requirements, improved efficiency and generalisability. The supervised models were trained using the Focal Tversky loss to address class imbalance that arises from the low porosity in the training datasets. The output of the unsupervised models was post-processed to reduce misclassifications caused by their inability to adequately represent the object surface. The findings were cross-validated in a 5-fold fashion and include: a performance benchmark of the DL models, an evaluation of the post-processing algorithm, an evaluation of the effect of training supervised models with the output of unsupervised models. In a final performance benchmark on a test set with poor image quality, the best performing supervised model was UNet++ with an average precision of 0.751 ± 0.030, while the best unsupervised model was the post-processed ceVAE with 0.830 ± 0.003. Notably, the ceVAE model, with its post-processing technique, exhibited superior capabilities, endorsing unsupervised learning as the preferred approach for the voxel-wise pore segmentation task.
doi_str_mv 10.1007/s10489-024-05647-z
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_3126825797</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>3126825797</sourcerecordid><originalsourceid>FETCH-LOGICAL-c244t-cc15a9de018c38a2ccb19b33538579eb8f609397396049e646826be50c26ac953</originalsourceid><addsrcrecordid>eNp9kMlOwzAQhi0EEmV5AU6WuMAhYMeJEx8Ru1SJCyBulutMiktrB9tpKQ_BM2MIEpw4jTT_MpoPoQNKTigh1WmgpKhFRvIiIyUvqux9A41oWbGsKkS1iUZEJIlz8bSNdkKYEUIYI3SEPh7dG8yzlQmAA0wXYKOKxlncOo87510wcY2NXUKIZjpIrsWqaUw0S8ALZftW6dh7aHCnfAx4ZeIzZhe4t6HvwC9TdYOVbfBRA9DN18f4z95C79U8jbhy_iXsoa1WzQPs_8xd9HB1eX9-k43vrm_Pz8aZzosiZlrTUokGCK01q1Wu9YSKCWMlq8tKwKRuORFMVExwUgjgBa9zPoGS6JwrLUq2iw6H3s671z79Jmeu9zadlIzmyZ1qquTKB5dOHIKHVnbeLJRfS0rkF3c5cJeJu_zmLt9TiA2hkMx2Cv63-p_UJwtWifQ</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>3126825797</pqid></control><display><type>article</type><title>Voxel-wise segmentation for porosity investigation of additive manufactured parts with 3D unsupervised and (deeply) supervised neural networks</title><source>SpringerLink Journals - AutoHoldings</source><creator>Iuso, Domenico ; Chatterjee, Soumick ; Cornelissen, Sven ; Verhees, Dries ; Beenhouwer, Jan De ; Sijbers, Jan</creator><creatorcontrib>Iuso, Domenico ; Chatterjee, Soumick ; Cornelissen, Sven ; Verhees, Dries ; Beenhouwer, Jan De ; Sijbers, Jan</creatorcontrib><description>Additive Manufacturing (AM) has emerged as a manufacturing process that allows the direct production of samples from digital models. To ensure that quality standards are met in all samples of a batch, X-ray computed tomography (X-CT) is often used in combination with automated anomaly detection. For the latter, deep learning (DL) anomaly detection techniques are increasingly used, as they can be trained to be robust to the material being analysed and resilient to poor image quality. Unfortunately, most recent and popular DL models have been developed for 2D image processing, thereby disregarding valuable volumetric information. Additionally, there is a notable absence of comparisons between supervised and unsupervised models for voxel-wise pore segmentation tasks. This study revisits recent supervised (UNet, UNet++, UNet 3+, MSS-UNet, ACC-UNet) and unsupervised (VAE, ceVAE, gmVAE, vqVAE, RV-VAE) DL models for porosity analysis of AM samples from X-CT images and extends them to accept 3D input data with a 3D-patch approach for lower computational requirements, improved efficiency and generalisability. The supervised models were trained using the Focal Tversky loss to address class imbalance that arises from the low porosity in the training datasets. The output of the unsupervised models was post-processed to reduce misclassifications caused by their inability to adequately represent the object surface. The findings were cross-validated in a 5-fold fashion and include: a performance benchmark of the DL models, an evaluation of the post-processing algorithm, an evaluation of the effect of training supervised models with the output of unsupervised models. In a final performance benchmark on a test set with poor image quality, the best performing supervised model was UNet++ with an average precision of 0.751 ± 0.030, while the best unsupervised model was the post-processed ceVAE with 0.830 ± 0.003. Notably, the ceVAE model, with its post-processing technique, exhibited superior capabilities, endorsing unsupervised learning as the preferred approach for the voxel-wise pore segmentation task.</description><identifier>ISSN: 0924-669X</identifier><identifier>EISSN: 1573-7497</identifier><identifier>DOI: 10.1007/s10489-024-05647-z</identifier><language>eng</language><publisher>New York: Springer US</publisher><subject>3-D printers ; Additive manufacturing ; Algorithms ; Anomalies ; Artificial Intelligence ; Benchmarks ; Computed tomography ; Computer Science ; Deep learning ; Image processing ; Image quality ; Image segmentation ; Lasers ; Machine learning ; Machines ; Manufacturing ; Mechanical Engineering ; Medical imaging ; Neural networks ; Performance evaluation ; Plant layout ; Porosity ; Processes ; Quality standards ; Two dimensional analysis ; Unsupervised learning</subject><ispartof>Applied intelligence (Dordrecht, Netherlands), 2024-12, Vol.54 (24), p.13160-13177</ispartof><rights>The Author(s) 2024</rights><rights>The Author(s) 2024. This work is published under http://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-c244t-cc15a9de018c38a2ccb19b33538579eb8f609397396049e646826be50c26ac953</cites><orcidid>0000-0001-7919-7878</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://link.springer.com/content/pdf/10.1007/s10489-024-05647-z$$EPDF$$P50$$Gspringer$$Hfree_for_read</linktopdf><linktohtml>$$Uhttps://link.springer.com/10.1007/s10489-024-05647-z$$EHTML$$P50$$Gspringer$$Hfree_for_read</linktohtml><link.rule.ids>314,776,780,27901,27902,41464,42533,51294</link.rule.ids></links><search><creatorcontrib>Iuso, Domenico</creatorcontrib><creatorcontrib>Chatterjee, Soumick</creatorcontrib><creatorcontrib>Cornelissen, Sven</creatorcontrib><creatorcontrib>Verhees, Dries</creatorcontrib><creatorcontrib>Beenhouwer, Jan De</creatorcontrib><creatorcontrib>Sijbers, Jan</creatorcontrib><title>Voxel-wise segmentation for porosity investigation of additive manufactured parts with 3D unsupervised and (deeply) supervised neural networks</title><title>Applied intelligence (Dordrecht, Netherlands)</title><addtitle>Appl Intell</addtitle><description>Additive Manufacturing (AM) has emerged as a manufacturing process that allows the direct production of samples from digital models. To ensure that quality standards are met in all samples of a batch, X-ray computed tomography (X-CT) is often used in combination with automated anomaly detection. For the latter, deep learning (DL) anomaly detection techniques are increasingly used, as they can be trained to be robust to the material being analysed and resilient to poor image quality. Unfortunately, most recent and popular DL models have been developed for 2D image processing, thereby disregarding valuable volumetric information. Additionally, there is a notable absence of comparisons between supervised and unsupervised models for voxel-wise pore segmentation tasks. This study revisits recent supervised (UNet, UNet++, UNet 3+, MSS-UNet, ACC-UNet) and unsupervised (VAE, ceVAE, gmVAE, vqVAE, RV-VAE) DL models for porosity analysis of AM samples from X-CT images and extends them to accept 3D input data with a 3D-patch approach for lower computational requirements, improved efficiency and generalisability. The supervised models were trained using the Focal Tversky loss to address class imbalance that arises from the low porosity in the training datasets. The output of the unsupervised models was post-processed to reduce misclassifications caused by their inability to adequately represent the object surface. The findings were cross-validated in a 5-fold fashion and include: a performance benchmark of the DL models, an evaluation of the post-processing algorithm, an evaluation of the effect of training supervised models with the output of unsupervised models. In a final performance benchmark on a test set with poor image quality, the best performing supervised model was UNet++ with an average precision of 0.751 ± 0.030, while the best unsupervised model was the post-processed ceVAE with 0.830 ± 0.003. Notably, the ceVAE model, with its post-processing technique, exhibited superior capabilities, endorsing unsupervised learning as the preferred approach for the voxel-wise pore segmentation task.</description><subject>3-D printers</subject><subject>Additive manufacturing</subject><subject>Algorithms</subject><subject>Anomalies</subject><subject>Artificial Intelligence</subject><subject>Benchmarks</subject><subject>Computed tomography</subject><subject>Computer Science</subject><subject>Deep learning</subject><subject>Image processing</subject><subject>Image quality</subject><subject>Image segmentation</subject><subject>Lasers</subject><subject>Machine learning</subject><subject>Machines</subject><subject>Manufacturing</subject><subject>Mechanical Engineering</subject><subject>Medical imaging</subject><subject>Neural networks</subject><subject>Performance evaluation</subject><subject>Plant layout</subject><subject>Porosity</subject><subject>Processes</subject><subject>Quality standards</subject><subject>Two dimensional analysis</subject><subject>Unsupervised learning</subject><issn>0924-669X</issn><issn>1573-7497</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><sourceid>C6C</sourceid><recordid>eNp9kMlOwzAQhi0EEmV5AU6WuMAhYMeJEx8Ru1SJCyBulutMiktrB9tpKQ_BM2MIEpw4jTT_MpoPoQNKTigh1WmgpKhFRvIiIyUvqux9A41oWbGsKkS1iUZEJIlz8bSNdkKYEUIYI3SEPh7dG8yzlQmAA0wXYKOKxlncOo87510wcY2NXUKIZjpIrsWqaUw0S8ALZftW6dh7aHCnfAx4ZeIzZhe4t6HvwC9TdYOVbfBRA9DN18f4z95C79U8jbhy_iXsoa1WzQPs_8xd9HB1eX9-k43vrm_Pz8aZzosiZlrTUokGCK01q1Wu9YSKCWMlq8tKwKRuORFMVExwUgjgBa9zPoGS6JwrLUq2iw6H3s671z79Jmeu9zadlIzmyZ1qquTKB5dOHIKHVnbeLJRfS0rkF3c5cJeJu_zmLt9TiA2hkMx2Cv63-p_UJwtWifQ</recordid><startdate>20241201</startdate><enddate>20241201</enddate><creator>Iuso, Domenico</creator><creator>Chatterjee, Soumick</creator><creator>Cornelissen, Sven</creator><creator>Verhees, Dries</creator><creator>Beenhouwer, Jan De</creator><creator>Sijbers, Jan</creator><general>Springer US</general><general>Springer Nature B.V</general><scope>C6C</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><orcidid>https://orcid.org/0000-0001-7919-7878</orcidid></search><sort><creationdate>20241201</creationdate><title>Voxel-wise segmentation for porosity investigation of additive manufactured parts with 3D unsupervised and (deeply) supervised neural networks</title><author>Iuso, Domenico ; Chatterjee, Soumick ; Cornelissen, Sven ; Verhees, Dries ; Beenhouwer, Jan De ; Sijbers, Jan</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c244t-cc15a9de018c38a2ccb19b33538579eb8f609397396049e646826be50c26ac953</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>3-D printers</topic><topic>Additive manufacturing</topic><topic>Algorithms</topic><topic>Anomalies</topic><topic>Artificial Intelligence</topic><topic>Benchmarks</topic><topic>Computed tomography</topic><topic>Computer Science</topic><topic>Deep learning</topic><topic>Image processing</topic><topic>Image quality</topic><topic>Image segmentation</topic><topic>Lasers</topic><topic>Machine learning</topic><topic>Machines</topic><topic>Manufacturing</topic><topic>Mechanical Engineering</topic><topic>Medical imaging</topic><topic>Neural networks</topic><topic>Performance evaluation</topic><topic>Plant layout</topic><topic>Porosity</topic><topic>Processes</topic><topic>Quality standards</topic><topic>Two dimensional analysis</topic><topic>Unsupervised learning</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Iuso, Domenico</creatorcontrib><creatorcontrib>Chatterjee, Soumick</creatorcontrib><creatorcontrib>Cornelissen, Sven</creatorcontrib><creatorcontrib>Verhees, Dries</creatorcontrib><creatorcontrib>Beenhouwer, Jan De</creatorcontrib><creatorcontrib>Sijbers, Jan</creatorcontrib><collection>Springer Nature OA Free Journals</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>Applied intelligence (Dordrecht, Netherlands)</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Iuso, Domenico</au><au>Chatterjee, Soumick</au><au>Cornelissen, Sven</au><au>Verhees, Dries</au><au>Beenhouwer, Jan De</au><au>Sijbers, Jan</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Voxel-wise segmentation for porosity investigation of additive manufactured parts with 3D unsupervised and (deeply) supervised neural networks</atitle><jtitle>Applied intelligence (Dordrecht, Netherlands)</jtitle><stitle>Appl Intell</stitle><date>2024-12-01</date><risdate>2024</risdate><volume>54</volume><issue>24</issue><spage>13160</spage><epage>13177</epage><pages>13160-13177</pages><issn>0924-669X</issn><eissn>1573-7497</eissn><abstract>Additive Manufacturing (AM) has emerged as a manufacturing process that allows the direct production of samples from digital models. To ensure that quality standards are met in all samples of a batch, X-ray computed tomography (X-CT) is often used in combination with automated anomaly detection. For the latter, deep learning (DL) anomaly detection techniques are increasingly used, as they can be trained to be robust to the material being analysed and resilient to poor image quality. Unfortunately, most recent and popular DL models have been developed for 2D image processing, thereby disregarding valuable volumetric information. Additionally, there is a notable absence of comparisons between supervised and unsupervised models for voxel-wise pore segmentation tasks. This study revisits recent supervised (UNet, UNet++, UNet 3+, MSS-UNet, ACC-UNet) and unsupervised (VAE, ceVAE, gmVAE, vqVAE, RV-VAE) DL models for porosity analysis of AM samples from X-CT images and extends them to accept 3D input data with a 3D-patch approach for lower computational requirements, improved efficiency and generalisability. The supervised models were trained using the Focal Tversky loss to address class imbalance that arises from the low porosity in the training datasets. The output of the unsupervised models was post-processed to reduce misclassifications caused by their inability to adequately represent the object surface. The findings were cross-validated in a 5-fold fashion and include: a performance benchmark of the DL models, an evaluation of the post-processing algorithm, an evaluation of the effect of training supervised models with the output of unsupervised models. In a final performance benchmark on a test set with poor image quality, the best performing supervised model was UNet++ with an average precision of 0.751 ± 0.030, while the best unsupervised model was the post-processed ceVAE with 0.830 ± 0.003. Notably, the ceVAE model, with its post-processing technique, exhibited superior capabilities, endorsing unsupervised learning as the preferred approach for the voxel-wise pore segmentation task.</abstract><cop>New York</cop><pub>Springer US</pub><doi>10.1007/s10489-024-05647-z</doi><tpages>18</tpages><orcidid>https://orcid.org/0000-0001-7919-7878</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 0924-669X
ispartof Applied intelligence (Dordrecht, Netherlands), 2024-12, Vol.54 (24), p.13160-13177
issn 0924-669X
1573-7497
language eng
recordid cdi_proquest_journals_3126825797
source SpringerLink Journals - AutoHoldings
subjects 3-D printers
Additive manufacturing
Algorithms
Anomalies
Artificial Intelligence
Benchmarks
Computed tomography
Computer Science
Deep learning
Image processing
Image quality
Image segmentation
Lasers
Machine learning
Machines
Manufacturing
Mechanical Engineering
Medical imaging
Neural networks
Performance evaluation
Plant layout
Porosity
Processes
Quality standards
Two dimensional analysis
Unsupervised learning
title Voxel-wise segmentation for porosity investigation of additive manufactured parts with 3D unsupervised and (deeply) supervised neural networks
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-31T17%3A38%3A05IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Voxel-wise%20segmentation%20for%20porosity%20investigation%20of%20additive%20manufactured%20parts%20with%203D%20unsupervised%20and%20(deeply)%20supervised%20neural%20networks&rft.jtitle=Applied%20intelligence%20(Dordrecht,%20Netherlands)&rft.au=Iuso,%20Domenico&rft.date=2024-12-01&rft.volume=54&rft.issue=24&rft.spage=13160&rft.epage=13177&rft.pages=13160-13177&rft.issn=0924-669X&rft.eissn=1573-7497&rft_id=info:doi/10.1007/s10489-024-05647-z&rft_dat=%3Cproquest_cross%3E3126825797%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=3126825797&rft_id=info:pmid/&rfr_iscdi=true