Deep learning approaches for thermographic imaging

In this paper, we investigate two deep learning approaches to recovering initial temperature profiles from thermographic images in non-destructive material testing. First, we trained a deep neural network (DNN) in an end-to-end fashion by directly feeding the surface temperature measurements to the...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Journal of applied physics 2020-10, Vol.128 (15)
Hauptverfasser: Kovács, Péter, Lehner, Bernhard, Thummerer, Gregor, Mayr, Günther, Burgholzer, Peter, Huemer, Mario
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue 15
container_start_page
container_title Journal of applied physics
container_volume 128
creator Kovács, Péter
Lehner, Bernhard
Thummerer, Gregor
Mayr, Günther
Burgholzer, Peter
Huemer, Mario
description In this paper, we investigate two deep learning approaches to recovering initial temperature profiles from thermographic images in non-destructive material testing. First, we trained a deep neural network (DNN) in an end-to-end fashion by directly feeding the surface temperature measurements to the DNN. Second, we turned the surface temperature measurements into virtual waves (a recently developed concept in thermography), which we then fed to the DNN. To demonstrate the effectiveness of these methods, we implemented a data generator and created a dataset comprising a total of 100 000 simulated temperature measurement images. With the objective of determining a suitable baseline, we investigated several state-of-the-art model-based reconstruction methods, including Abel transformation, curvelet denoising, and time- and frequency-domain synthetic aperture focusing techniques. Additionally, a physical phantom was created to support evaluation on completely unseen real-world data. The results of several experiments suggest that both the end-to-end and the hybrid approach outperformed the baseline in terms of reconstruction accuracy. The end-to-end approach required the least amount of domain knowledge and was the most computationally efficient one. The hybrid approach required extensive domain knowledge and was more computationally expensive than the end-to-end approach. However, the virtual waves served as meaningful features that convert the complex task of the end-to-end reconstruction into a less demanding undertaking. This in turn yielded better reconstructions with the same number of training samples compared to the end-to-end approach. Additionally, it allowed more compact network architectures and use of prior knowledge, such as sparsity and non-negativity. The proposed method is suitable for non-destructive testing (NDT) in 2D where the amplitudes along the objects are considered to be constant (e.g., for metallic wires). To encourage the development of other deep-learning-based reconstruction techniques, we release both the synthetic and the real-world datasets along with the implementation of the deep learning methods to the research community.
doi_str_mv 10.1063/5.0020404
format Article
fullrecord <record><control><sourceid>proquest_scita</sourceid><recordid>TN_cdi_scitation_primary_10_1063_5_0020404</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2451444384</sourcerecordid><originalsourceid>FETCH-LOGICAL-c362t-b7c40c5f36f92f935c28329a2c7351c8e8cac6822ea54e5ac77f83dd6d964da33</originalsourceid><addsrcrecordid>eNp90E1LxDAQBuAgCq6rB_9BwZNC13w3Ocr6CQte9BziNGm77DY16Qr-eyNd9CB4Ghge3hlehM4JXhAs2bVYYEwxx_wAzQhWuqyEwIdolrekVLrSx-gkpTXGhCimZ4jeOjcUG2dj3_VNYYchBgutS4UPsRhbF7ehiXZoOyi6rW0yOkVH3m6SO9vPOXq9v3tZPpar54en5c2qBCbpWL5VwDEIz6TX1GsmgCpGtaVQMUFAOQUWpKLUWcGdsFBVXrG6lrWWvLaMzdHFlJtfet-5NJp12MU-nzSUC8I5Z4pndTkpiCGl6LwZYn40fhqCzXclRph9JdleTTZBN9qxC_0P_gjxF5qh9v_hv8lfxzxuCQ</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2451444384</pqid></control><display><type>article</type><title>Deep learning approaches for thermographic imaging</title><source>AIP Journals Complete</source><source>Alma/SFX Local Collection</source><creator>Kovács, Péter ; Lehner, Bernhard ; Thummerer, Gregor ; Mayr, Günther ; Burgholzer, Peter ; Huemer, Mario</creator><creatorcontrib>Kovács, Péter ; Lehner, Bernhard ; Thummerer, Gregor ; Mayr, Günther ; Burgholzer, Peter ; Huemer, Mario</creatorcontrib><description>In this paper, we investigate two deep learning approaches to recovering initial temperature profiles from thermographic images in non-destructive material testing. First, we trained a deep neural network (DNN) in an end-to-end fashion by directly feeding the surface temperature measurements to the DNN. Second, we turned the surface temperature measurements into virtual waves (a recently developed concept in thermography), which we then fed to the DNN. To demonstrate the effectiveness of these methods, we implemented a data generator and created a dataset comprising a total of 100 000 simulated temperature measurement images. With the objective of determining a suitable baseline, we investigated several state-of-the-art model-based reconstruction methods, including Abel transformation, curvelet denoising, and time- and frequency-domain synthetic aperture focusing techniques. Additionally, a physical phantom was created to support evaluation on completely unseen real-world data. The results of several experiments suggest that both the end-to-end and the hybrid approach outperformed the baseline in terms of reconstruction accuracy. The end-to-end approach required the least amount of domain knowledge and was the most computationally efficient one. The hybrid approach required extensive domain knowledge and was more computationally expensive than the end-to-end approach. However, the virtual waves served as meaningful features that convert the complex task of the end-to-end reconstruction into a less demanding undertaking. This in turn yielded better reconstructions with the same number of training samples compared to the end-to-end approach. Additionally, it allowed more compact network architectures and use of prior knowledge, such as sparsity and non-negativity. The proposed method is suitable for non-destructive testing (NDT) in 2D where the amplitudes along the objects are considered to be constant (e.g., for metallic wires). To encourage the development of other deep-learning-based reconstruction techniques, we release both the synthetic and the real-world datasets along with the implementation of the deep learning methods to the research community.</description><identifier>ISSN: 0021-8979</identifier><identifier>EISSN: 1089-7550</identifier><identifier>DOI: 10.1063/5.0020404</identifier><identifier>CODEN: JAPIAU</identifier><language>eng</language><publisher>Melville: American Institute of Physics</publisher><subject>Applied physics ; Artificial neural networks ; Computer architecture ; Datasets ; Deep learning ; Destructive testing ; Image reconstruction ; Machine learning ; Noise reduction ; Nondestructive testing ; Surface temperature ; Synthetic apertures ; Temperature ; Temperature measurement ; Temperature profiles ; Thermal imaging ; Thermography</subject><ispartof>Journal of applied physics, 2020-10, Vol.128 (15)</ispartof><rights>Author(s)</rights><rights>2020 Author(s). All article content, except where otherwise noted, is licensed under a Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c362t-b7c40c5f36f92f935c28329a2c7351c8e8cac6822ea54e5ac77f83dd6d964da33</citedby><cites>FETCH-LOGICAL-c362t-b7c40c5f36f92f935c28329a2c7351c8e8cac6822ea54e5ac77f83dd6d964da33</cites><orcidid>0000-0003-2551-1686 ; 0000-0002-3164-7232 ; 0000-0002-0772-9721 ; 0000-0003-3383-803X ; 0000-0002-7754-7042 ; 0000-0002-6642-6448</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://pubs.aip.org/jap/article-lookup/doi/10.1063/5.0020404$$EHTML$$P50$$Gscitation$$Hfree_for_read</linktohtml><link.rule.ids>314,778,782,792,4500,27907,27908,76135</link.rule.ids></links><search><creatorcontrib>Kovács, Péter</creatorcontrib><creatorcontrib>Lehner, Bernhard</creatorcontrib><creatorcontrib>Thummerer, Gregor</creatorcontrib><creatorcontrib>Mayr, Günther</creatorcontrib><creatorcontrib>Burgholzer, Peter</creatorcontrib><creatorcontrib>Huemer, Mario</creatorcontrib><title>Deep learning approaches for thermographic imaging</title><title>Journal of applied physics</title><description>In this paper, we investigate two deep learning approaches to recovering initial temperature profiles from thermographic images in non-destructive material testing. First, we trained a deep neural network (DNN) in an end-to-end fashion by directly feeding the surface temperature measurements to the DNN. Second, we turned the surface temperature measurements into virtual waves (a recently developed concept in thermography), which we then fed to the DNN. To demonstrate the effectiveness of these methods, we implemented a data generator and created a dataset comprising a total of 100 000 simulated temperature measurement images. With the objective of determining a suitable baseline, we investigated several state-of-the-art model-based reconstruction methods, including Abel transformation, curvelet denoising, and time- and frequency-domain synthetic aperture focusing techniques. Additionally, a physical phantom was created to support evaluation on completely unseen real-world data. The results of several experiments suggest that both the end-to-end and the hybrid approach outperformed the baseline in terms of reconstruction accuracy. The end-to-end approach required the least amount of domain knowledge and was the most computationally efficient one. The hybrid approach required extensive domain knowledge and was more computationally expensive than the end-to-end approach. However, the virtual waves served as meaningful features that convert the complex task of the end-to-end reconstruction into a less demanding undertaking. This in turn yielded better reconstructions with the same number of training samples compared to the end-to-end approach. Additionally, it allowed more compact network architectures and use of prior knowledge, such as sparsity and non-negativity. The proposed method is suitable for non-destructive testing (NDT) in 2D where the amplitudes along the objects are considered to be constant (e.g., for metallic wires). To encourage the development of other deep-learning-based reconstruction techniques, we release both the synthetic and the real-world datasets along with the implementation of the deep learning methods to the research community.</description><subject>Applied physics</subject><subject>Artificial neural networks</subject><subject>Computer architecture</subject><subject>Datasets</subject><subject>Deep learning</subject><subject>Destructive testing</subject><subject>Image reconstruction</subject><subject>Machine learning</subject><subject>Noise reduction</subject><subject>Nondestructive testing</subject><subject>Surface temperature</subject><subject>Synthetic apertures</subject><subject>Temperature</subject><subject>Temperature measurement</subject><subject>Temperature profiles</subject><subject>Thermal imaging</subject><subject>Thermography</subject><issn>0021-8979</issn><issn>1089-7550</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2020</creationdate><recordtype>article</recordtype><recordid>eNp90E1LxDAQBuAgCq6rB_9BwZNC13w3Ocr6CQte9BziNGm77DY16Qr-eyNd9CB4Ghge3hlehM4JXhAs2bVYYEwxx_wAzQhWuqyEwIdolrekVLrSx-gkpTXGhCimZ4jeOjcUG2dj3_VNYYchBgutS4UPsRhbF7ehiXZoOyi6rW0yOkVH3m6SO9vPOXq9v3tZPpar54en5c2qBCbpWL5VwDEIz6TX1GsmgCpGtaVQMUFAOQUWpKLUWcGdsFBVXrG6lrWWvLaMzdHFlJtfet-5NJp12MU-nzSUC8I5Z4pndTkpiCGl6LwZYn40fhqCzXclRph9JdleTTZBN9qxC_0P_gjxF5qh9v_hv8lfxzxuCQ</recordid><startdate>20201021</startdate><enddate>20201021</enddate><creator>Kovács, Péter</creator><creator>Lehner, Bernhard</creator><creator>Thummerer, Gregor</creator><creator>Mayr, Günther</creator><creator>Burgholzer, Peter</creator><creator>Huemer, Mario</creator><general>American Institute of Physics</general><scope>AJDQP</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>8FD</scope><scope>H8D</scope><scope>L7M</scope><orcidid>https://orcid.org/0000-0003-2551-1686</orcidid><orcidid>https://orcid.org/0000-0002-3164-7232</orcidid><orcidid>https://orcid.org/0000-0002-0772-9721</orcidid><orcidid>https://orcid.org/0000-0003-3383-803X</orcidid><orcidid>https://orcid.org/0000-0002-7754-7042</orcidid><orcidid>https://orcid.org/0000-0002-6642-6448</orcidid></search><sort><creationdate>20201021</creationdate><title>Deep learning approaches for thermographic imaging</title><author>Kovács, Péter ; Lehner, Bernhard ; Thummerer, Gregor ; Mayr, Günther ; Burgholzer, Peter ; Huemer, Mario</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c362t-b7c40c5f36f92f935c28329a2c7351c8e8cac6822ea54e5ac77f83dd6d964da33</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2020</creationdate><topic>Applied physics</topic><topic>Artificial neural networks</topic><topic>Computer architecture</topic><topic>Datasets</topic><topic>Deep learning</topic><topic>Destructive testing</topic><topic>Image reconstruction</topic><topic>Machine learning</topic><topic>Noise reduction</topic><topic>Nondestructive testing</topic><topic>Surface temperature</topic><topic>Synthetic apertures</topic><topic>Temperature</topic><topic>Temperature measurement</topic><topic>Temperature profiles</topic><topic>Thermal imaging</topic><topic>Thermography</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Kovács, Péter</creatorcontrib><creatorcontrib>Lehner, Bernhard</creatorcontrib><creatorcontrib>Thummerer, Gregor</creatorcontrib><creatorcontrib>Mayr, Günther</creatorcontrib><creatorcontrib>Burgholzer, Peter</creatorcontrib><creatorcontrib>Huemer, Mario</creatorcontrib><collection>AIP Open Access Journals</collection><collection>CrossRef</collection><collection>Technology Research Database</collection><collection>Aerospace Database</collection><collection>Advanced Technologies Database with Aerospace</collection><jtitle>Journal of applied physics</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Kovács, Péter</au><au>Lehner, Bernhard</au><au>Thummerer, Gregor</au><au>Mayr, Günther</au><au>Burgholzer, Peter</au><au>Huemer, Mario</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Deep learning approaches for thermographic imaging</atitle><jtitle>Journal of applied physics</jtitle><date>2020-10-21</date><risdate>2020</risdate><volume>128</volume><issue>15</issue><issn>0021-8979</issn><eissn>1089-7550</eissn><coden>JAPIAU</coden><abstract>In this paper, we investigate two deep learning approaches to recovering initial temperature profiles from thermographic images in non-destructive material testing. First, we trained a deep neural network (DNN) in an end-to-end fashion by directly feeding the surface temperature measurements to the DNN. Second, we turned the surface temperature measurements into virtual waves (a recently developed concept in thermography), which we then fed to the DNN. To demonstrate the effectiveness of these methods, we implemented a data generator and created a dataset comprising a total of 100 000 simulated temperature measurement images. With the objective of determining a suitable baseline, we investigated several state-of-the-art model-based reconstruction methods, including Abel transformation, curvelet denoising, and time- and frequency-domain synthetic aperture focusing techniques. Additionally, a physical phantom was created to support evaluation on completely unseen real-world data. The results of several experiments suggest that both the end-to-end and the hybrid approach outperformed the baseline in terms of reconstruction accuracy. The end-to-end approach required the least amount of domain knowledge and was the most computationally efficient one. The hybrid approach required extensive domain knowledge and was more computationally expensive than the end-to-end approach. However, the virtual waves served as meaningful features that convert the complex task of the end-to-end reconstruction into a less demanding undertaking. This in turn yielded better reconstructions with the same number of training samples compared to the end-to-end approach. Additionally, it allowed more compact network architectures and use of prior knowledge, such as sparsity and non-negativity. The proposed method is suitable for non-destructive testing (NDT) in 2D where the amplitudes along the objects are considered to be constant (e.g., for metallic wires). To encourage the development of other deep-learning-based reconstruction techniques, we release both the synthetic and the real-world datasets along with the implementation of the deep learning methods to the research community.</abstract><cop>Melville</cop><pub>American Institute of Physics</pub><doi>10.1063/5.0020404</doi><tpages>16</tpages><orcidid>https://orcid.org/0000-0003-2551-1686</orcidid><orcidid>https://orcid.org/0000-0002-3164-7232</orcidid><orcidid>https://orcid.org/0000-0002-0772-9721</orcidid><orcidid>https://orcid.org/0000-0003-3383-803X</orcidid><orcidid>https://orcid.org/0000-0002-7754-7042</orcidid><orcidid>https://orcid.org/0000-0002-6642-6448</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 0021-8979
ispartof Journal of applied physics, 2020-10, Vol.128 (15)
issn 0021-8979
1089-7550
language eng
recordid cdi_scitation_primary_10_1063_5_0020404
source AIP Journals Complete; Alma/SFX Local Collection
subjects Applied physics
Artificial neural networks
Computer architecture
Datasets
Deep learning
Destructive testing
Image reconstruction
Machine learning
Noise reduction
Nondestructive testing
Surface temperature
Synthetic apertures
Temperature
Temperature measurement
Temperature profiles
Thermal imaging
Thermography
title Deep learning approaches for thermographic imaging
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-16T16%3A02%3A57IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_scita&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Deep%20learning%20approaches%20for%20thermographic%20imaging&rft.jtitle=Journal%20of%20applied%20physics&rft.au=Kov%C3%A1cs,%20P%C3%A9ter&rft.date=2020-10-21&rft.volume=128&rft.issue=15&rft.issn=0021-8979&rft.eissn=1089-7550&rft.coden=JAPIAU&rft_id=info:doi/10.1063/5.0020404&rft_dat=%3Cproquest_scita%3E2451444384%3C/proquest_scita%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2451444384&rft_id=info:pmid/&rfr_iscdi=true