Object Detection Using Structure-Preserving Wavelet Pyramid Reflection Removal Network

Images shot through glass will produce reflections. However, these reflections will cause the objects in the images to be unrecognizable. Hence, to improve the recognition rate, the reflections in the images should be removed. Reflection removal has been widely used in the field of deep learning. Al...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on instrumentation and measurement 2022, Vol.71, p.1-11
Hauptverfasser: Hsu, Wei-Yen, Wu, Wan-Jia
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 11
container_issue
container_start_page 1
container_title IEEE transactions on instrumentation and measurement
container_volume 71
creator Hsu, Wei-Yen
Wu, Wan-Jia
description Images shot through glass will produce reflections. However, these reflections will cause the objects in the images to be unrecognizable. Hence, to improve the recognition rate, the reflections in the images should be removed. Reflection removal has been widely used in the field of deep learning. Although these methods have good results, they all assume that reflection removal is performed in a specific situation and provide their own datasets for research, such as strong reflections in some local areas, and this limitation will lead to the inability to effectively remove the reflections in the real world, which will affect the recognition of objects. To address this issue, we propose a novel structure-preserving wavelet pyramid reflection removal network (SpWPRRNet) to achieve effective background structure preservation and reflection removal to further improve the object recognition rate in images. After wavelet decomposition, we put the high- and low-frequency images of each level into reflection layer removal and detail enhancement subnetwork (RDSn) and structure preservation subnetwork (SPSn), respectively, and then use structure-level fusion (SLF) and inverse stationary wavelet transform (ISWT) to restore clean images recursively. In addition, to further separate the reflection layer and the transmission layer, we propose the reflection layer information transmission (RLIT), through which the reflection layer features of the high-frequency images can be extracted to help the SPSn to effectively separate these two layers to achieve the results of reflection removal and improve object recognition rate. The experimental results indicate that the proposed method can greatly improve the object recognition rate in images.
doi_str_mv 10.1109/TIM.2022.3204081
format Article
fullrecord <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_crossref_primary_10_1109_TIM_2022_3204081</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>9875364</ieee_id><sourcerecordid>2717160562</sourcerecordid><originalsourceid>FETCH-LOGICAL-c254t-70076dae7f7bbbeee281c840a468746d1f734fe07ce12ea4387865c1249499cb3</originalsourceid><addsrcrecordid>eNo9kN1LwzAUxYMoOKfvgi8Fnztv0jRJH2V-DaYbc9PHkGa30tmtM0kn--9t2fDpwOWccw8_Qq4pDCiF7G4-eh0wYGyQMOCg6Anp0TSVcSYEOyU9AKrijKfinFx4vwIAKbjskY9JvkIbogcMrZT1Jlr4cvMVvQfX2NA4jKcOPbpdd_w0O6wwRNO9M-tyGc2wqI6pGa7rnamiNwy_tfu-JGeFqTxeHbVPFk-P8-FLPJ48j4b349iylIdYdjOWBmUh8zxHRKaoVRwMF0pysaSFTHiBIC1ShoYnSiqRWsp4xrPM5kmf3B56t67-adAHvaobt2lfaiappAJSwVoXHFzW1d47LPTWlWvj9pqC7ujplp7u6OkjvTZyc4iU7ap_e6Zkmgie_AHDXWt3</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2717160562</pqid></control><display><type>article</type><title>Object Detection Using Structure-Preserving Wavelet Pyramid Reflection Removal Network</title><source>IEEE Electronic Library (IEL)</source><creator>Hsu, Wei-Yen ; Wu, Wan-Jia</creator><creatorcontrib>Hsu, Wei-Yen ; Wu, Wan-Jia</creatorcontrib><description>Images shot through glass will produce reflections. However, these reflections will cause the objects in the images to be unrecognizable. Hence, to improve the recognition rate, the reflections in the images should be removed. Reflection removal has been widely used in the field of deep learning. Although these methods have good results, they all assume that reflection removal is performed in a specific situation and provide their own datasets for research, such as strong reflections in some local areas, and this limitation will lead to the inability to effectively remove the reflections in the real world, which will affect the recognition of objects. To address this issue, we propose a novel structure-preserving wavelet pyramid reflection removal network (SpWPRRNet) to achieve effective background structure preservation and reflection removal to further improve the object recognition rate in images. After wavelet decomposition, we put the high- and low-frequency images of each level into reflection layer removal and detail enhancement subnetwork (RDSn) and structure preservation subnetwork (SPSn), respectively, and then use structure-level fusion (SLF) and inverse stationary wavelet transform (ISWT) to restore clean images recursively. In addition, to further separate the reflection layer and the transmission layer, we propose the reflection layer information transmission (RLIT), through which the reflection layer features of the high-frequency images can be extracted to help the SPSn to effectively separate these two layers to achieve the results of reflection removal and improve object recognition rate. The experimental results indicate that the proposed method can greatly improve the object recognition rate in images.</description><identifier>ISSN: 0018-9456</identifier><identifier>EISSN: 1557-9662</identifier><identifier>DOI: 10.1109/TIM.2022.3204081</identifier><identifier>CODEN: IEIMAO</identifier><language>eng</language><publisher>New York: IEEE</publisher><subject>Deep learning ; Feature extraction ; Glass ; Image enhancement ; Image restoration ; Machine learning ; Object detection ; Object recognition ; Reflection ; reflection removal ; structure preservation ; Wave reflection ; wavelet pyramid ; Wavelet transforms</subject><ispartof>IEEE transactions on instrumentation and measurement, 2022, Vol.71, p.1-11</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2022</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c254t-70076dae7f7bbbeee281c840a468746d1f734fe07ce12ea4387865c1249499cb3</citedby><cites>FETCH-LOGICAL-c254t-70076dae7f7bbbeee281c840a468746d1f734fe07ce12ea4387865c1249499cb3</cites><orcidid>0000-0001-8681-3317 ; 0000-0002-4599-0744</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/9875364$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,778,782,794,4012,27910,27911,27912,54745</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/9875364$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Hsu, Wei-Yen</creatorcontrib><creatorcontrib>Wu, Wan-Jia</creatorcontrib><title>Object Detection Using Structure-Preserving Wavelet Pyramid Reflection Removal Network</title><title>IEEE transactions on instrumentation and measurement</title><addtitle>TIM</addtitle><description>Images shot through glass will produce reflections. However, these reflections will cause the objects in the images to be unrecognizable. Hence, to improve the recognition rate, the reflections in the images should be removed. Reflection removal has been widely used in the field of deep learning. Although these methods have good results, they all assume that reflection removal is performed in a specific situation and provide their own datasets for research, such as strong reflections in some local areas, and this limitation will lead to the inability to effectively remove the reflections in the real world, which will affect the recognition of objects. To address this issue, we propose a novel structure-preserving wavelet pyramid reflection removal network (SpWPRRNet) to achieve effective background structure preservation and reflection removal to further improve the object recognition rate in images. After wavelet decomposition, we put the high- and low-frequency images of each level into reflection layer removal and detail enhancement subnetwork (RDSn) and structure preservation subnetwork (SPSn), respectively, and then use structure-level fusion (SLF) and inverse stationary wavelet transform (ISWT) to restore clean images recursively. In addition, to further separate the reflection layer and the transmission layer, we propose the reflection layer information transmission (RLIT), through which the reflection layer features of the high-frequency images can be extracted to help the SPSn to effectively separate these two layers to achieve the results of reflection removal and improve object recognition rate. The experimental results indicate that the proposed method can greatly improve the object recognition rate in images.</description><subject>Deep learning</subject><subject>Feature extraction</subject><subject>Glass</subject><subject>Image enhancement</subject><subject>Image restoration</subject><subject>Machine learning</subject><subject>Object detection</subject><subject>Object recognition</subject><subject>Reflection</subject><subject>reflection removal</subject><subject>structure preservation</subject><subject>Wave reflection</subject><subject>wavelet pyramid</subject><subject>Wavelet transforms</subject><issn>0018-9456</issn><issn>1557-9662</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNo9kN1LwzAUxYMoOKfvgi8Fnztv0jRJH2V-DaYbc9PHkGa30tmtM0kn--9t2fDpwOWccw8_Qq4pDCiF7G4-eh0wYGyQMOCg6Anp0TSVcSYEOyU9AKrijKfinFx4vwIAKbjskY9JvkIbogcMrZT1Jlr4cvMVvQfX2NA4jKcOPbpdd_w0O6wwRNO9M-tyGc2wqI6pGa7rnamiNwy_tfu-JGeFqTxeHbVPFk-P8-FLPJ48j4b349iylIdYdjOWBmUh8zxHRKaoVRwMF0pysaSFTHiBIC1ShoYnSiqRWsp4xrPM5kmf3B56t67-adAHvaobt2lfaiappAJSwVoXHFzW1d47LPTWlWvj9pqC7ujplp7u6OkjvTZyc4iU7ap_e6Zkmgie_AHDXWt3</recordid><startdate>2022</startdate><enddate>2022</enddate><creator>Hsu, Wei-Yen</creator><creator>Wu, Wan-Jia</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SP</scope><scope>7U5</scope><scope>8FD</scope><scope>L7M</scope><orcidid>https://orcid.org/0000-0001-8681-3317</orcidid><orcidid>https://orcid.org/0000-0002-4599-0744</orcidid></search><sort><creationdate>2022</creationdate><title>Object Detection Using Structure-Preserving Wavelet Pyramid Reflection Removal Network</title><author>Hsu, Wei-Yen ; Wu, Wan-Jia</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c254t-70076dae7f7bbbeee281c840a468746d1f734fe07ce12ea4387865c1249499cb3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>Deep learning</topic><topic>Feature extraction</topic><topic>Glass</topic><topic>Image enhancement</topic><topic>Image restoration</topic><topic>Machine learning</topic><topic>Object detection</topic><topic>Object recognition</topic><topic>Reflection</topic><topic>reflection removal</topic><topic>structure preservation</topic><topic>Wave reflection</topic><topic>wavelet pyramid</topic><topic>Wavelet transforms</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Hsu, Wei-Yen</creatorcontrib><creatorcontrib>Wu, Wan-Jia</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Electronics &amp; Communications Abstracts</collection><collection>Solid State and Superconductivity Abstracts</collection><collection>Technology Research Database</collection><collection>Advanced Technologies Database with Aerospace</collection><jtitle>IEEE transactions on instrumentation and measurement</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Hsu, Wei-Yen</au><au>Wu, Wan-Jia</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Object Detection Using Structure-Preserving Wavelet Pyramid Reflection Removal Network</atitle><jtitle>IEEE transactions on instrumentation and measurement</jtitle><stitle>TIM</stitle><date>2022</date><risdate>2022</risdate><volume>71</volume><spage>1</spage><epage>11</epage><pages>1-11</pages><issn>0018-9456</issn><eissn>1557-9662</eissn><coden>IEIMAO</coden><abstract>Images shot through glass will produce reflections. However, these reflections will cause the objects in the images to be unrecognizable. Hence, to improve the recognition rate, the reflections in the images should be removed. Reflection removal has been widely used in the field of deep learning. Although these methods have good results, they all assume that reflection removal is performed in a specific situation and provide their own datasets for research, such as strong reflections in some local areas, and this limitation will lead to the inability to effectively remove the reflections in the real world, which will affect the recognition of objects. To address this issue, we propose a novel structure-preserving wavelet pyramid reflection removal network (SpWPRRNet) to achieve effective background structure preservation and reflection removal to further improve the object recognition rate in images. After wavelet decomposition, we put the high- and low-frequency images of each level into reflection layer removal and detail enhancement subnetwork (RDSn) and structure preservation subnetwork (SPSn), respectively, and then use structure-level fusion (SLF) and inverse stationary wavelet transform (ISWT) to restore clean images recursively. In addition, to further separate the reflection layer and the transmission layer, we propose the reflection layer information transmission (RLIT), through which the reflection layer features of the high-frequency images can be extracted to help the SPSn to effectively separate these two layers to achieve the results of reflection removal and improve object recognition rate. The experimental results indicate that the proposed method can greatly improve the object recognition rate in images.</abstract><cop>New York</cop><pub>IEEE</pub><doi>10.1109/TIM.2022.3204081</doi><tpages>11</tpages><orcidid>https://orcid.org/0000-0001-8681-3317</orcidid><orcidid>https://orcid.org/0000-0002-4599-0744</orcidid></addata></record>
fulltext fulltext_linktorsrc
identifier ISSN: 0018-9456
ispartof IEEE transactions on instrumentation and measurement, 2022, Vol.71, p.1-11
issn 0018-9456
1557-9662
language eng
recordid cdi_crossref_primary_10_1109_TIM_2022_3204081
source IEEE Electronic Library (IEL)
subjects Deep learning
Feature extraction
Glass
Image enhancement
Image restoration
Machine learning
Object detection
Object recognition
Reflection
reflection removal
structure preservation
Wave reflection
wavelet pyramid
Wavelet transforms
title Object Detection Using Structure-Preserving Wavelet Pyramid Reflection Removal Network
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-15T11%3A58%3A28IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Object%20Detection%20Using%20Structure-Preserving%20Wavelet%20Pyramid%20Reflection%20Removal%20Network&rft.jtitle=IEEE%20transactions%20on%20instrumentation%20and%20measurement&rft.au=Hsu,%20Wei-Yen&rft.date=2022&rft.volume=71&rft.spage=1&rft.epage=11&rft.pages=1-11&rft.issn=0018-9456&rft.eissn=1557-9662&rft.coden=IEIMAO&rft_id=info:doi/10.1109/TIM.2022.3204081&rft_dat=%3Cproquest_RIE%3E2717160562%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2717160562&rft_id=info:pmid/&rft_ieee_id=9875364&rfr_iscdi=true