Object Detection Using Structure-Preserving Wavelet Pyramid Reflection Removal Network
Images shot through glass will produce reflections. However, these reflections will cause the objects in the images to be unrecognizable. Hence, to improve the recognition rate, the reflections in the images should be removed. Reflection removal has been widely used in the field of deep learning. Al...
Gespeichert in:
Veröffentlicht in: | IEEE transactions on instrumentation and measurement 2022, Vol.71, p.1-11 |
---|---|
Hauptverfasser: | , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 11 |
---|---|
container_issue | |
container_start_page | 1 |
container_title | IEEE transactions on instrumentation and measurement |
container_volume | 71 |
creator | Hsu, Wei-Yen Wu, Wan-Jia |
description | Images shot through glass will produce reflections. However, these reflections will cause the objects in the images to be unrecognizable. Hence, to improve the recognition rate, the reflections in the images should be removed. Reflection removal has been widely used in the field of deep learning. Although these methods have good results, they all assume that reflection removal is performed in a specific situation and provide their own datasets for research, such as strong reflections in some local areas, and this limitation will lead to the inability to effectively remove the reflections in the real world, which will affect the recognition of objects. To address this issue, we propose a novel structure-preserving wavelet pyramid reflection removal network (SpWPRRNet) to achieve effective background structure preservation and reflection removal to further improve the object recognition rate in images. After wavelet decomposition, we put the high- and low-frequency images of each level into reflection layer removal and detail enhancement subnetwork (RDSn) and structure preservation subnetwork (SPSn), respectively, and then use structure-level fusion (SLF) and inverse stationary wavelet transform (ISWT) to restore clean images recursively. In addition, to further separate the reflection layer and the transmission layer, we propose the reflection layer information transmission (RLIT), through which the reflection layer features of the high-frequency images can be extracted to help the SPSn to effectively separate these two layers to achieve the results of reflection removal and improve object recognition rate. The experimental results indicate that the proposed method can greatly improve the object recognition rate in images. |
doi_str_mv | 10.1109/TIM.2022.3204081 |
format | Article |
fullrecord | <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_crossref_primary_10_1109_TIM_2022_3204081</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>9875364</ieee_id><sourcerecordid>2717160562</sourcerecordid><originalsourceid>FETCH-LOGICAL-c254t-70076dae7f7bbbeee281c840a468746d1f734fe07ce12ea4387865c1249499cb3</originalsourceid><addsrcrecordid>eNo9kN1LwzAUxYMoOKfvgi8Fnztv0jRJH2V-DaYbc9PHkGa30tmtM0kn--9t2fDpwOWccw8_Qq4pDCiF7G4-eh0wYGyQMOCg6Anp0TSVcSYEOyU9AKrijKfinFx4vwIAKbjskY9JvkIbogcMrZT1Jlr4cvMVvQfX2NA4jKcOPbpdd_w0O6wwRNO9M-tyGc2wqI6pGa7rnamiNwy_tfu-JGeFqTxeHbVPFk-P8-FLPJ48j4b349iylIdYdjOWBmUh8zxHRKaoVRwMF0pysaSFTHiBIC1ShoYnSiqRWsp4xrPM5kmf3B56t67-adAHvaobt2lfaiappAJSwVoXHFzW1d47LPTWlWvj9pqC7ujplp7u6OkjvTZyc4iU7ap_e6Zkmgie_AHDXWt3</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2717160562</pqid></control><display><type>article</type><title>Object Detection Using Structure-Preserving Wavelet Pyramid Reflection Removal Network</title><source>IEEE Electronic Library (IEL)</source><creator>Hsu, Wei-Yen ; Wu, Wan-Jia</creator><creatorcontrib>Hsu, Wei-Yen ; Wu, Wan-Jia</creatorcontrib><description>Images shot through glass will produce reflections. However, these reflections will cause the objects in the images to be unrecognizable. Hence, to improve the recognition rate, the reflections in the images should be removed. Reflection removal has been widely used in the field of deep learning. Although these methods have good results, they all assume that reflection removal is performed in a specific situation and provide their own datasets for research, such as strong reflections in some local areas, and this limitation will lead to the inability to effectively remove the reflections in the real world, which will affect the recognition of objects. To address this issue, we propose a novel structure-preserving wavelet pyramid reflection removal network (SpWPRRNet) to achieve effective background structure preservation and reflection removal to further improve the object recognition rate in images. After wavelet decomposition, we put the high- and low-frequency images of each level into reflection layer removal and detail enhancement subnetwork (RDSn) and structure preservation subnetwork (SPSn), respectively, and then use structure-level fusion (SLF) and inverse stationary wavelet transform (ISWT) to restore clean images recursively. In addition, to further separate the reflection layer and the transmission layer, we propose the reflection layer information transmission (RLIT), through which the reflection layer features of the high-frequency images can be extracted to help the SPSn to effectively separate these two layers to achieve the results of reflection removal and improve object recognition rate. The experimental results indicate that the proposed method can greatly improve the object recognition rate in images.</description><identifier>ISSN: 0018-9456</identifier><identifier>EISSN: 1557-9662</identifier><identifier>DOI: 10.1109/TIM.2022.3204081</identifier><identifier>CODEN: IEIMAO</identifier><language>eng</language><publisher>New York: IEEE</publisher><subject>Deep learning ; Feature extraction ; Glass ; Image enhancement ; Image restoration ; Machine learning ; Object detection ; Object recognition ; Reflection ; reflection removal ; structure preservation ; Wave reflection ; wavelet pyramid ; Wavelet transforms</subject><ispartof>IEEE transactions on instrumentation and measurement, 2022, Vol.71, p.1-11</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2022</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c254t-70076dae7f7bbbeee281c840a468746d1f734fe07ce12ea4387865c1249499cb3</citedby><cites>FETCH-LOGICAL-c254t-70076dae7f7bbbeee281c840a468746d1f734fe07ce12ea4387865c1249499cb3</cites><orcidid>0000-0001-8681-3317 ; 0000-0002-4599-0744</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/9875364$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,778,782,794,4012,27910,27911,27912,54745</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/9875364$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Hsu, Wei-Yen</creatorcontrib><creatorcontrib>Wu, Wan-Jia</creatorcontrib><title>Object Detection Using Structure-Preserving Wavelet Pyramid Reflection Removal Network</title><title>IEEE transactions on instrumentation and measurement</title><addtitle>TIM</addtitle><description>Images shot through glass will produce reflections. However, these reflections will cause the objects in the images to be unrecognizable. Hence, to improve the recognition rate, the reflections in the images should be removed. Reflection removal has been widely used in the field of deep learning. Although these methods have good results, they all assume that reflection removal is performed in a specific situation and provide their own datasets for research, such as strong reflections in some local areas, and this limitation will lead to the inability to effectively remove the reflections in the real world, which will affect the recognition of objects. To address this issue, we propose a novel structure-preserving wavelet pyramid reflection removal network (SpWPRRNet) to achieve effective background structure preservation and reflection removal to further improve the object recognition rate in images. After wavelet decomposition, we put the high- and low-frequency images of each level into reflection layer removal and detail enhancement subnetwork (RDSn) and structure preservation subnetwork (SPSn), respectively, and then use structure-level fusion (SLF) and inverse stationary wavelet transform (ISWT) to restore clean images recursively. In addition, to further separate the reflection layer and the transmission layer, we propose the reflection layer information transmission (RLIT), through which the reflection layer features of the high-frequency images can be extracted to help the SPSn to effectively separate these two layers to achieve the results of reflection removal and improve object recognition rate. The experimental results indicate that the proposed method can greatly improve the object recognition rate in images.</description><subject>Deep learning</subject><subject>Feature extraction</subject><subject>Glass</subject><subject>Image enhancement</subject><subject>Image restoration</subject><subject>Machine learning</subject><subject>Object detection</subject><subject>Object recognition</subject><subject>Reflection</subject><subject>reflection removal</subject><subject>structure preservation</subject><subject>Wave reflection</subject><subject>wavelet pyramid</subject><subject>Wavelet transforms</subject><issn>0018-9456</issn><issn>1557-9662</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNo9kN1LwzAUxYMoOKfvgi8Fnztv0jRJH2V-DaYbc9PHkGa30tmtM0kn--9t2fDpwOWccw8_Qq4pDCiF7G4-eh0wYGyQMOCg6Anp0TSVcSYEOyU9AKrijKfinFx4vwIAKbjskY9JvkIbogcMrZT1Jlr4cvMVvQfX2NA4jKcOPbpdd_w0O6wwRNO9M-tyGc2wqI6pGa7rnamiNwy_tfu-JGeFqTxeHbVPFk-P8-FLPJ48j4b349iylIdYdjOWBmUh8zxHRKaoVRwMF0pysaSFTHiBIC1ShoYnSiqRWsp4xrPM5kmf3B56t67-adAHvaobt2lfaiappAJSwVoXHFzW1d47LPTWlWvj9pqC7ujplp7u6OkjvTZyc4iU7ap_e6Zkmgie_AHDXWt3</recordid><startdate>2022</startdate><enddate>2022</enddate><creator>Hsu, Wei-Yen</creator><creator>Wu, Wan-Jia</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SP</scope><scope>7U5</scope><scope>8FD</scope><scope>L7M</scope><orcidid>https://orcid.org/0000-0001-8681-3317</orcidid><orcidid>https://orcid.org/0000-0002-4599-0744</orcidid></search><sort><creationdate>2022</creationdate><title>Object Detection Using Structure-Preserving Wavelet Pyramid Reflection Removal Network</title><author>Hsu, Wei-Yen ; Wu, Wan-Jia</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c254t-70076dae7f7bbbeee281c840a468746d1f734fe07ce12ea4387865c1249499cb3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>Deep learning</topic><topic>Feature extraction</topic><topic>Glass</topic><topic>Image enhancement</topic><topic>Image restoration</topic><topic>Machine learning</topic><topic>Object detection</topic><topic>Object recognition</topic><topic>Reflection</topic><topic>reflection removal</topic><topic>structure preservation</topic><topic>Wave reflection</topic><topic>wavelet pyramid</topic><topic>Wavelet transforms</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Hsu, Wei-Yen</creatorcontrib><creatorcontrib>Wu, Wan-Jia</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Electronics & Communications Abstracts</collection><collection>Solid State and Superconductivity Abstracts</collection><collection>Technology Research Database</collection><collection>Advanced Technologies Database with Aerospace</collection><jtitle>IEEE transactions on instrumentation and measurement</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Hsu, Wei-Yen</au><au>Wu, Wan-Jia</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Object Detection Using Structure-Preserving Wavelet Pyramid Reflection Removal Network</atitle><jtitle>IEEE transactions on instrumentation and measurement</jtitle><stitle>TIM</stitle><date>2022</date><risdate>2022</risdate><volume>71</volume><spage>1</spage><epage>11</epage><pages>1-11</pages><issn>0018-9456</issn><eissn>1557-9662</eissn><coden>IEIMAO</coden><abstract>Images shot through glass will produce reflections. However, these reflections will cause the objects in the images to be unrecognizable. Hence, to improve the recognition rate, the reflections in the images should be removed. Reflection removal has been widely used in the field of deep learning. Although these methods have good results, they all assume that reflection removal is performed in a specific situation and provide their own datasets for research, such as strong reflections in some local areas, and this limitation will lead to the inability to effectively remove the reflections in the real world, which will affect the recognition of objects. To address this issue, we propose a novel structure-preserving wavelet pyramid reflection removal network (SpWPRRNet) to achieve effective background structure preservation and reflection removal to further improve the object recognition rate in images. After wavelet decomposition, we put the high- and low-frequency images of each level into reflection layer removal and detail enhancement subnetwork (RDSn) and structure preservation subnetwork (SPSn), respectively, and then use structure-level fusion (SLF) and inverse stationary wavelet transform (ISWT) to restore clean images recursively. In addition, to further separate the reflection layer and the transmission layer, we propose the reflection layer information transmission (RLIT), through which the reflection layer features of the high-frequency images can be extracted to help the SPSn to effectively separate these two layers to achieve the results of reflection removal and improve object recognition rate. The experimental results indicate that the proposed method can greatly improve the object recognition rate in images.</abstract><cop>New York</cop><pub>IEEE</pub><doi>10.1109/TIM.2022.3204081</doi><tpages>11</tpages><orcidid>https://orcid.org/0000-0001-8681-3317</orcidid><orcidid>https://orcid.org/0000-0002-4599-0744</orcidid></addata></record> |
fulltext | fulltext_linktorsrc |
identifier | ISSN: 0018-9456 |
ispartof | IEEE transactions on instrumentation and measurement, 2022, Vol.71, p.1-11 |
issn | 0018-9456 1557-9662 |
language | eng |
recordid | cdi_crossref_primary_10_1109_TIM_2022_3204081 |
source | IEEE Electronic Library (IEL) |
subjects | Deep learning Feature extraction Glass Image enhancement Image restoration Machine learning Object detection Object recognition Reflection reflection removal structure preservation Wave reflection wavelet pyramid Wavelet transforms |
title | Object Detection Using Structure-Preserving Wavelet Pyramid Reflection Removal Network |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-15T11%3A58%3A28IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Object%20Detection%20Using%20Structure-Preserving%20Wavelet%20Pyramid%20Reflection%20Removal%20Network&rft.jtitle=IEEE%20transactions%20on%20instrumentation%20and%20measurement&rft.au=Hsu,%20Wei-Yen&rft.date=2022&rft.volume=71&rft.spage=1&rft.epage=11&rft.pages=1-11&rft.issn=0018-9456&rft.eissn=1557-9662&rft.coden=IEIMAO&rft_id=info:doi/10.1109/TIM.2022.3204081&rft_dat=%3Cproquest_RIE%3E2717160562%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2717160562&rft_id=info:pmid/&rft_ieee_id=9875364&rfr_iscdi=true |