Self-Paced Feature Attention Fusion Network for Concealed Object Detection in Millimeter-Wave Image
The active millimeter-wave (AMMW) scanner has been widely used for inspecting human security in public places in recent years owing to its ability to detect all kinds of objects under the clothes and be harmless to the body. However, it is really challenging to detect all concealed objects automatic...
Gespeichert in:
Veröffentlicht in: | IEEE transactions on circuits and systems for video technology 2022-01, Vol.32 (1), p.224-239 |
---|---|
Hauptverfasser: | , , , , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 239 |
---|---|
container_issue | 1 |
container_start_page | 224 |
container_title | IEEE transactions on circuits and systems for video technology |
container_volume | 32 |
creator | Wang, Xinlin Gou, Shuiping Li, Jichao Zhao, Yinghai Liu, Zhen Jiao, Changzhe Mao, Shasha |
description | The active millimeter-wave (AMMW) scanner has been widely used for inspecting human security in public places in recent years owing to its ability to detect all kinds of objects under the clothes and be harmless to the body. However, it is really challenging to detect all concealed objects automatically and accurately due to inherent imaging noise, unknown object kind, and uncertain position. Recently, many existing methods, especially deep learning-based, have achieved good performances on concealed object detection. These methods work well for detecting a few kinds of large objects, but fail to perform on dim and incomplete hard objects. To address this task, a concealed object detection model with self-paced feature attention fusion network (SPFAFN) is proposed in this article. To be specific, the features with different scales are fused in a top-down manner to integrate details and global semantics to better detect small objects. During fusing multi-scale features, a hierarchical pyramid attention mechanism composed of channel and spatial attention is developed to perceive the object. Moreover, boosting self-paced learning is exploited to guide the model to learn hard samples that are difficultly detected. The proposed method is validated on two real-world datasets: an AMMW dataset and a publicly available passive millimeter-wave (PMMW) dataset. Experimental results demonstrate that the proposed approach is superior to the state-of-the-art methods, and achieves better performances on the two datasets with Average Precision (AP). |
doi_str_mv | 10.1109/TCSVT.2021.3058246 |
format | Article |
fullrecord | <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_ieee_primary_9350607</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>9350607</ieee_id><sourcerecordid>2619023187</sourcerecordid><originalsourceid>FETCH-LOGICAL-c295t-c62801857e94f6dd8161476d897f3001140496001e89196cbc7169f4f80e64d63</originalsourceid><addsrcrecordid>eNo9kMFOwzAQRC0EEqXwA3CxxDnF69iOfawChUqFIrXAMUqdDUpJk-I4IP4el1acZrR6s7saQi6BjQCYuVmmi9fliDMOo5hJzYU6IgOQUkecM3kcPJMQaQ7ylJx13ZoxEFokA2IXWJfRc26xoBPMfe-Qjr3HxldtQyd9t5Mn9N-t-6Bl62jaNhbzOuDz1Rqtp7fog-ywqqGPVV1XmzBx0Vv-hXS6yd_xnJyUed3hxUGH5GVyt0wfotn8fpqOZ5HlRvrIKq4ZaJmgEaUqCg0KRKIKbZIyDg-DYMKoYFAbMMqubALKlKLUDJUoVDwk1_u9W9d-9tj5bN32rgknM67AMB6DTgLF95R1bdc5LLOtqza5-8mAZbsys78ys12Z2aHMELrahypE_A-YWDLFkvgX7dNu4w</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2619023187</pqid></control><display><type>article</type><title>Self-Paced Feature Attention Fusion Network for Concealed Object Detection in Millimeter-Wave Image</title><source>IEEE Electronic Library (IEL)</source><creator>Wang, Xinlin ; Gou, Shuiping ; Li, Jichao ; Zhao, Yinghai ; Liu, Zhen ; Jiao, Changzhe ; Mao, Shasha</creator><creatorcontrib>Wang, Xinlin ; Gou, Shuiping ; Li, Jichao ; Zhao, Yinghai ; Liu, Zhen ; Jiao, Changzhe ; Mao, Shasha</creatorcontrib><description>The active millimeter-wave (AMMW) scanner has been widely used for inspecting human security in public places in recent years owing to its ability to detect all kinds of objects under the clothes and be harmless to the body. However, it is really challenging to detect all concealed objects automatically and accurately due to inherent imaging noise, unknown object kind, and uncertain position. Recently, many existing methods, especially deep learning-based, have achieved good performances on concealed object detection. These methods work well for detecting a few kinds of large objects, but fail to perform on dim and incomplete hard objects. To address this task, a concealed object detection model with self-paced feature attention fusion network (SPFAFN) is proposed in this article. To be specific, the features with different scales are fused in a top-down manner to integrate details and global semantics to better detect small objects. During fusing multi-scale features, a hierarchical pyramid attention mechanism composed of channel and spatial attention is developed to perceive the object. Moreover, boosting self-paced learning is exploited to guide the model to learn hard samples that are difficultly detected. The proposed method is validated on two real-world datasets: an AMMW dataset and a publicly available passive millimeter-wave (PMMW) dataset. Experimental results demonstrate that the proposed approach is superior to the state-of-the-art methods, and achieves better performances on the two datasets with Average Precision (AP).</description><identifier>ISSN: 1051-8215</identifier><identifier>EISSN: 1558-2205</identifier><identifier>DOI: 10.1109/TCSVT.2021.3058246</identifier><identifier>CODEN: ITCTEM</identifier><language>eng</language><publisher>New York: IEEE</publisher><subject>attention mechanism ; Concealed object detection ; Datasets ; Deep learning ; Feature extraction ; Imaging ; Location awareness ; Millimeter waves ; millimeter-wave image ; Object detection ; Object recognition ; Proposals ; self-paced learning ; Semantics ; Training</subject><ispartof>IEEE transactions on circuits and systems for video technology, 2022-01, Vol.32 (1), p.224-239</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2022</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c295t-c62801857e94f6dd8161476d897f3001140496001e89196cbc7169f4f80e64d63</citedby><cites>FETCH-LOGICAL-c295t-c62801857e94f6dd8161476d897f3001140496001e89196cbc7169f4f80e64d63</cites><orcidid>0000-0003-1224-4611 ; 0000-0003-3308-1794 ; 0000-0002-2619-6481 ; 0000-0002-1392-8348</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/9350607$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,776,780,792,27903,27904,54737</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/9350607$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Wang, Xinlin</creatorcontrib><creatorcontrib>Gou, Shuiping</creatorcontrib><creatorcontrib>Li, Jichao</creatorcontrib><creatorcontrib>Zhao, Yinghai</creatorcontrib><creatorcontrib>Liu, Zhen</creatorcontrib><creatorcontrib>Jiao, Changzhe</creatorcontrib><creatorcontrib>Mao, Shasha</creatorcontrib><title>Self-Paced Feature Attention Fusion Network for Concealed Object Detection in Millimeter-Wave Image</title><title>IEEE transactions on circuits and systems for video technology</title><addtitle>TCSVT</addtitle><description>The active millimeter-wave (AMMW) scanner has been widely used for inspecting human security in public places in recent years owing to its ability to detect all kinds of objects under the clothes and be harmless to the body. However, it is really challenging to detect all concealed objects automatically and accurately due to inherent imaging noise, unknown object kind, and uncertain position. Recently, many existing methods, especially deep learning-based, have achieved good performances on concealed object detection. These methods work well for detecting a few kinds of large objects, but fail to perform on dim and incomplete hard objects. To address this task, a concealed object detection model with self-paced feature attention fusion network (SPFAFN) is proposed in this article. To be specific, the features with different scales are fused in a top-down manner to integrate details and global semantics to better detect small objects. During fusing multi-scale features, a hierarchical pyramid attention mechanism composed of channel and spatial attention is developed to perceive the object. Moreover, boosting self-paced learning is exploited to guide the model to learn hard samples that are difficultly detected. The proposed method is validated on two real-world datasets: an AMMW dataset and a publicly available passive millimeter-wave (PMMW) dataset. Experimental results demonstrate that the proposed approach is superior to the state-of-the-art methods, and achieves better performances on the two datasets with Average Precision (AP).</description><subject>attention mechanism</subject><subject>Concealed object detection</subject><subject>Datasets</subject><subject>Deep learning</subject><subject>Feature extraction</subject><subject>Imaging</subject><subject>Location awareness</subject><subject>Millimeter waves</subject><subject>millimeter-wave image</subject><subject>Object detection</subject><subject>Object recognition</subject><subject>Proposals</subject><subject>self-paced learning</subject><subject>Semantics</subject><subject>Training</subject><issn>1051-8215</issn><issn>1558-2205</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNo9kMFOwzAQRC0EEqXwA3CxxDnF69iOfawChUqFIrXAMUqdDUpJk-I4IP4el1acZrR6s7saQi6BjQCYuVmmi9fliDMOo5hJzYU6IgOQUkecM3kcPJMQaQ7ylJx13ZoxEFokA2IXWJfRc26xoBPMfe-Qjr3HxldtQyd9t5Mn9N-t-6Bl62jaNhbzOuDz1Rqtp7fog-ywqqGPVV1XmzBx0Vv-hXS6yd_xnJyUed3hxUGH5GVyt0wfotn8fpqOZ5HlRvrIKq4ZaJmgEaUqCg0KRKIKbZIyDg-DYMKoYFAbMMqubALKlKLUDJUoVDwk1_u9W9d-9tj5bN32rgknM67AMB6DTgLF95R1bdc5LLOtqza5-8mAZbsys78ys12Z2aHMELrahypE_A-YWDLFkvgX7dNu4w</recordid><startdate>202201</startdate><enddate>202201</enddate><creator>Wang, Xinlin</creator><creator>Gou, Shuiping</creator><creator>Li, Jichao</creator><creator>Zhao, Yinghai</creator><creator>Liu, Zhen</creator><creator>Jiao, Changzhe</creator><creator>Mao, Shasha</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7SP</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><orcidid>https://orcid.org/0000-0003-1224-4611</orcidid><orcidid>https://orcid.org/0000-0003-3308-1794</orcidid><orcidid>https://orcid.org/0000-0002-2619-6481</orcidid><orcidid>https://orcid.org/0000-0002-1392-8348</orcidid></search><sort><creationdate>202201</creationdate><title>Self-Paced Feature Attention Fusion Network for Concealed Object Detection in Millimeter-Wave Image</title><author>Wang, Xinlin ; Gou, Shuiping ; Li, Jichao ; Zhao, Yinghai ; Liu, Zhen ; Jiao, Changzhe ; Mao, Shasha</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c295t-c62801857e94f6dd8161476d897f3001140496001e89196cbc7169f4f80e64d63</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>attention mechanism</topic><topic>Concealed object detection</topic><topic>Datasets</topic><topic>Deep learning</topic><topic>Feature extraction</topic><topic>Imaging</topic><topic>Location awareness</topic><topic>Millimeter waves</topic><topic>millimeter-wave image</topic><topic>Object detection</topic><topic>Object recognition</topic><topic>Proposals</topic><topic>self-paced learning</topic><topic>Semantics</topic><topic>Training</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Wang, Xinlin</creatorcontrib><creatorcontrib>Gou, Shuiping</creatorcontrib><creatorcontrib>Li, Jichao</creatorcontrib><creatorcontrib>Zhao, Yinghai</creatorcontrib><creatorcontrib>Liu, Zhen</creatorcontrib><creatorcontrib>Jiao, Changzhe</creatorcontrib><creatorcontrib>Mao, Shasha</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics & Communications Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>IEEE transactions on circuits and systems for video technology</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Wang, Xinlin</au><au>Gou, Shuiping</au><au>Li, Jichao</au><au>Zhao, Yinghai</au><au>Liu, Zhen</au><au>Jiao, Changzhe</au><au>Mao, Shasha</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Self-Paced Feature Attention Fusion Network for Concealed Object Detection in Millimeter-Wave Image</atitle><jtitle>IEEE transactions on circuits and systems for video technology</jtitle><stitle>TCSVT</stitle><date>2022-01</date><risdate>2022</risdate><volume>32</volume><issue>1</issue><spage>224</spage><epage>239</epage><pages>224-239</pages><issn>1051-8215</issn><eissn>1558-2205</eissn><coden>ITCTEM</coden><abstract>The active millimeter-wave (AMMW) scanner has been widely used for inspecting human security in public places in recent years owing to its ability to detect all kinds of objects under the clothes and be harmless to the body. However, it is really challenging to detect all concealed objects automatically and accurately due to inherent imaging noise, unknown object kind, and uncertain position. Recently, many existing methods, especially deep learning-based, have achieved good performances on concealed object detection. These methods work well for detecting a few kinds of large objects, but fail to perform on dim and incomplete hard objects. To address this task, a concealed object detection model with self-paced feature attention fusion network (SPFAFN) is proposed in this article. To be specific, the features with different scales are fused in a top-down manner to integrate details and global semantics to better detect small objects. During fusing multi-scale features, a hierarchical pyramid attention mechanism composed of channel and spatial attention is developed to perceive the object. Moreover, boosting self-paced learning is exploited to guide the model to learn hard samples that are difficultly detected. The proposed method is validated on two real-world datasets: an AMMW dataset and a publicly available passive millimeter-wave (PMMW) dataset. Experimental results demonstrate that the proposed approach is superior to the state-of-the-art methods, and achieves better performances on the two datasets with Average Precision (AP).</abstract><cop>New York</cop><pub>IEEE</pub><doi>10.1109/TCSVT.2021.3058246</doi><tpages>16</tpages><orcidid>https://orcid.org/0000-0003-1224-4611</orcidid><orcidid>https://orcid.org/0000-0003-3308-1794</orcidid><orcidid>https://orcid.org/0000-0002-2619-6481</orcidid><orcidid>https://orcid.org/0000-0002-1392-8348</orcidid></addata></record> |
fulltext | fulltext_linktorsrc |
identifier | ISSN: 1051-8215 |
ispartof | IEEE transactions on circuits and systems for video technology, 2022-01, Vol.32 (1), p.224-239 |
issn | 1051-8215 1558-2205 |
language | eng |
recordid | cdi_ieee_primary_9350607 |
source | IEEE Electronic Library (IEL) |
subjects | attention mechanism Concealed object detection Datasets Deep learning Feature extraction Imaging Location awareness Millimeter waves millimeter-wave image Object detection Object recognition Proposals self-paced learning Semantics Training |
title | Self-Paced Feature Attention Fusion Network for Concealed Object Detection in Millimeter-Wave Image |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-21T10%3A22%3A52IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Self-Paced%20Feature%20Attention%20Fusion%20Network%20for%20Concealed%20Object%20Detection%20in%20Millimeter-Wave%20Image&rft.jtitle=IEEE%20transactions%20on%20circuits%20and%20systems%20for%20video%20technology&rft.au=Wang,%20Xinlin&rft.date=2022-01&rft.volume=32&rft.issue=1&rft.spage=224&rft.epage=239&rft.pages=224-239&rft.issn=1051-8215&rft.eissn=1558-2205&rft.coden=ITCTEM&rft_id=info:doi/10.1109/TCSVT.2021.3058246&rft_dat=%3Cproquest_RIE%3E2619023187%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2619023187&rft_id=info:pmid/&rft_ieee_id=9350607&rfr_iscdi=true |