Self-Paced Feature Attention Fusion Network for Concealed Object Detection in Millimeter-Wave Image

The active millimeter-wave (AMMW) scanner has been widely used for inspecting human security in public places in recent years owing to its ability to detect all kinds of objects under the clothes and be harmless to the body. However, it is really challenging to detect all concealed objects automatic...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on circuits and systems for video technology 2022-01, Vol.32 (1), p.224-239
Hauptverfasser: Wang, Xinlin, Gou, Shuiping, Li, Jichao, Zhao, Yinghai, Liu, Zhen, Jiao, Changzhe, Mao, Shasha
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 239
container_issue 1
container_start_page 224
container_title IEEE transactions on circuits and systems for video technology
container_volume 32
creator Wang, Xinlin
Gou, Shuiping
Li, Jichao
Zhao, Yinghai
Liu, Zhen
Jiao, Changzhe
Mao, Shasha
description The active millimeter-wave (AMMW) scanner has been widely used for inspecting human security in public places in recent years owing to its ability to detect all kinds of objects under the clothes and be harmless to the body. However, it is really challenging to detect all concealed objects automatically and accurately due to inherent imaging noise, unknown object kind, and uncertain position. Recently, many existing methods, especially deep learning-based, have achieved good performances on concealed object detection. These methods work well for detecting a few kinds of large objects, but fail to perform on dim and incomplete hard objects. To address this task, a concealed object detection model with self-paced feature attention fusion network (SPFAFN) is proposed in this article. To be specific, the features with different scales are fused in a top-down manner to integrate details and global semantics to better detect small objects. During fusing multi-scale features, a hierarchical pyramid attention mechanism composed of channel and spatial attention is developed to perceive the object. Moreover, boosting self-paced learning is exploited to guide the model to learn hard samples that are difficultly detected. The proposed method is validated on two real-world datasets: an AMMW dataset and a publicly available passive millimeter-wave (PMMW) dataset. Experimental results demonstrate that the proposed approach is superior to the state-of-the-art methods, and achieves better performances on the two datasets with Average Precision (AP).
doi_str_mv 10.1109/TCSVT.2021.3058246
format Article
fullrecord <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_ieee_primary_9350607</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>9350607</ieee_id><sourcerecordid>2619023187</sourcerecordid><originalsourceid>FETCH-LOGICAL-c295t-c62801857e94f6dd8161476d897f3001140496001e89196cbc7169f4f80e64d63</originalsourceid><addsrcrecordid>eNo9kMFOwzAQRC0EEqXwA3CxxDnF69iOfawChUqFIrXAMUqdDUpJk-I4IP4el1acZrR6s7saQi6BjQCYuVmmi9fliDMOo5hJzYU6IgOQUkecM3kcPJMQaQ7ylJx13ZoxEFokA2IXWJfRc26xoBPMfe-Qjr3HxldtQyd9t5Mn9N-t-6Bl62jaNhbzOuDz1Rqtp7fog-ywqqGPVV1XmzBx0Vv-hXS6yd_xnJyUed3hxUGH5GVyt0wfotn8fpqOZ5HlRvrIKq4ZaJmgEaUqCg0KRKIKbZIyDg-DYMKoYFAbMMqubALKlKLUDJUoVDwk1_u9W9d-9tj5bN32rgknM67AMB6DTgLF95R1bdc5LLOtqza5-8mAZbsys78ys12Z2aHMELrahypE_A-YWDLFkvgX7dNu4w</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2619023187</pqid></control><display><type>article</type><title>Self-Paced Feature Attention Fusion Network for Concealed Object Detection in Millimeter-Wave Image</title><source>IEEE Electronic Library (IEL)</source><creator>Wang, Xinlin ; Gou, Shuiping ; Li, Jichao ; Zhao, Yinghai ; Liu, Zhen ; Jiao, Changzhe ; Mao, Shasha</creator><creatorcontrib>Wang, Xinlin ; Gou, Shuiping ; Li, Jichao ; Zhao, Yinghai ; Liu, Zhen ; Jiao, Changzhe ; Mao, Shasha</creatorcontrib><description>The active millimeter-wave (AMMW) scanner has been widely used for inspecting human security in public places in recent years owing to its ability to detect all kinds of objects under the clothes and be harmless to the body. However, it is really challenging to detect all concealed objects automatically and accurately due to inherent imaging noise, unknown object kind, and uncertain position. Recently, many existing methods, especially deep learning-based, have achieved good performances on concealed object detection. These methods work well for detecting a few kinds of large objects, but fail to perform on dim and incomplete hard objects. To address this task, a concealed object detection model with self-paced feature attention fusion network (SPFAFN) is proposed in this article. To be specific, the features with different scales are fused in a top-down manner to integrate details and global semantics to better detect small objects. During fusing multi-scale features, a hierarchical pyramid attention mechanism composed of channel and spatial attention is developed to perceive the object. Moreover, boosting self-paced learning is exploited to guide the model to learn hard samples that are difficultly detected. The proposed method is validated on two real-world datasets: an AMMW dataset and a publicly available passive millimeter-wave (PMMW) dataset. Experimental results demonstrate that the proposed approach is superior to the state-of-the-art methods, and achieves better performances on the two datasets with Average Precision (AP).</description><identifier>ISSN: 1051-8215</identifier><identifier>EISSN: 1558-2205</identifier><identifier>DOI: 10.1109/TCSVT.2021.3058246</identifier><identifier>CODEN: ITCTEM</identifier><language>eng</language><publisher>New York: IEEE</publisher><subject>attention mechanism ; Concealed object detection ; Datasets ; Deep learning ; Feature extraction ; Imaging ; Location awareness ; Millimeter waves ; millimeter-wave image ; Object detection ; Object recognition ; Proposals ; self-paced learning ; Semantics ; Training</subject><ispartof>IEEE transactions on circuits and systems for video technology, 2022-01, Vol.32 (1), p.224-239</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2022</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c295t-c62801857e94f6dd8161476d897f3001140496001e89196cbc7169f4f80e64d63</citedby><cites>FETCH-LOGICAL-c295t-c62801857e94f6dd8161476d897f3001140496001e89196cbc7169f4f80e64d63</cites><orcidid>0000-0003-1224-4611 ; 0000-0003-3308-1794 ; 0000-0002-2619-6481 ; 0000-0002-1392-8348</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/9350607$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,776,780,792,27903,27904,54737</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/9350607$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Wang, Xinlin</creatorcontrib><creatorcontrib>Gou, Shuiping</creatorcontrib><creatorcontrib>Li, Jichao</creatorcontrib><creatorcontrib>Zhao, Yinghai</creatorcontrib><creatorcontrib>Liu, Zhen</creatorcontrib><creatorcontrib>Jiao, Changzhe</creatorcontrib><creatorcontrib>Mao, Shasha</creatorcontrib><title>Self-Paced Feature Attention Fusion Network for Concealed Object Detection in Millimeter-Wave Image</title><title>IEEE transactions on circuits and systems for video technology</title><addtitle>TCSVT</addtitle><description>The active millimeter-wave (AMMW) scanner has been widely used for inspecting human security in public places in recent years owing to its ability to detect all kinds of objects under the clothes and be harmless to the body. However, it is really challenging to detect all concealed objects automatically and accurately due to inherent imaging noise, unknown object kind, and uncertain position. Recently, many existing methods, especially deep learning-based, have achieved good performances on concealed object detection. These methods work well for detecting a few kinds of large objects, but fail to perform on dim and incomplete hard objects. To address this task, a concealed object detection model with self-paced feature attention fusion network (SPFAFN) is proposed in this article. To be specific, the features with different scales are fused in a top-down manner to integrate details and global semantics to better detect small objects. During fusing multi-scale features, a hierarchical pyramid attention mechanism composed of channel and spatial attention is developed to perceive the object. Moreover, boosting self-paced learning is exploited to guide the model to learn hard samples that are difficultly detected. The proposed method is validated on two real-world datasets: an AMMW dataset and a publicly available passive millimeter-wave (PMMW) dataset. Experimental results demonstrate that the proposed approach is superior to the state-of-the-art methods, and achieves better performances on the two datasets with Average Precision (AP).</description><subject>attention mechanism</subject><subject>Concealed object detection</subject><subject>Datasets</subject><subject>Deep learning</subject><subject>Feature extraction</subject><subject>Imaging</subject><subject>Location awareness</subject><subject>Millimeter waves</subject><subject>millimeter-wave image</subject><subject>Object detection</subject><subject>Object recognition</subject><subject>Proposals</subject><subject>self-paced learning</subject><subject>Semantics</subject><subject>Training</subject><issn>1051-8215</issn><issn>1558-2205</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNo9kMFOwzAQRC0EEqXwA3CxxDnF69iOfawChUqFIrXAMUqdDUpJk-I4IP4el1acZrR6s7saQi6BjQCYuVmmi9fliDMOo5hJzYU6IgOQUkecM3kcPJMQaQ7ylJx13ZoxEFokA2IXWJfRc26xoBPMfe-Qjr3HxldtQyd9t5Mn9N-t-6Bl62jaNhbzOuDz1Rqtp7fog-ywqqGPVV1XmzBx0Vv-hXS6yd_xnJyUed3hxUGH5GVyt0wfotn8fpqOZ5HlRvrIKq4ZaJmgEaUqCg0KRKIKbZIyDg-DYMKoYFAbMMqubALKlKLUDJUoVDwk1_u9W9d-9tj5bN32rgknM67AMB6DTgLF95R1bdc5LLOtqza5-8mAZbsys78ys12Z2aHMELrahypE_A-YWDLFkvgX7dNu4w</recordid><startdate>202201</startdate><enddate>202201</enddate><creator>Wang, Xinlin</creator><creator>Gou, Shuiping</creator><creator>Li, Jichao</creator><creator>Zhao, Yinghai</creator><creator>Liu, Zhen</creator><creator>Jiao, Changzhe</creator><creator>Mao, Shasha</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7SP</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><orcidid>https://orcid.org/0000-0003-1224-4611</orcidid><orcidid>https://orcid.org/0000-0003-3308-1794</orcidid><orcidid>https://orcid.org/0000-0002-2619-6481</orcidid><orcidid>https://orcid.org/0000-0002-1392-8348</orcidid></search><sort><creationdate>202201</creationdate><title>Self-Paced Feature Attention Fusion Network for Concealed Object Detection in Millimeter-Wave Image</title><author>Wang, Xinlin ; Gou, Shuiping ; Li, Jichao ; Zhao, Yinghai ; Liu, Zhen ; Jiao, Changzhe ; Mao, Shasha</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c295t-c62801857e94f6dd8161476d897f3001140496001e89196cbc7169f4f80e64d63</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>attention mechanism</topic><topic>Concealed object detection</topic><topic>Datasets</topic><topic>Deep learning</topic><topic>Feature extraction</topic><topic>Imaging</topic><topic>Location awareness</topic><topic>Millimeter waves</topic><topic>millimeter-wave image</topic><topic>Object detection</topic><topic>Object recognition</topic><topic>Proposals</topic><topic>self-paced learning</topic><topic>Semantics</topic><topic>Training</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Wang, Xinlin</creatorcontrib><creatorcontrib>Gou, Shuiping</creatorcontrib><creatorcontrib>Li, Jichao</creatorcontrib><creatorcontrib>Zhao, Yinghai</creatorcontrib><creatorcontrib>Liu, Zhen</creatorcontrib><creatorcontrib>Jiao, Changzhe</creatorcontrib><creatorcontrib>Mao, Shasha</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics &amp; Communications Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>IEEE transactions on circuits and systems for video technology</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Wang, Xinlin</au><au>Gou, Shuiping</au><au>Li, Jichao</au><au>Zhao, Yinghai</au><au>Liu, Zhen</au><au>Jiao, Changzhe</au><au>Mao, Shasha</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Self-Paced Feature Attention Fusion Network for Concealed Object Detection in Millimeter-Wave Image</atitle><jtitle>IEEE transactions on circuits and systems for video technology</jtitle><stitle>TCSVT</stitle><date>2022-01</date><risdate>2022</risdate><volume>32</volume><issue>1</issue><spage>224</spage><epage>239</epage><pages>224-239</pages><issn>1051-8215</issn><eissn>1558-2205</eissn><coden>ITCTEM</coden><abstract>The active millimeter-wave (AMMW) scanner has been widely used for inspecting human security in public places in recent years owing to its ability to detect all kinds of objects under the clothes and be harmless to the body. However, it is really challenging to detect all concealed objects automatically and accurately due to inherent imaging noise, unknown object kind, and uncertain position. Recently, many existing methods, especially deep learning-based, have achieved good performances on concealed object detection. These methods work well for detecting a few kinds of large objects, but fail to perform on dim and incomplete hard objects. To address this task, a concealed object detection model with self-paced feature attention fusion network (SPFAFN) is proposed in this article. To be specific, the features with different scales are fused in a top-down manner to integrate details and global semantics to better detect small objects. During fusing multi-scale features, a hierarchical pyramid attention mechanism composed of channel and spatial attention is developed to perceive the object. Moreover, boosting self-paced learning is exploited to guide the model to learn hard samples that are difficultly detected. The proposed method is validated on two real-world datasets: an AMMW dataset and a publicly available passive millimeter-wave (PMMW) dataset. Experimental results demonstrate that the proposed approach is superior to the state-of-the-art methods, and achieves better performances on the two datasets with Average Precision (AP).</abstract><cop>New York</cop><pub>IEEE</pub><doi>10.1109/TCSVT.2021.3058246</doi><tpages>16</tpages><orcidid>https://orcid.org/0000-0003-1224-4611</orcidid><orcidid>https://orcid.org/0000-0003-3308-1794</orcidid><orcidid>https://orcid.org/0000-0002-2619-6481</orcidid><orcidid>https://orcid.org/0000-0002-1392-8348</orcidid></addata></record>
fulltext fulltext_linktorsrc
identifier ISSN: 1051-8215
ispartof IEEE transactions on circuits and systems for video technology, 2022-01, Vol.32 (1), p.224-239
issn 1051-8215
1558-2205
language eng
recordid cdi_ieee_primary_9350607
source IEEE Electronic Library (IEL)
subjects attention mechanism
Concealed object detection
Datasets
Deep learning
Feature extraction
Imaging
Location awareness
Millimeter waves
millimeter-wave image
Object detection
Object recognition
Proposals
self-paced learning
Semantics
Training
title Self-Paced Feature Attention Fusion Network for Concealed Object Detection in Millimeter-Wave Image
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-21T10%3A22%3A52IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Self-Paced%20Feature%20Attention%20Fusion%20Network%20for%20Concealed%20Object%20Detection%20in%20Millimeter-Wave%20Image&rft.jtitle=IEEE%20transactions%20on%20circuits%20and%20systems%20for%20video%20technology&rft.au=Wang,%20Xinlin&rft.date=2022-01&rft.volume=32&rft.issue=1&rft.spage=224&rft.epage=239&rft.pages=224-239&rft.issn=1051-8215&rft.eissn=1558-2205&rft.coden=ITCTEM&rft_id=info:doi/10.1109/TCSVT.2021.3058246&rft_dat=%3Cproquest_RIE%3E2619023187%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2619023187&rft_id=info:pmid/&rft_ieee_id=9350607&rfr_iscdi=true