Research on Intelligent Target Recognition Integrated With Knowledge

With the development of artificial intelligence technology, intelligent weapon systems that can automatically identify, lock on and strike targets have gradually appeared and can replace humans in executing simple decision-making commands. Target detection is a key part of intelligent weapons. At pr...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE access 2021, Vol.9, p.137107-137115
Hauptverfasser: Zhang, Feng, Fan, Huibing, Wang, Keju, Zhao, Yongjin, Zhang, Xiaoxi, Ma, Yang
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 137115
container_issue
container_start_page 137107
container_title IEEE access
container_volume 9
creator Zhang, Feng
Fan, Huibing
Wang, Keju
Zhao, Yongjin
Zhang, Xiaoxi
Ma, Yang
description With the development of artificial intelligence technology, intelligent weapon systems that can automatically identify, lock on and strike targets have gradually appeared and can replace humans in executing simple decision-making commands. Target detection is a key part of intelligent weapons. At present, large-scale target detection has serious challenges such as long-tail data distributions, severe occlusion, and category ambiguity. The main detection algorithms only detect each independent area without considering the key semantic dependencies between objects. It has become a hot trend to apply deep learning to prior knowledge to form a model. This article uses both internal and external knowledge to instill a target detection system with human reasoning capabilities. Commonly used external embedded knowledge includes geometric relations, attributes, locations, etc. They have a common shortcoming in that they require large amounts of labeled data, and the integration costs are huge. The purpose of this article is to construct a general external prior knowledge module to guide network learning. By paying attention to the characteristics of each object in different semantic contexts, the characteristics of each object are adaptively enhanced, and the high-level semantics of all categories evolve on a global scale. Internal knowledge uses a convolutional attention module that can learn spatial and channel information at multiple scales. The experimental results show the superiority of our knowledge-YOLOv5. The proposed method achieved 1.7%, 2.2%, 1.1%, and 0.7% improvements over YOLOv5s, YOLOv5m, VOLOv51, and YOLOv5x, respectively, on the COCO data sets; and the proposed method also achieves a 0.9% improvement on the self-built data set. The trained lightweight model Knowledge-YOLOv5s is deployed on an NVIDIA Jetson TX2 through TensorRT acceleration, and the real-time detection frame is 20 ms, which meets the real-time detection requirements. This system can also be used as a module of an intelligent weapon system, which has certain referential significance for autonomous weapons and unmanned combat systems.
doi_str_mv 10.1109/ACCESS.2021.3116866
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2581569487</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>9552859</ieee_id><doaj_id>oai_doaj_org_article_2dd9dae6a71146a2be9ea2ccbfbae797</doaj_id><sourcerecordid>2581569487</sourcerecordid><originalsourceid>FETCH-LOGICAL-c408t-37c42d7b32345fa11e3f6d790b97c16aea43768b7781d37b3dcb5cdae807b993</originalsourceid><addsrcrecordid>eNpNUE1Lw0AQXUTBUvsLegl4Ts3uZr-OpVYtFoS24HHZ7E7SlJitmy3ivzc1RZzLDG_eezM8hKY4m2GcqYf5YrHcbmckI3hGMeaS8ys0IpirlDLKr__Nt2jSdYesL9lDTIzQ4wY6MMHuE98mqzZC09QVtDHZmVBBTDZgfdXWsb6sq2AiuOS9jvvktfVfDbgK7tBNaZoOJpc-Rrun5W7xkq7fnleL-Tq1eSZjSoXNiRMFJTRnpcEYaMmdUFmhhMXcgMmp4LIQQmJHe56zBbPOgMxEoRQdo9Vg67w56GOoP0z41t7U-hfwodImxNo2oIlzqhdyIzDOuSEFKDDE2qIsDAgleq_7wesY_OcJuqgP_hTa_ntNmMSMq1yeWXRg2eC7LkD5dxVn-hy-HsLX5_D1JfxeNR1UNQD8KRRjRDJFfwCFooCM</addsrcrecordid><sourcetype>Open Website</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2581569487</pqid></control><display><type>article</type><title>Research on Intelligent Target Recognition Integrated With Knowledge</title><source>DOAJ Directory of Open Access Journals</source><source>EZB-FREE-00999 freely available EZB journals</source><source>IEEE Xplore Open Access Journals</source><creator>Zhang, Feng ; Fan, Huibing ; Wang, Keju ; Zhao, Yongjin ; Zhang, Xiaoxi ; Ma, Yang</creator><creatorcontrib>Zhang, Feng ; Fan, Huibing ; Wang, Keju ; Zhao, Yongjin ; Zhang, Xiaoxi ; Ma, Yang</creatorcontrib><description>With the development of artificial intelligence technology, intelligent weapon systems that can automatically identify, lock on and strike targets have gradually appeared and can replace humans in executing simple decision-making commands. Target detection is a key part of intelligent weapons. At present, large-scale target detection has serious challenges such as long-tail data distributions, severe occlusion, and category ambiguity. The main detection algorithms only detect each independent area without considering the key semantic dependencies between objects. It has become a hot trend to apply deep learning to prior knowledge to form a model. This article uses both internal and external knowledge to instill a target detection system with human reasoning capabilities. Commonly used external embedded knowledge includes geometric relations, attributes, locations, etc. They have a common shortcoming in that they require large amounts of labeled data, and the integration costs are huge. The purpose of this article is to construct a general external prior knowledge module to guide network learning. By paying attention to the characteristics of each object in different semantic contexts, the characteristics of each object are adaptively enhanced, and the high-level semantics of all categories evolve on a global scale. Internal knowledge uses a convolutional attention module that can learn spatial and channel information at multiple scales. The experimental results show the superiority of our knowledge-YOLOv5. The proposed method achieved 1.7%, 2.2%, 1.1%, and 0.7% improvements over YOLOv5s, YOLOv5m, VOLOv51, and YOLOv5x, respectively, on the COCO data sets; and the proposed method also achieves a 0.9% improvement on the self-built data set. The trained lightweight model Knowledge-YOLOv5s is deployed on an NVIDIA Jetson TX2 through TensorRT acceleration, and the real-time detection frame is 20 ms, which meets the real-time detection requirements. This system can also be used as a module of an intelligent weapon system, which has certain referential significance for autonomous weapons and unmanned combat systems.</description><identifier>ISSN: 2169-3536</identifier><identifier>EISSN: 2169-3536</identifier><identifier>DOI: 10.1109/ACCESS.2021.3116866</identifier><identifier>CODEN: IAECCG</identifier><language>eng</language><publisher>Piscataway: IEEE</publisher><subject>Algorithms ; Artificial intelligence ; Convolution ; Datasets ; Decision making ; Deep learning ; Feature extraction ; intelligent weapon system ; Knowledge ; knowledge graph ; Machine learning ; Military aircraft ; Modules ; NVIDIA JetsonTX2 ; Object detection ; Object recognition ; Occlusion ; Prior knowledge ; Real time ; Semantics ; Target detection ; Target recognition ; Weapon systems ; YOLOv5</subject><ispartof>IEEE access, 2021, Vol.9, p.137107-137115</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2021</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c408t-37c42d7b32345fa11e3f6d790b97c16aea43768b7781d37b3dcb5cdae807b993</citedby><cites>FETCH-LOGICAL-c408t-37c42d7b32345fa11e3f6d790b97c16aea43768b7781d37b3dcb5cdae807b993</cites><orcidid>0000-0003-1719-9645</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/9552859$$EHTML$$P50$$Gieee$$Hfree_for_read</linktohtml><link.rule.ids>314,776,780,860,2096,4010,27610,27900,27901,27902,54908</link.rule.ids></links><search><creatorcontrib>Zhang, Feng</creatorcontrib><creatorcontrib>Fan, Huibing</creatorcontrib><creatorcontrib>Wang, Keju</creatorcontrib><creatorcontrib>Zhao, Yongjin</creatorcontrib><creatorcontrib>Zhang, Xiaoxi</creatorcontrib><creatorcontrib>Ma, Yang</creatorcontrib><title>Research on Intelligent Target Recognition Integrated With Knowledge</title><title>IEEE access</title><addtitle>Access</addtitle><description>With the development of artificial intelligence technology, intelligent weapon systems that can automatically identify, lock on and strike targets have gradually appeared and can replace humans in executing simple decision-making commands. Target detection is a key part of intelligent weapons. At present, large-scale target detection has serious challenges such as long-tail data distributions, severe occlusion, and category ambiguity. The main detection algorithms only detect each independent area without considering the key semantic dependencies between objects. It has become a hot trend to apply deep learning to prior knowledge to form a model. This article uses both internal and external knowledge to instill a target detection system with human reasoning capabilities. Commonly used external embedded knowledge includes geometric relations, attributes, locations, etc. They have a common shortcoming in that they require large amounts of labeled data, and the integration costs are huge. The purpose of this article is to construct a general external prior knowledge module to guide network learning. By paying attention to the characteristics of each object in different semantic contexts, the characteristics of each object are adaptively enhanced, and the high-level semantics of all categories evolve on a global scale. Internal knowledge uses a convolutional attention module that can learn spatial and channel information at multiple scales. The experimental results show the superiority of our knowledge-YOLOv5. The proposed method achieved 1.7%, 2.2%, 1.1%, and 0.7% improvements over YOLOv5s, YOLOv5m, VOLOv51, and YOLOv5x, respectively, on the COCO data sets; and the proposed method also achieves a 0.9% improvement on the self-built data set. The trained lightweight model Knowledge-YOLOv5s is deployed on an NVIDIA Jetson TX2 through TensorRT acceleration, and the real-time detection frame is 20 ms, which meets the real-time detection requirements. This system can also be used as a module of an intelligent weapon system, which has certain referential significance for autonomous weapons and unmanned combat systems.</description><subject>Algorithms</subject><subject>Artificial intelligence</subject><subject>Convolution</subject><subject>Datasets</subject><subject>Decision making</subject><subject>Deep learning</subject><subject>Feature extraction</subject><subject>intelligent weapon system</subject><subject>Knowledge</subject><subject>knowledge graph</subject><subject>Machine learning</subject><subject>Military aircraft</subject><subject>Modules</subject><subject>NVIDIA JetsonTX2</subject><subject>Object detection</subject><subject>Object recognition</subject><subject>Occlusion</subject><subject>Prior knowledge</subject><subject>Real time</subject><subject>Semantics</subject><subject>Target detection</subject><subject>Target recognition</subject><subject>Weapon systems</subject><subject>YOLOv5</subject><issn>2169-3536</issn><issn>2169-3536</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2021</creationdate><recordtype>article</recordtype><sourceid>ESBDL</sourceid><sourceid>RIE</sourceid><sourceid>DOA</sourceid><recordid>eNpNUE1Lw0AQXUTBUvsLegl4Ts3uZr-OpVYtFoS24HHZ7E7SlJitmy3ivzc1RZzLDG_eezM8hKY4m2GcqYf5YrHcbmckI3hGMeaS8ys0IpirlDLKr__Nt2jSdYesL9lDTIzQ4wY6MMHuE98mqzZC09QVtDHZmVBBTDZgfdXWsb6sq2AiuOS9jvvktfVfDbgK7tBNaZoOJpc-Rrun5W7xkq7fnleL-Tq1eSZjSoXNiRMFJTRnpcEYaMmdUFmhhMXcgMmp4LIQQmJHe56zBbPOgMxEoRQdo9Vg67w56GOoP0z41t7U-hfwodImxNo2oIlzqhdyIzDOuSEFKDDE2qIsDAgleq_7wesY_OcJuqgP_hTa_ntNmMSMq1yeWXRg2eC7LkD5dxVn-hy-HsLX5_D1JfxeNR1UNQD8KRRjRDJFfwCFooCM</recordid><startdate>2021</startdate><enddate>2021</enddate><creator>Zhang, Feng</creator><creator>Fan, Huibing</creator><creator>Wang, Keju</creator><creator>Zhao, Yongjin</creator><creator>Zhang, Xiaoxi</creator><creator>Ma, Yang</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>ESBDL</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7SP</scope><scope>7SR</scope><scope>8BQ</scope><scope>8FD</scope><scope>JG9</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>DOA</scope><orcidid>https://orcid.org/0000-0003-1719-9645</orcidid></search><sort><creationdate>2021</creationdate><title>Research on Intelligent Target Recognition Integrated With Knowledge</title><author>Zhang, Feng ; Fan, Huibing ; Wang, Keju ; Zhao, Yongjin ; Zhang, Xiaoxi ; Ma, Yang</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c408t-37c42d7b32345fa11e3f6d790b97c16aea43768b7781d37b3dcb5cdae807b993</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2021</creationdate><topic>Algorithms</topic><topic>Artificial intelligence</topic><topic>Convolution</topic><topic>Datasets</topic><topic>Decision making</topic><topic>Deep learning</topic><topic>Feature extraction</topic><topic>intelligent weapon system</topic><topic>Knowledge</topic><topic>knowledge graph</topic><topic>Machine learning</topic><topic>Military aircraft</topic><topic>Modules</topic><topic>NVIDIA JetsonTX2</topic><topic>Object detection</topic><topic>Object recognition</topic><topic>Occlusion</topic><topic>Prior knowledge</topic><topic>Real time</topic><topic>Semantics</topic><topic>Target detection</topic><topic>Target recognition</topic><topic>Weapon systems</topic><topic>YOLOv5</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Zhang, Feng</creatorcontrib><creatorcontrib>Fan, Huibing</creatorcontrib><creatorcontrib>Wang, Keju</creatorcontrib><creatorcontrib>Zhao, Yongjin</creatorcontrib><creatorcontrib>Zhang, Xiaoxi</creatorcontrib><creatorcontrib>Ma, Yang</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE Xplore Open Access Journals</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics &amp; Communications Abstracts</collection><collection>Engineered Materials Abstracts</collection><collection>METADEX</collection><collection>Technology Research Database</collection><collection>Materials Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>DOAJ Directory of Open Access Journals</collection><jtitle>IEEE access</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Zhang, Feng</au><au>Fan, Huibing</au><au>Wang, Keju</au><au>Zhao, Yongjin</au><au>Zhang, Xiaoxi</au><au>Ma, Yang</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Research on Intelligent Target Recognition Integrated With Knowledge</atitle><jtitle>IEEE access</jtitle><stitle>Access</stitle><date>2021</date><risdate>2021</risdate><volume>9</volume><spage>137107</spage><epage>137115</epage><pages>137107-137115</pages><issn>2169-3536</issn><eissn>2169-3536</eissn><coden>IAECCG</coden><abstract>With the development of artificial intelligence technology, intelligent weapon systems that can automatically identify, lock on and strike targets have gradually appeared and can replace humans in executing simple decision-making commands. Target detection is a key part of intelligent weapons. At present, large-scale target detection has serious challenges such as long-tail data distributions, severe occlusion, and category ambiguity. The main detection algorithms only detect each independent area without considering the key semantic dependencies between objects. It has become a hot trend to apply deep learning to prior knowledge to form a model. This article uses both internal and external knowledge to instill a target detection system with human reasoning capabilities. Commonly used external embedded knowledge includes geometric relations, attributes, locations, etc. They have a common shortcoming in that they require large amounts of labeled data, and the integration costs are huge. The purpose of this article is to construct a general external prior knowledge module to guide network learning. By paying attention to the characteristics of each object in different semantic contexts, the characteristics of each object are adaptively enhanced, and the high-level semantics of all categories evolve on a global scale. Internal knowledge uses a convolutional attention module that can learn spatial and channel information at multiple scales. The experimental results show the superiority of our knowledge-YOLOv5. The proposed method achieved 1.7%, 2.2%, 1.1%, and 0.7% improvements over YOLOv5s, YOLOv5m, VOLOv51, and YOLOv5x, respectively, on the COCO data sets; and the proposed method also achieves a 0.9% improvement on the self-built data set. The trained lightweight model Knowledge-YOLOv5s is deployed on an NVIDIA Jetson TX2 through TensorRT acceleration, and the real-time detection frame is 20 ms, which meets the real-time detection requirements. This system can also be used as a module of an intelligent weapon system, which has certain referential significance for autonomous weapons and unmanned combat systems.</abstract><cop>Piscataway</cop><pub>IEEE</pub><doi>10.1109/ACCESS.2021.3116866</doi><tpages>9</tpages><orcidid>https://orcid.org/0000-0003-1719-9645</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 2169-3536
ispartof IEEE access, 2021, Vol.9, p.137107-137115
issn 2169-3536
2169-3536
language eng
recordid cdi_proquest_journals_2581569487
source DOAJ Directory of Open Access Journals; EZB-FREE-00999 freely available EZB journals; IEEE Xplore Open Access Journals
subjects Algorithms
Artificial intelligence
Convolution
Datasets
Decision making
Deep learning
Feature extraction
intelligent weapon system
Knowledge
knowledge graph
Machine learning
Military aircraft
Modules
NVIDIA JetsonTX2
Object detection
Object recognition
Occlusion
Prior knowledge
Real time
Semantics
Target detection
Target recognition
Weapon systems
YOLOv5
title Research on Intelligent Target Recognition Integrated With Knowledge
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-08T10%3A55%3A08IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Research%20on%20Intelligent%20Target%20Recognition%20Integrated%20With%20Knowledge&rft.jtitle=IEEE%20access&rft.au=Zhang,%20Feng&rft.date=2021&rft.volume=9&rft.spage=137107&rft.epage=137115&rft.pages=137107-137115&rft.issn=2169-3536&rft.eissn=2169-3536&rft.coden=IAECCG&rft_id=info:doi/10.1109/ACCESS.2021.3116866&rft_dat=%3Cproquest_cross%3E2581569487%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2581569487&rft_id=info:pmid/&rft_ieee_id=9552859&rft_doaj_id=oai_doaj_org_article_2dd9dae6a71146a2be9ea2ccbfbae797&rfr_iscdi=true