A Self-Attention Feature Fusion Model for Rice Pest Detection

To address the problem that existing deep learning methods are not sufficiently accurate to detect rice pests with changeable shapes or similar appearances, a self-attention feature fusion model for rice pest detection (SAFFPest) was proposed. The model was based on VarifocalNet. First, a deformable...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE access 2022, Vol.10, p.84063-84077
Hauptverfasser: Li, Shuaifeng, Wang, Heng, Zhang, Cong, Liu, Jie
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 84077
container_issue
container_start_page 84063
container_title IEEE access
container_volume 10
creator Li, Shuaifeng
Wang, Heng
Zhang, Cong
Liu, Jie
description To address the problem that existing deep learning methods are not sufficiently accurate to detect rice pests with changeable shapes or similar appearances, a self-attention feature fusion model for rice pest detection (SAFFPest) was proposed. The model was based on VarifocalNet. First, a deformable convolution module was added to the feature extraction network, to improve the feature extraction ability of pests with changeable shapes. Second, by obtaining the balance features of multiple feature maps, the self-attention mechanism was introduced to refine the balance feature, in order to better restore the semantic information of some pests with similar appearances. Subsequently, the group normalization method was used to replace the batch normalization method in the original model, to reduce the impact of batch size on model training. The IP102 rice pest dataset was used to train and verify this model. The experimental results showed that the model can accurately detect nine kinds of rice pests, such as rice leaf rollers and rice leaf caterpillars. Compared with FasterRCNN, RetinaNet, CP-FCOS, VFNet and BiFA-YOLO, the mean average precision of the model improved by 33.7%, 6.5%, 4.5%, 2.9% and 2% respectively.
doi_str_mv 10.1109/ACCESS.2022.3194925
format Article
fullrecord <record><control><sourceid>proquest_ieee_</sourceid><recordid>TN_cdi_ieee_primary_9844737</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>9844737</ieee_id><doaj_id>oai_doaj_org_article_0061c63372f946a8a202424fd103bf4e</doaj_id><sourcerecordid>2703098989</sourcerecordid><originalsourceid>FETCH-LOGICAL-c408t-5bedddefc27614375bd14299052f2bffcaca8b687f7b3fe6483b3310482ba6cd3</originalsourceid><addsrcrecordid>eNpNkMtOwzAQRSMEElXpF3QTiXWKX_FjwSIqLVQqAlFYW44zRqlCXZxkwd_jkKrCXtgzuvd6fJJkjtECY6TuiuVytdstCCJkQbFiiuQXyYRgrjKaU375736dzNp2j-KSsZWLSXJfpDtoXFZ0HRy62h_SNZiuD5Cu-3Yon30FTep8SN9qC-krtF36AB3YQXyTXDnTtDA7ndPkY716Xz5l25fHzbLYZpYh2WV5CVVVgbNEcMyoyMsKM6IUyokjpXPWWCNLLoUTJXXAmaQlpRgxSUrDbUWnyWbMrbzZ62Oov0z40d7U-q_hw6c2oattAxohji2nVBCnGDfSRC6MMFdhREvHIGbdjlnH4L_7-B299304xPE1EYgiJeOOKjqqbPBtG8CdX8VID9j1iF0P2PUJe3TNR1cNAGeHkowJKugvJFR8BQ</addsrcrecordid><sourcetype>Open Website</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2703098989</pqid></control><display><type>article</type><title>A Self-Attention Feature Fusion Model for Rice Pest Detection</title><source>IEEE Open Access Journals</source><source>DOAJ Directory of Open Access Journals</source><source>EZB-FREE-00999 freely available EZB journals</source><creator>Li, Shuaifeng ; Wang, Heng ; Zhang, Cong ; Liu, Jie</creator><creatorcontrib>Li, Shuaifeng ; Wang, Heng ; Zhang, Cong ; Liu, Jie</creatorcontrib><description>To address the problem that existing deep learning methods are not sufficiently accurate to detect rice pests with changeable shapes or similar appearances, a self-attention feature fusion model for rice pest detection (SAFFPest) was proposed. The model was based on VarifocalNet. First, a deformable convolution module was added to the feature extraction network, to improve the feature extraction ability of pests with changeable shapes. Second, by obtaining the balance features of multiple feature maps, the self-attention mechanism was introduced to refine the balance feature, in order to better restore the semantic information of some pests with similar appearances. Subsequently, the group normalization method was used to replace the batch normalization method in the original model, to reduce the impact of batch size on model training. The IP102 rice pest dataset was used to train and verify this model. The experimental results showed that the model can accurately detect nine kinds of rice pests, such as rice leaf rollers and rice leaf caterpillars. Compared with FasterRCNN, RetinaNet, CP-FCOS, VFNet and BiFA-YOLO, the mean average precision of the model improved by 33.7%, 6.5%, 4.5%, 2.9% and 2% respectively.</description><identifier>ISSN: 2169-3536</identifier><identifier>EISSN: 2169-3536</identifier><identifier>DOI: 10.1109/ACCESS.2022.3194925</identifier><identifier>CODEN: IAECCG</identifier><language>eng</language><publisher>Piscataway: IEEE</publisher><subject>Biological system modeling ; computer vision ; Convolution ; Convolutional neural networks ; deep learning ; Feature extraction ; Feature maps ; Formability ; Machine learning ; object detection ; Pest detection ; Pests ; SAFFPest model ; Semantics ; Shape</subject><ispartof>IEEE access, 2022, Vol.10, p.84063-84077</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2022</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c408t-5bedddefc27614375bd14299052f2bffcaca8b687f7b3fe6483b3310482ba6cd3</citedby><cites>FETCH-LOGICAL-c408t-5bedddefc27614375bd14299052f2bffcaca8b687f7b3fe6483b3310482ba6cd3</cites><orcidid>0000-0002-9624-1655 ; 0000-0003-2606-3424 ; 0000-0003-0678-817X</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/9844737$$EHTML$$P50$$Gieee$$Hfree_for_read</linktohtml><link.rule.ids>314,780,784,864,2102,4024,27633,27923,27924,27925,54933</link.rule.ids></links><search><creatorcontrib>Li, Shuaifeng</creatorcontrib><creatorcontrib>Wang, Heng</creatorcontrib><creatorcontrib>Zhang, Cong</creatorcontrib><creatorcontrib>Liu, Jie</creatorcontrib><title>A Self-Attention Feature Fusion Model for Rice Pest Detection</title><title>IEEE access</title><addtitle>Access</addtitle><description>To address the problem that existing deep learning methods are not sufficiently accurate to detect rice pests with changeable shapes or similar appearances, a self-attention feature fusion model for rice pest detection (SAFFPest) was proposed. The model was based on VarifocalNet. First, a deformable convolution module was added to the feature extraction network, to improve the feature extraction ability of pests with changeable shapes. Second, by obtaining the balance features of multiple feature maps, the self-attention mechanism was introduced to refine the balance feature, in order to better restore the semantic information of some pests with similar appearances. Subsequently, the group normalization method was used to replace the batch normalization method in the original model, to reduce the impact of batch size on model training. The IP102 rice pest dataset was used to train and verify this model. The experimental results showed that the model can accurately detect nine kinds of rice pests, such as rice leaf rollers and rice leaf caterpillars. Compared with FasterRCNN, RetinaNet, CP-FCOS, VFNet and BiFA-YOLO, the mean average precision of the model improved by 33.7%, 6.5%, 4.5%, 2.9% and 2% respectively.</description><subject>Biological system modeling</subject><subject>computer vision</subject><subject>Convolution</subject><subject>Convolutional neural networks</subject><subject>deep learning</subject><subject>Feature extraction</subject><subject>Feature maps</subject><subject>Formability</subject><subject>Machine learning</subject><subject>object detection</subject><subject>Pest detection</subject><subject>Pests</subject><subject>SAFFPest model</subject><subject>Semantics</subject><subject>Shape</subject><issn>2169-3536</issn><issn>2169-3536</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><sourceid>ESBDL</sourceid><sourceid>RIE</sourceid><sourceid>DOA</sourceid><recordid>eNpNkMtOwzAQRSMEElXpF3QTiXWKX_FjwSIqLVQqAlFYW44zRqlCXZxkwd_jkKrCXtgzuvd6fJJkjtECY6TuiuVytdstCCJkQbFiiuQXyYRgrjKaU375736dzNp2j-KSsZWLSXJfpDtoXFZ0HRy62h_SNZiuD5Cu-3Yon30FTep8SN9qC-krtF36AB3YQXyTXDnTtDA7ndPkY716Xz5l25fHzbLYZpYh2WV5CVVVgbNEcMyoyMsKM6IUyokjpXPWWCNLLoUTJXXAmaQlpRgxSUrDbUWnyWbMrbzZ62Oov0z40d7U-q_hw6c2oattAxohji2nVBCnGDfSRC6MMFdhREvHIGbdjlnH4L_7-B299304xPE1EYgiJeOOKjqqbPBtG8CdX8VID9j1iF0P2PUJe3TNR1cNAGeHkowJKugvJFR8BQ</recordid><startdate>2022</startdate><enddate>2022</enddate><creator>Li, Shuaifeng</creator><creator>Wang, Heng</creator><creator>Zhang, Cong</creator><creator>Liu, Jie</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>ESBDL</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7SP</scope><scope>7SR</scope><scope>8BQ</scope><scope>8FD</scope><scope>JG9</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>DOA</scope><orcidid>https://orcid.org/0000-0002-9624-1655</orcidid><orcidid>https://orcid.org/0000-0003-2606-3424</orcidid><orcidid>https://orcid.org/0000-0003-0678-817X</orcidid></search><sort><creationdate>2022</creationdate><title>A Self-Attention Feature Fusion Model for Rice Pest Detection</title><author>Li, Shuaifeng ; Wang, Heng ; Zhang, Cong ; Liu, Jie</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c408t-5bedddefc27614375bd14299052f2bffcaca8b687f7b3fe6483b3310482ba6cd3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>Biological system modeling</topic><topic>computer vision</topic><topic>Convolution</topic><topic>Convolutional neural networks</topic><topic>deep learning</topic><topic>Feature extraction</topic><topic>Feature maps</topic><topic>Formability</topic><topic>Machine learning</topic><topic>object detection</topic><topic>Pest detection</topic><topic>Pests</topic><topic>SAFFPest model</topic><topic>Semantics</topic><topic>Shape</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Li, Shuaifeng</creatorcontrib><creatorcontrib>Wang, Heng</creatorcontrib><creatorcontrib>Zhang, Cong</creatorcontrib><creatorcontrib>Liu, Jie</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE Open Access Journals</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics &amp; Communications Abstracts</collection><collection>Engineered Materials Abstracts</collection><collection>METADEX</collection><collection>Technology Research Database</collection><collection>Materials Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>DOAJ Directory of Open Access Journals</collection><jtitle>IEEE access</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Li, Shuaifeng</au><au>Wang, Heng</au><au>Zhang, Cong</au><au>Liu, Jie</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>A Self-Attention Feature Fusion Model for Rice Pest Detection</atitle><jtitle>IEEE access</jtitle><stitle>Access</stitle><date>2022</date><risdate>2022</risdate><volume>10</volume><spage>84063</spage><epage>84077</epage><pages>84063-84077</pages><issn>2169-3536</issn><eissn>2169-3536</eissn><coden>IAECCG</coden><abstract>To address the problem that existing deep learning methods are not sufficiently accurate to detect rice pests with changeable shapes or similar appearances, a self-attention feature fusion model for rice pest detection (SAFFPest) was proposed. The model was based on VarifocalNet. First, a deformable convolution module was added to the feature extraction network, to improve the feature extraction ability of pests with changeable shapes. Second, by obtaining the balance features of multiple feature maps, the self-attention mechanism was introduced to refine the balance feature, in order to better restore the semantic information of some pests with similar appearances. Subsequently, the group normalization method was used to replace the batch normalization method in the original model, to reduce the impact of batch size on model training. The IP102 rice pest dataset was used to train and verify this model. The experimental results showed that the model can accurately detect nine kinds of rice pests, such as rice leaf rollers and rice leaf caterpillars. Compared with FasterRCNN, RetinaNet, CP-FCOS, VFNet and BiFA-YOLO, the mean average precision of the model improved by 33.7%, 6.5%, 4.5%, 2.9% and 2% respectively.</abstract><cop>Piscataway</cop><pub>IEEE</pub><doi>10.1109/ACCESS.2022.3194925</doi><tpages>15</tpages><orcidid>https://orcid.org/0000-0002-9624-1655</orcidid><orcidid>https://orcid.org/0000-0003-2606-3424</orcidid><orcidid>https://orcid.org/0000-0003-0678-817X</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 2169-3536
ispartof IEEE access, 2022, Vol.10, p.84063-84077
issn 2169-3536
2169-3536
language eng
recordid cdi_ieee_primary_9844737
source IEEE Open Access Journals; DOAJ Directory of Open Access Journals; EZB-FREE-00999 freely available EZB journals
subjects Biological system modeling
computer vision
Convolution
Convolutional neural networks
deep learning
Feature extraction
Feature maps
Formability
Machine learning
object detection
Pest detection
Pests
SAFFPest model
Semantics
Shape
title A Self-Attention Feature Fusion Model for Rice Pest Detection
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-26T20%3A41%3A52IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_ieee_&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=A%20Self-Attention%20Feature%20Fusion%20Model%20for%20Rice%20Pest%20Detection&rft.jtitle=IEEE%20access&rft.au=Li,%20Shuaifeng&rft.date=2022&rft.volume=10&rft.spage=84063&rft.epage=84077&rft.pages=84063-84077&rft.issn=2169-3536&rft.eissn=2169-3536&rft.coden=IAECCG&rft_id=info:doi/10.1109/ACCESS.2022.3194925&rft_dat=%3Cproquest_ieee_%3E2703098989%3C/proquest_ieee_%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2703098989&rft_id=info:pmid/&rft_ieee_id=9844737&rft_doaj_id=oai_doaj_org_article_0061c63372f946a8a202424fd103bf4e&rfr_iscdi=true