A Self-Attention Feature Fusion Model for Rice Pest Detection
To address the problem that existing deep learning methods are not sufficiently accurate to detect rice pests with changeable shapes or similar appearances, a self-attention feature fusion model for rice pest detection (SAFFPest) was proposed. The model was based on VarifocalNet. First, a deformable...
Gespeichert in:
Veröffentlicht in: | IEEE access 2022, Vol.10, p.84063-84077 |
---|---|
Hauptverfasser: | , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 84077 |
---|---|
container_issue | |
container_start_page | 84063 |
container_title | IEEE access |
container_volume | 10 |
creator | Li, Shuaifeng Wang, Heng Zhang, Cong Liu, Jie |
description | To address the problem that existing deep learning methods are not sufficiently accurate to detect rice pests with changeable shapes or similar appearances, a self-attention feature fusion model for rice pest detection (SAFFPest) was proposed. The model was based on VarifocalNet. First, a deformable convolution module was added to the feature extraction network, to improve the feature extraction ability of pests with changeable shapes. Second, by obtaining the balance features of multiple feature maps, the self-attention mechanism was introduced to refine the balance feature, in order to better restore the semantic information of some pests with similar appearances. Subsequently, the group normalization method was used to replace the batch normalization method in the original model, to reduce the impact of batch size on model training. The IP102 rice pest dataset was used to train and verify this model. The experimental results showed that the model can accurately detect nine kinds of rice pests, such as rice leaf rollers and rice leaf caterpillars. Compared with FasterRCNN, RetinaNet, CP-FCOS, VFNet and BiFA-YOLO, the mean average precision of the model improved by 33.7%, 6.5%, 4.5%, 2.9% and 2% respectively. |
doi_str_mv | 10.1109/ACCESS.2022.3194925 |
format | Article |
fullrecord | <record><control><sourceid>proquest_ieee_</sourceid><recordid>TN_cdi_ieee_primary_9844737</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>9844737</ieee_id><doaj_id>oai_doaj_org_article_0061c63372f946a8a202424fd103bf4e</doaj_id><sourcerecordid>2703098989</sourcerecordid><originalsourceid>FETCH-LOGICAL-c408t-5bedddefc27614375bd14299052f2bffcaca8b687f7b3fe6483b3310482ba6cd3</originalsourceid><addsrcrecordid>eNpNkMtOwzAQRSMEElXpF3QTiXWKX_FjwSIqLVQqAlFYW44zRqlCXZxkwd_jkKrCXtgzuvd6fJJkjtECY6TuiuVytdstCCJkQbFiiuQXyYRgrjKaU375736dzNp2j-KSsZWLSXJfpDtoXFZ0HRy62h_SNZiuD5Cu-3Yon30FTep8SN9qC-krtF36AB3YQXyTXDnTtDA7ndPkY716Xz5l25fHzbLYZpYh2WV5CVVVgbNEcMyoyMsKM6IUyokjpXPWWCNLLoUTJXXAmaQlpRgxSUrDbUWnyWbMrbzZ62Oov0z40d7U-q_hw6c2oattAxohji2nVBCnGDfSRC6MMFdhREvHIGbdjlnH4L_7-B299304xPE1EYgiJeOOKjqqbPBtG8CdX8VID9j1iF0P2PUJe3TNR1cNAGeHkowJKugvJFR8BQ</addsrcrecordid><sourcetype>Open Website</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2703098989</pqid></control><display><type>article</type><title>A Self-Attention Feature Fusion Model for Rice Pest Detection</title><source>IEEE Open Access Journals</source><source>DOAJ Directory of Open Access Journals</source><source>EZB-FREE-00999 freely available EZB journals</source><creator>Li, Shuaifeng ; Wang, Heng ; Zhang, Cong ; Liu, Jie</creator><creatorcontrib>Li, Shuaifeng ; Wang, Heng ; Zhang, Cong ; Liu, Jie</creatorcontrib><description>To address the problem that existing deep learning methods are not sufficiently accurate to detect rice pests with changeable shapes or similar appearances, a self-attention feature fusion model for rice pest detection (SAFFPest) was proposed. The model was based on VarifocalNet. First, a deformable convolution module was added to the feature extraction network, to improve the feature extraction ability of pests with changeable shapes. Second, by obtaining the balance features of multiple feature maps, the self-attention mechanism was introduced to refine the balance feature, in order to better restore the semantic information of some pests with similar appearances. Subsequently, the group normalization method was used to replace the batch normalization method in the original model, to reduce the impact of batch size on model training. The IP102 rice pest dataset was used to train and verify this model. The experimental results showed that the model can accurately detect nine kinds of rice pests, such as rice leaf rollers and rice leaf caterpillars. Compared with FasterRCNN, RetinaNet, CP-FCOS, VFNet and BiFA-YOLO, the mean average precision of the model improved by 33.7%, 6.5%, 4.5%, 2.9% and 2% respectively.</description><identifier>ISSN: 2169-3536</identifier><identifier>EISSN: 2169-3536</identifier><identifier>DOI: 10.1109/ACCESS.2022.3194925</identifier><identifier>CODEN: IAECCG</identifier><language>eng</language><publisher>Piscataway: IEEE</publisher><subject>Biological system modeling ; computer vision ; Convolution ; Convolutional neural networks ; deep learning ; Feature extraction ; Feature maps ; Formability ; Machine learning ; object detection ; Pest detection ; Pests ; SAFFPest model ; Semantics ; Shape</subject><ispartof>IEEE access, 2022, Vol.10, p.84063-84077</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2022</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c408t-5bedddefc27614375bd14299052f2bffcaca8b687f7b3fe6483b3310482ba6cd3</citedby><cites>FETCH-LOGICAL-c408t-5bedddefc27614375bd14299052f2bffcaca8b687f7b3fe6483b3310482ba6cd3</cites><orcidid>0000-0002-9624-1655 ; 0000-0003-2606-3424 ; 0000-0003-0678-817X</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/9844737$$EHTML$$P50$$Gieee$$Hfree_for_read</linktohtml><link.rule.ids>314,780,784,864,2102,4024,27633,27923,27924,27925,54933</link.rule.ids></links><search><creatorcontrib>Li, Shuaifeng</creatorcontrib><creatorcontrib>Wang, Heng</creatorcontrib><creatorcontrib>Zhang, Cong</creatorcontrib><creatorcontrib>Liu, Jie</creatorcontrib><title>A Self-Attention Feature Fusion Model for Rice Pest Detection</title><title>IEEE access</title><addtitle>Access</addtitle><description>To address the problem that existing deep learning methods are not sufficiently accurate to detect rice pests with changeable shapes or similar appearances, a self-attention feature fusion model for rice pest detection (SAFFPest) was proposed. The model was based on VarifocalNet. First, a deformable convolution module was added to the feature extraction network, to improve the feature extraction ability of pests with changeable shapes. Second, by obtaining the balance features of multiple feature maps, the self-attention mechanism was introduced to refine the balance feature, in order to better restore the semantic information of some pests with similar appearances. Subsequently, the group normalization method was used to replace the batch normalization method in the original model, to reduce the impact of batch size on model training. The IP102 rice pest dataset was used to train and verify this model. The experimental results showed that the model can accurately detect nine kinds of rice pests, such as rice leaf rollers and rice leaf caterpillars. Compared with FasterRCNN, RetinaNet, CP-FCOS, VFNet and BiFA-YOLO, the mean average precision of the model improved by 33.7%, 6.5%, 4.5%, 2.9% and 2% respectively.</description><subject>Biological system modeling</subject><subject>computer vision</subject><subject>Convolution</subject><subject>Convolutional neural networks</subject><subject>deep learning</subject><subject>Feature extraction</subject><subject>Feature maps</subject><subject>Formability</subject><subject>Machine learning</subject><subject>object detection</subject><subject>Pest detection</subject><subject>Pests</subject><subject>SAFFPest model</subject><subject>Semantics</subject><subject>Shape</subject><issn>2169-3536</issn><issn>2169-3536</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><sourceid>ESBDL</sourceid><sourceid>RIE</sourceid><sourceid>DOA</sourceid><recordid>eNpNkMtOwzAQRSMEElXpF3QTiXWKX_FjwSIqLVQqAlFYW44zRqlCXZxkwd_jkKrCXtgzuvd6fJJkjtECY6TuiuVytdstCCJkQbFiiuQXyYRgrjKaU375736dzNp2j-KSsZWLSXJfpDtoXFZ0HRy62h_SNZiuD5Cu-3Yon30FTep8SN9qC-krtF36AB3YQXyTXDnTtDA7ndPkY716Xz5l25fHzbLYZpYh2WV5CVVVgbNEcMyoyMsKM6IUyokjpXPWWCNLLoUTJXXAmaQlpRgxSUrDbUWnyWbMrbzZ62Oov0z40d7U-q_hw6c2oattAxohji2nVBCnGDfSRC6MMFdhREvHIGbdjlnH4L_7-B299304xPE1EYgiJeOOKjqqbPBtG8CdX8VID9j1iF0P2PUJe3TNR1cNAGeHkowJKugvJFR8BQ</recordid><startdate>2022</startdate><enddate>2022</enddate><creator>Li, Shuaifeng</creator><creator>Wang, Heng</creator><creator>Zhang, Cong</creator><creator>Liu, Jie</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>ESBDL</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7SP</scope><scope>7SR</scope><scope>8BQ</scope><scope>8FD</scope><scope>JG9</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>DOA</scope><orcidid>https://orcid.org/0000-0002-9624-1655</orcidid><orcidid>https://orcid.org/0000-0003-2606-3424</orcidid><orcidid>https://orcid.org/0000-0003-0678-817X</orcidid></search><sort><creationdate>2022</creationdate><title>A Self-Attention Feature Fusion Model for Rice Pest Detection</title><author>Li, Shuaifeng ; Wang, Heng ; Zhang, Cong ; Liu, Jie</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c408t-5bedddefc27614375bd14299052f2bffcaca8b687f7b3fe6483b3310482ba6cd3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>Biological system modeling</topic><topic>computer vision</topic><topic>Convolution</topic><topic>Convolutional neural networks</topic><topic>deep learning</topic><topic>Feature extraction</topic><topic>Feature maps</topic><topic>Formability</topic><topic>Machine learning</topic><topic>object detection</topic><topic>Pest detection</topic><topic>Pests</topic><topic>SAFFPest model</topic><topic>Semantics</topic><topic>Shape</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Li, Shuaifeng</creatorcontrib><creatorcontrib>Wang, Heng</creatorcontrib><creatorcontrib>Zhang, Cong</creatorcontrib><creatorcontrib>Liu, Jie</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE Open Access Journals</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics & Communications Abstracts</collection><collection>Engineered Materials Abstracts</collection><collection>METADEX</collection><collection>Technology Research Database</collection><collection>Materials Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>DOAJ Directory of Open Access Journals</collection><jtitle>IEEE access</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Li, Shuaifeng</au><au>Wang, Heng</au><au>Zhang, Cong</au><au>Liu, Jie</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>A Self-Attention Feature Fusion Model for Rice Pest Detection</atitle><jtitle>IEEE access</jtitle><stitle>Access</stitle><date>2022</date><risdate>2022</risdate><volume>10</volume><spage>84063</spage><epage>84077</epage><pages>84063-84077</pages><issn>2169-3536</issn><eissn>2169-3536</eissn><coden>IAECCG</coden><abstract>To address the problem that existing deep learning methods are not sufficiently accurate to detect rice pests with changeable shapes or similar appearances, a self-attention feature fusion model for rice pest detection (SAFFPest) was proposed. The model was based on VarifocalNet. First, a deformable convolution module was added to the feature extraction network, to improve the feature extraction ability of pests with changeable shapes. Second, by obtaining the balance features of multiple feature maps, the self-attention mechanism was introduced to refine the balance feature, in order to better restore the semantic information of some pests with similar appearances. Subsequently, the group normalization method was used to replace the batch normalization method in the original model, to reduce the impact of batch size on model training. The IP102 rice pest dataset was used to train and verify this model. The experimental results showed that the model can accurately detect nine kinds of rice pests, such as rice leaf rollers and rice leaf caterpillars. Compared with FasterRCNN, RetinaNet, CP-FCOS, VFNet and BiFA-YOLO, the mean average precision of the model improved by 33.7%, 6.5%, 4.5%, 2.9% and 2% respectively.</abstract><cop>Piscataway</cop><pub>IEEE</pub><doi>10.1109/ACCESS.2022.3194925</doi><tpages>15</tpages><orcidid>https://orcid.org/0000-0002-9624-1655</orcidid><orcidid>https://orcid.org/0000-0003-2606-3424</orcidid><orcidid>https://orcid.org/0000-0003-0678-817X</orcidid><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | ISSN: 2169-3536 |
ispartof | IEEE access, 2022, Vol.10, p.84063-84077 |
issn | 2169-3536 2169-3536 |
language | eng |
recordid | cdi_ieee_primary_9844737 |
source | IEEE Open Access Journals; DOAJ Directory of Open Access Journals; EZB-FREE-00999 freely available EZB journals |
subjects | Biological system modeling computer vision Convolution Convolutional neural networks deep learning Feature extraction Feature maps Formability Machine learning object detection Pest detection Pests SAFFPest model Semantics Shape |
title | A Self-Attention Feature Fusion Model for Rice Pest Detection |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-26T20%3A41%3A52IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_ieee_&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=A%20Self-Attention%20Feature%20Fusion%20Model%20for%20Rice%20Pest%20Detection&rft.jtitle=IEEE%20access&rft.au=Li,%20Shuaifeng&rft.date=2022&rft.volume=10&rft.spage=84063&rft.epage=84077&rft.pages=84063-84077&rft.issn=2169-3536&rft.eissn=2169-3536&rft.coden=IAECCG&rft_id=info:doi/10.1109/ACCESS.2022.3194925&rft_dat=%3Cproquest_ieee_%3E2703098989%3C/proquest_ieee_%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2703098989&rft_id=info:pmid/&rft_ieee_id=9844737&rft_doaj_id=oai_doaj_org_article_0061c63372f946a8a202424fd103bf4e&rfr_iscdi=true |