Plant disease recognition in a low data scenario using few-shot learning

Plant disease is one of the major problems in agriculture. Diseases damage plants, reduce yields and lower the quality of the produce. Traditional approaches to detecting plant diseases are usually based on visual inspection and laboratory testing, which can be expensive and time-consuming. They req...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Computers and electronics in agriculture 2024-04, Vol.219, p.108812, Article 108812
Hauptverfasser: Rezaei, Masoud, Diepeveen, Dean, Laga, Hamid, Jones, Michael G.K., Sohel, Ferdous
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page 108812
container_title Computers and electronics in agriculture
container_volume 219
creator Rezaei, Masoud
Diepeveen, Dean
Laga, Hamid
Jones, Michael G.K.
Sohel, Ferdous
description Plant disease is one of the major problems in agriculture. Diseases damage plants, reduce yields and lower the quality of the produce. Traditional approaches to detecting plant diseases are usually based on visual inspection and laboratory testing, which can be expensive and time-consuming. They require trained plant pathologists as well as specialised equipment. Several studies demonstrate that artificial intelligence (AI) methods can produce promising results. However, AI methods are generally data-hungry and require large annotated datasets, and the collection and annotation of such datasets can be a limiting factor. It often appears that only a small amount of data is available for certain disease types. Whereas the performance of typical AI methods drops significantly when they are trained with inadequate data. This paper proposes a novel few-shot learning (FSL) method to detect plant diseases and alleviate the data scarcity problem. The proposed method uses as few as five images per class in the machine learning process. Our method is based on a state-of-the-art FSL pipeline called pre-training, meta-learning, and fine-tuning (PMF), integrated with a novel feature attention (FA) module; we call the overall method PMF+FA. The FA module emphasises the discriminative parts in the image and reduces the impact of complicated backgrounds and undesired objects. We used ResNet50 and Vision Transformers (ViT) as the feature learner. Two publicly available plant disease datasets were repurposed to meet the FSL requirements. We thoroughly evaluated the proposed method on the PlantDoc dataset, which contains disease samples in field environments with complex backgrounds and unwanted objects. The PMF+FA method with ViT achieved an average accuracy of 90.12% in disease recognition. The results demonstrate that the PMF+FA pipeline consistently outperforms the baseline PMF. The results also highlight that the method using ViT generates better results than ResNet50 for diagnosing complex data. ViT and ResNet50 implementations are computationally efficient, taking 1.11 and 0.57 ms on average per image to evaluate the test set respectively. The high throughput and high-quality performance with only a small training dataset indicate that the proposed technique can be used for real-time disease detection in digital farming systems. •A few-shot learning approach is proposed for detecting plant diseases from images.•High performance was achieved using only a few training i
doi_str_mv 10.1016/j.compag.2024.108812
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_3153551708</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S0168169924002035</els_id><sourcerecordid>3153551708</sourcerecordid><originalsourceid>FETCH-LOGICAL-c385t-eb6059a4b651eaa860649fa8ac037dec4941347fbc7401e6060a8443c93c4da73</originalsourceid><addsrcrecordid>eNp9kDFPwzAQhS0EEqXwDxg8sqTYsRM7CxKqoEWqBAPM1tW5FFepXeyUin-PqzAzne7du6e7j5Bbzmac8fp-O7Nht4fNrGSlzJLWvDwjE65VWSjO1DmZZJsueN00l-QqpS3LfaPVhCzfevADbV1CSEgj2rDxbnDBU-cp0D4caQsD0GTRQ3SBHpLzG9rhsUifYaA9QvRZuSYXHfQJb_7qlHw8P73Pl8XqdfEyf1wVVuhqKHBds6oBua4rjgC6ZrVsOtBgmVAtWtlILqTq1lZJxjGPGWgphW2ElS0oMSV3Y-4-hq8DpsHsXL6tz29gOCQjeCWqiiums1WOVhtDShE7s49uB_HHcGZO4MzWjODMCZwZweW1h3EN8xvfDqNJ1qG32LqMZzBtcP8H_AIAE3gI</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>3153551708</pqid></control><display><type>article</type><title>Plant disease recognition in a low data scenario using few-shot learning</title><source>Elsevier ScienceDirect Journals</source><creator>Rezaei, Masoud ; Diepeveen, Dean ; Laga, Hamid ; Jones, Michael G.K. ; Sohel, Ferdous</creator><creatorcontrib>Rezaei, Masoud ; Diepeveen, Dean ; Laga, Hamid ; Jones, Michael G.K. ; Sohel, Ferdous</creatorcontrib><description>Plant disease is one of the major problems in agriculture. Diseases damage plants, reduce yields and lower the quality of the produce. Traditional approaches to detecting plant diseases are usually based on visual inspection and laboratory testing, which can be expensive and time-consuming. They require trained plant pathologists as well as specialised equipment. Several studies demonstrate that artificial intelligence (AI) methods can produce promising results. However, AI methods are generally data-hungry and require large annotated datasets, and the collection and annotation of such datasets can be a limiting factor. It often appears that only a small amount of data is available for certain disease types. Whereas the performance of typical AI methods drops significantly when they are trained with inadequate data. This paper proposes a novel few-shot learning (FSL) method to detect plant diseases and alleviate the data scarcity problem. The proposed method uses as few as five images per class in the machine learning process. Our method is based on a state-of-the-art FSL pipeline called pre-training, meta-learning, and fine-tuning (PMF), integrated with a novel feature attention (FA) module; we call the overall method PMF+FA. The FA module emphasises the discriminative parts in the image and reduces the impact of complicated backgrounds and undesired objects. We used ResNet50 and Vision Transformers (ViT) as the feature learner. Two publicly available plant disease datasets were repurposed to meet the FSL requirements. We thoroughly evaluated the proposed method on the PlantDoc dataset, which contains disease samples in field environments with complex backgrounds and unwanted objects. The PMF+FA method with ViT achieved an average accuracy of 90.12% in disease recognition. The results demonstrate that the PMF+FA pipeline consistently outperforms the baseline PMF. The results also highlight that the method using ViT generates better results than ResNet50 for diagnosing complex data. ViT and ResNet50 implementations are computationally efficient, taking 1.11 and 0.57 ms on average per image to evaluate the test set respectively. The high throughput and high-quality performance with only a small training dataset indicate that the proposed technique can be used for real-time disease detection in digital farming systems. •A few-shot learning approach is proposed for detecting plant diseases from images.•High performance was achieved using only a few training images per disease.•Vision transformers further improve performance, especially on complex samples.•Our proposed attention module reduces the impact of complicated backgrounds.•The high throughput and performance indicate its potential in precision farming.</description><identifier>ISSN: 0168-1699</identifier><identifier>EISSN: 1872-7107</identifier><identifier>DOI: 10.1016/j.compag.2024.108812</identifier><language>eng</language><publisher>Elsevier B.V</publisher><subject>agriculture ; artificial intelligence ; class ; data collection ; Deep learning ; Digital agriculture ; disease detection ; electronics ; Feature attention ; vision ; Vision transformer</subject><ispartof>Computers and electronics in agriculture, 2024-04, Vol.219, p.108812, Article 108812</ispartof><rights>2024 The Author(s)</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c385t-eb6059a4b651eaa860649fa8ac037dec4941347fbc7401e6060a8443c93c4da73</citedby><cites>FETCH-LOGICAL-c385t-eb6059a4b651eaa860649fa8ac037dec4941347fbc7401e6060a8443c93c4da73</cites><orcidid>0000-0003-1557-4907</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://dx.doi.org/10.1016/j.compag.2024.108812$$EHTML$$P50$$Gelsevier$$Hfree_for_read</linktohtml><link.rule.ids>314,776,780,3536,27903,27904,45974</link.rule.ids></links><search><creatorcontrib>Rezaei, Masoud</creatorcontrib><creatorcontrib>Diepeveen, Dean</creatorcontrib><creatorcontrib>Laga, Hamid</creatorcontrib><creatorcontrib>Jones, Michael G.K.</creatorcontrib><creatorcontrib>Sohel, Ferdous</creatorcontrib><title>Plant disease recognition in a low data scenario using few-shot learning</title><title>Computers and electronics in agriculture</title><description>Plant disease is one of the major problems in agriculture. Diseases damage plants, reduce yields and lower the quality of the produce. Traditional approaches to detecting plant diseases are usually based on visual inspection and laboratory testing, which can be expensive and time-consuming. They require trained plant pathologists as well as specialised equipment. Several studies demonstrate that artificial intelligence (AI) methods can produce promising results. However, AI methods are generally data-hungry and require large annotated datasets, and the collection and annotation of such datasets can be a limiting factor. It often appears that only a small amount of data is available for certain disease types. Whereas the performance of typical AI methods drops significantly when they are trained with inadequate data. This paper proposes a novel few-shot learning (FSL) method to detect plant diseases and alleviate the data scarcity problem. The proposed method uses as few as five images per class in the machine learning process. Our method is based on a state-of-the-art FSL pipeline called pre-training, meta-learning, and fine-tuning (PMF), integrated with a novel feature attention (FA) module; we call the overall method PMF+FA. The FA module emphasises the discriminative parts in the image and reduces the impact of complicated backgrounds and undesired objects. We used ResNet50 and Vision Transformers (ViT) as the feature learner. Two publicly available plant disease datasets were repurposed to meet the FSL requirements. We thoroughly evaluated the proposed method on the PlantDoc dataset, which contains disease samples in field environments with complex backgrounds and unwanted objects. The PMF+FA method with ViT achieved an average accuracy of 90.12% in disease recognition. The results demonstrate that the PMF+FA pipeline consistently outperforms the baseline PMF. The results also highlight that the method using ViT generates better results than ResNet50 for diagnosing complex data. ViT and ResNet50 implementations are computationally efficient, taking 1.11 and 0.57 ms on average per image to evaluate the test set respectively. The high throughput and high-quality performance with only a small training dataset indicate that the proposed technique can be used for real-time disease detection in digital farming systems. •A few-shot learning approach is proposed for detecting plant diseases from images.•High performance was achieved using only a few training images per disease.•Vision transformers further improve performance, especially on complex samples.•Our proposed attention module reduces the impact of complicated backgrounds.•The high throughput and performance indicate its potential in precision farming.</description><subject>agriculture</subject><subject>artificial intelligence</subject><subject>class</subject><subject>data collection</subject><subject>Deep learning</subject><subject>Digital agriculture</subject><subject>disease detection</subject><subject>electronics</subject><subject>Feature attention</subject><subject>vision</subject><subject>Vision transformer</subject><issn>0168-1699</issn><issn>1872-7107</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><recordid>eNp9kDFPwzAQhS0EEqXwDxg8sqTYsRM7CxKqoEWqBAPM1tW5FFepXeyUin-PqzAzne7du6e7j5Bbzmac8fp-O7Nht4fNrGSlzJLWvDwjE65VWSjO1DmZZJsueN00l-QqpS3LfaPVhCzfevADbV1CSEgj2rDxbnDBU-cp0D4caQsD0GTRQ3SBHpLzG9rhsUifYaA9QvRZuSYXHfQJb_7qlHw8P73Pl8XqdfEyf1wVVuhqKHBds6oBua4rjgC6ZrVsOtBgmVAtWtlILqTq1lZJxjGPGWgphW2ElS0oMSV3Y-4-hq8DpsHsXL6tz29gOCQjeCWqiiums1WOVhtDShE7s49uB_HHcGZO4MzWjODMCZwZweW1h3EN8xvfDqNJ1qG32LqMZzBtcP8H_AIAE3gI</recordid><startdate>202404</startdate><enddate>202404</enddate><creator>Rezaei, Masoud</creator><creator>Diepeveen, Dean</creator><creator>Laga, Hamid</creator><creator>Jones, Michael G.K.</creator><creator>Sohel, Ferdous</creator><general>Elsevier B.V</general><scope>6I.</scope><scope>AAFTH</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7S9</scope><scope>L.6</scope><orcidid>https://orcid.org/0000-0003-1557-4907</orcidid></search><sort><creationdate>202404</creationdate><title>Plant disease recognition in a low data scenario using few-shot learning</title><author>Rezaei, Masoud ; Diepeveen, Dean ; Laga, Hamid ; Jones, Michael G.K. ; Sohel, Ferdous</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c385t-eb6059a4b651eaa860649fa8ac037dec4941347fbc7401e6060a8443c93c4da73</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>agriculture</topic><topic>artificial intelligence</topic><topic>class</topic><topic>data collection</topic><topic>Deep learning</topic><topic>Digital agriculture</topic><topic>disease detection</topic><topic>electronics</topic><topic>Feature attention</topic><topic>vision</topic><topic>Vision transformer</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Rezaei, Masoud</creatorcontrib><creatorcontrib>Diepeveen, Dean</creatorcontrib><creatorcontrib>Laga, Hamid</creatorcontrib><creatorcontrib>Jones, Michael G.K.</creatorcontrib><creatorcontrib>Sohel, Ferdous</creatorcontrib><collection>ScienceDirect Open Access Titles</collection><collection>Elsevier:ScienceDirect:Open Access</collection><collection>CrossRef</collection><collection>AGRICOLA</collection><collection>AGRICOLA - Academic</collection><jtitle>Computers and electronics in agriculture</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Rezaei, Masoud</au><au>Diepeveen, Dean</au><au>Laga, Hamid</au><au>Jones, Michael G.K.</au><au>Sohel, Ferdous</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Plant disease recognition in a low data scenario using few-shot learning</atitle><jtitle>Computers and electronics in agriculture</jtitle><date>2024-04</date><risdate>2024</risdate><volume>219</volume><spage>108812</spage><pages>108812-</pages><artnum>108812</artnum><issn>0168-1699</issn><eissn>1872-7107</eissn><abstract>Plant disease is one of the major problems in agriculture. Diseases damage plants, reduce yields and lower the quality of the produce. Traditional approaches to detecting plant diseases are usually based on visual inspection and laboratory testing, which can be expensive and time-consuming. They require trained plant pathologists as well as specialised equipment. Several studies demonstrate that artificial intelligence (AI) methods can produce promising results. However, AI methods are generally data-hungry and require large annotated datasets, and the collection and annotation of such datasets can be a limiting factor. It often appears that only a small amount of data is available for certain disease types. Whereas the performance of typical AI methods drops significantly when they are trained with inadequate data. This paper proposes a novel few-shot learning (FSL) method to detect plant diseases and alleviate the data scarcity problem. The proposed method uses as few as five images per class in the machine learning process. Our method is based on a state-of-the-art FSL pipeline called pre-training, meta-learning, and fine-tuning (PMF), integrated with a novel feature attention (FA) module; we call the overall method PMF+FA. The FA module emphasises the discriminative parts in the image and reduces the impact of complicated backgrounds and undesired objects. We used ResNet50 and Vision Transformers (ViT) as the feature learner. Two publicly available plant disease datasets were repurposed to meet the FSL requirements. We thoroughly evaluated the proposed method on the PlantDoc dataset, which contains disease samples in field environments with complex backgrounds and unwanted objects. The PMF+FA method with ViT achieved an average accuracy of 90.12% in disease recognition. The results demonstrate that the PMF+FA pipeline consistently outperforms the baseline PMF. The results also highlight that the method using ViT generates better results than ResNet50 for diagnosing complex data. ViT and ResNet50 implementations are computationally efficient, taking 1.11 and 0.57 ms on average per image to evaluate the test set respectively. The high throughput and high-quality performance with only a small training dataset indicate that the proposed technique can be used for real-time disease detection in digital farming systems. •A few-shot learning approach is proposed for detecting plant diseases from images.•High performance was achieved using only a few training images per disease.•Vision transformers further improve performance, especially on complex samples.•Our proposed attention module reduces the impact of complicated backgrounds.•The high throughput and performance indicate its potential in precision farming.</abstract><pub>Elsevier B.V</pub><doi>10.1016/j.compag.2024.108812</doi><orcidid>https://orcid.org/0000-0003-1557-4907</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 0168-1699
ispartof Computers and electronics in agriculture, 2024-04, Vol.219, p.108812, Article 108812
issn 0168-1699
1872-7107
language eng
recordid cdi_proquest_miscellaneous_3153551708
source Elsevier ScienceDirect Journals
subjects agriculture
artificial intelligence
class
data collection
Deep learning
Digital agriculture
disease detection
electronics
Feature attention
vision
Vision transformer
title Plant disease recognition in a low data scenario using few-shot learning
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-22T08%3A02%3A16IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Plant%20disease%20recognition%20in%20a%20low%20data%20scenario%20using%20few-shot%20learning&rft.jtitle=Computers%20and%20electronics%20in%20agriculture&rft.au=Rezaei,%20Masoud&rft.date=2024-04&rft.volume=219&rft.spage=108812&rft.pages=108812-&rft.artnum=108812&rft.issn=0168-1699&rft.eissn=1872-7107&rft_id=info:doi/10.1016/j.compag.2024.108812&rft_dat=%3Cproquest_cross%3E3153551708%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=3153551708&rft_id=info:pmid/&rft_els_id=S0168169924002035&rfr_iscdi=true