Revolutionizing Agriculture: Real-Time Ripe Tomato Detection With the Enhanced Tomato-YOLOv7 System

Traditional agricultural practices of hand-picking ripe tomatoes are labor-intensive and inefficient for large-scale harvesting. To address this, we propose an innovative approach using the YOLOv7 algorithm for ripe tomato detection, enabling robotic arms to perform the picking. However, the occlusi...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE access 2023, Vol.11, p.133086-133098
Hauptverfasser: Guo, Jun, Yang, Yue, Lin, Xinyan, Memon, Muhammad Sohail, Liu, Wei, Zhang, Meiqi, Sun, Enhui
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 133098
container_issue
container_start_page 133086
container_title IEEE access
container_volume 11
creator Guo, Jun
Yang, Yue
Lin, Xinyan
Memon, Muhammad Sohail
Liu, Wei
Zhang, Meiqi
Sun, Enhui
description Traditional agricultural practices of hand-picking ripe tomatoes are labor-intensive and inefficient for large-scale harvesting. To address this, we propose an innovative approach using the YOLOv7 algorithm for ripe tomato detection, enabling robotic arms to perform the picking. However, the occlusion of tomatoes in the field often leads to unclear target features, causing false or missed detections. So it is worth studying and this paper proposes a tomato detection method based on improved YOLOv7. The novelty is shown below. First, a new structure called ReplkDext is redesigned to increase the receptive field. ReplkDext is introduced before the last layer of CBS in the backbone. Secondly, to overcome the problem of low FLOPS caused by frequent access to memory in traditional neural networks, the head structure of YOLOv7 is redesigned. By using FasterNet to optimize the structure between Concat and CBS in the head, FasterNet makes the model balance between running speed and detection accuracy. Finally, to improve the ability of convolution, ODConv is added after the last ELANN-2 structure in the Head layer. ODConv improves the feature extraction ability of small targets and obtains more feature information about ripe tomatoes. Experiments show that compared with YOLOv7, Map@.5 of Tomato-YOLOv7 has increased by 1.3%. The model is overall better than other models. The overall contribution of the Tomato-YOLO model is to provide important insights into agricultural product detection and provide a theoretical basis for automated tomato harvesting in orchards.
doi_str_mv 10.1109/ACCESS.2023.3336562
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_crossref_primary_10_1109_ACCESS_2023_3336562</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>10328593</ieee_id><doaj_id>oai_doaj_org_article_6f4bd5d1bc1a4ba3bba5fd41bf0833a3</doaj_id><sourcerecordid>2895874901</sourcerecordid><originalsourceid>FETCH-LOGICAL-c409t-a40850f23a8e1488dc2e92ed7b6ed615772dea48c5614525d40aa8bdc490b7533</originalsourceid><addsrcrecordid>eNpNUctq20AUFSWFhDRf0CwGspYzT2nUnXGcNGAw2C6lq2EeV_YYWeOMRobk6ytXpuRu7uVwHhdOln0neEIIrh6ns9l8vZ5QTNmEMVaIgn7JbigpqpwJVlx9uq-zu67b42HkAInyJrMrOIWmTz60_sO3WzTdRm_7JvURfqAV6Cbf-AOglT8C2oSDTgE9QQJ7VqDfPu1Q2gGatzvdWnAXSv5nuVieSrR-7xIcvmVfa910cHfZt9mv5_lm9jNfLF9eZ9NFbjmuUq45lgLXlGkJhEvpLIWKgitNAa4goiypA82lFQXhggrHsdbSOMsrbErB2G32Ovq6oPfqGP1Bx3cVtFf_gBC3SsfkbQOqqLlxwhFjieZGM2O0qB0npsaSMX32ehi9jjG89dAltQ99bIf3FZWVkOUQSgYWG1k2hq6LUP9PJVidy1FjOepcjrqUM6juR5UHgE8KRqWoGPsLZ_6LLQ</addsrcrecordid><sourcetype>Open Website</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2895874901</pqid></control><display><type>article</type><title>Revolutionizing Agriculture: Real-Time Ripe Tomato Detection With the Enhanced Tomato-YOLOv7 System</title><source>DOAJ Directory of Open Access Journals</source><source>IEEE Xplore Open Access Journals</source><source>EZB Electronic Journals Library</source><creator>Guo, Jun ; Yang, Yue ; Lin, Xinyan ; Memon, Muhammad Sohail ; Liu, Wei ; Zhang, Meiqi ; Sun, Enhui</creator><creatorcontrib>Guo, Jun ; Yang, Yue ; Lin, Xinyan ; Memon, Muhammad Sohail ; Liu, Wei ; Zhang, Meiqi ; Sun, Enhui</creatorcontrib><description>Traditional agricultural practices of hand-picking ripe tomatoes are labor-intensive and inefficient for large-scale harvesting. To address this, we propose an innovative approach using the YOLOv7 algorithm for ripe tomato detection, enabling robotic arms to perform the picking. However, the occlusion of tomatoes in the field often leads to unclear target features, causing false or missed detections. So it is worth studying and this paper proposes a tomato detection method based on improved YOLOv7. The novelty is shown below. First, a new structure called ReplkDext is redesigned to increase the receptive field. ReplkDext is introduced before the last layer of CBS in the backbone. Secondly, to overcome the problem of low FLOPS caused by frequent access to memory in traditional neural networks, the head structure of YOLOv7 is redesigned. By using FasterNet to optimize the structure between Concat and CBS in the head, FasterNet makes the model balance between running speed and detection accuracy. Finally, to improve the ability of convolution, ODConv is added after the last ELANN-2 structure in the Head layer. ODConv improves the feature extraction ability of small targets and obtains more feature information about ripe tomatoes. Experiments show that compared with YOLOv7, Map@.5 of Tomato-YOLOv7 has increased by 1.3%. The model is overall better than other models. The overall contribution of the Tomato-YOLO model is to provide important insights into agricultural product detection and provide a theoretical basis for automated tomato harvesting in orchards.</description><identifier>ISSN: 2169-3536</identifier><identifier>EISSN: 2169-3536</identifier><identifier>DOI: 10.1109/ACCESS.2023.3336562</identifier><identifier>CODEN: IAECCG</identifier><language>eng</language><publisher>Piscataway: IEEE</publisher><subject>Agricultural practices ; Algorithms ; Crops ; Feature extraction ; Harvesting ; improved YOLOv7 ; Magnetic heads ; missed detection ; Neural networks ; Occlusion ; Picking ; Remote sensing ; Residual neural networks ; Robot arms ; Smart agriculture ; target detection ; Tomato ; Tomatoes ; Training ; YOLO</subject><ispartof>IEEE access, 2023, Vol.11, p.133086-133098</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2023</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c409t-a40850f23a8e1488dc2e92ed7b6ed615772dea48c5614525d40aa8bdc490b7533</citedby><cites>FETCH-LOGICAL-c409t-a40850f23a8e1488dc2e92ed7b6ed615772dea48c5614525d40aa8bdc490b7533</cites><orcidid>0000-0003-4355-9720</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/10328593$$EHTML$$P50$$Gieee$$Hfree_for_read</linktohtml><link.rule.ids>314,780,784,864,2102,4024,27633,27923,27924,27925,54933</link.rule.ids></links><search><creatorcontrib>Guo, Jun</creatorcontrib><creatorcontrib>Yang, Yue</creatorcontrib><creatorcontrib>Lin, Xinyan</creatorcontrib><creatorcontrib>Memon, Muhammad Sohail</creatorcontrib><creatorcontrib>Liu, Wei</creatorcontrib><creatorcontrib>Zhang, Meiqi</creatorcontrib><creatorcontrib>Sun, Enhui</creatorcontrib><title>Revolutionizing Agriculture: Real-Time Ripe Tomato Detection With the Enhanced Tomato-YOLOv7 System</title><title>IEEE access</title><addtitle>Access</addtitle><description>Traditional agricultural practices of hand-picking ripe tomatoes are labor-intensive and inefficient for large-scale harvesting. To address this, we propose an innovative approach using the YOLOv7 algorithm for ripe tomato detection, enabling robotic arms to perform the picking. However, the occlusion of tomatoes in the field often leads to unclear target features, causing false or missed detections. So it is worth studying and this paper proposes a tomato detection method based on improved YOLOv7. The novelty is shown below. First, a new structure called ReplkDext is redesigned to increase the receptive field. ReplkDext is introduced before the last layer of CBS in the backbone. Secondly, to overcome the problem of low FLOPS caused by frequent access to memory in traditional neural networks, the head structure of YOLOv7 is redesigned. By using FasterNet to optimize the structure between Concat and CBS in the head, FasterNet makes the model balance between running speed and detection accuracy. Finally, to improve the ability of convolution, ODConv is added after the last ELANN-2 structure in the Head layer. ODConv improves the feature extraction ability of small targets and obtains more feature information about ripe tomatoes. Experiments show that compared with YOLOv7, Map@.5 of Tomato-YOLOv7 has increased by 1.3%. The model is overall better than other models. The overall contribution of the Tomato-YOLO model is to provide important insights into agricultural product detection and provide a theoretical basis for automated tomato harvesting in orchards.</description><subject>Agricultural practices</subject><subject>Algorithms</subject><subject>Crops</subject><subject>Feature extraction</subject><subject>Harvesting</subject><subject>improved YOLOv7</subject><subject>Magnetic heads</subject><subject>missed detection</subject><subject>Neural networks</subject><subject>Occlusion</subject><subject>Picking</subject><subject>Remote sensing</subject><subject>Residual neural networks</subject><subject>Robot arms</subject><subject>Smart agriculture</subject><subject>target detection</subject><subject>Tomato</subject><subject>Tomatoes</subject><subject>Training</subject><subject>YOLO</subject><issn>2169-3536</issn><issn>2169-3536</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><sourceid>ESBDL</sourceid><sourceid>RIE</sourceid><sourceid>DOA</sourceid><recordid>eNpNUctq20AUFSWFhDRf0CwGspYzT2nUnXGcNGAw2C6lq2EeV_YYWeOMRobk6ytXpuRu7uVwHhdOln0neEIIrh6ns9l8vZ5QTNmEMVaIgn7JbigpqpwJVlx9uq-zu67b42HkAInyJrMrOIWmTz60_sO3WzTdRm_7JvURfqAV6Cbf-AOglT8C2oSDTgE9QQJ7VqDfPu1Q2gGatzvdWnAXSv5nuVieSrR-7xIcvmVfa910cHfZt9mv5_lm9jNfLF9eZ9NFbjmuUq45lgLXlGkJhEvpLIWKgitNAa4goiypA82lFQXhggrHsdbSOMsrbErB2G32Ovq6oPfqGP1Bx3cVtFf_gBC3SsfkbQOqqLlxwhFjieZGM2O0qB0npsaSMX32ehi9jjG89dAltQ99bIf3FZWVkOUQSgYWG1k2hq6LUP9PJVidy1FjOepcjrqUM6juR5UHgE8KRqWoGPsLZ_6LLQ</recordid><startdate>2023</startdate><enddate>2023</enddate><creator>Guo, Jun</creator><creator>Yang, Yue</creator><creator>Lin, Xinyan</creator><creator>Memon, Muhammad Sohail</creator><creator>Liu, Wei</creator><creator>Zhang, Meiqi</creator><creator>Sun, Enhui</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>ESBDL</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7SP</scope><scope>7SR</scope><scope>8BQ</scope><scope>8FD</scope><scope>JG9</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>DOA</scope><orcidid>https://orcid.org/0000-0003-4355-9720</orcidid></search><sort><creationdate>2023</creationdate><title>Revolutionizing Agriculture: Real-Time Ripe Tomato Detection With the Enhanced Tomato-YOLOv7 System</title><author>Guo, Jun ; Yang, Yue ; Lin, Xinyan ; Memon, Muhammad Sohail ; Liu, Wei ; Zhang, Meiqi ; Sun, Enhui</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c409t-a40850f23a8e1488dc2e92ed7b6ed615772dea48c5614525d40aa8bdc490b7533</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Agricultural practices</topic><topic>Algorithms</topic><topic>Crops</topic><topic>Feature extraction</topic><topic>Harvesting</topic><topic>improved YOLOv7</topic><topic>Magnetic heads</topic><topic>missed detection</topic><topic>Neural networks</topic><topic>Occlusion</topic><topic>Picking</topic><topic>Remote sensing</topic><topic>Residual neural networks</topic><topic>Robot arms</topic><topic>Smart agriculture</topic><topic>target detection</topic><topic>Tomato</topic><topic>Tomatoes</topic><topic>Training</topic><topic>YOLO</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Guo, Jun</creatorcontrib><creatorcontrib>Yang, Yue</creatorcontrib><creatorcontrib>Lin, Xinyan</creatorcontrib><creatorcontrib>Memon, Muhammad Sohail</creatorcontrib><creatorcontrib>Liu, Wei</creatorcontrib><creatorcontrib>Zhang, Meiqi</creatorcontrib><creatorcontrib>Sun, Enhui</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE Xplore Open Access Journals</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics &amp; Communications Abstracts</collection><collection>Engineered Materials Abstracts</collection><collection>METADEX</collection><collection>Technology Research Database</collection><collection>Materials Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>DOAJ Directory of Open Access Journals</collection><jtitle>IEEE access</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Guo, Jun</au><au>Yang, Yue</au><au>Lin, Xinyan</au><au>Memon, Muhammad Sohail</au><au>Liu, Wei</au><au>Zhang, Meiqi</au><au>Sun, Enhui</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Revolutionizing Agriculture: Real-Time Ripe Tomato Detection With the Enhanced Tomato-YOLOv7 System</atitle><jtitle>IEEE access</jtitle><stitle>Access</stitle><date>2023</date><risdate>2023</risdate><volume>11</volume><spage>133086</spage><epage>133098</epage><pages>133086-133098</pages><issn>2169-3536</issn><eissn>2169-3536</eissn><coden>IAECCG</coden><abstract>Traditional agricultural practices of hand-picking ripe tomatoes are labor-intensive and inefficient for large-scale harvesting. To address this, we propose an innovative approach using the YOLOv7 algorithm for ripe tomato detection, enabling robotic arms to perform the picking. However, the occlusion of tomatoes in the field often leads to unclear target features, causing false or missed detections. So it is worth studying and this paper proposes a tomato detection method based on improved YOLOv7. The novelty is shown below. First, a new structure called ReplkDext is redesigned to increase the receptive field. ReplkDext is introduced before the last layer of CBS in the backbone. Secondly, to overcome the problem of low FLOPS caused by frequent access to memory in traditional neural networks, the head structure of YOLOv7 is redesigned. By using FasterNet to optimize the structure between Concat and CBS in the head, FasterNet makes the model balance between running speed and detection accuracy. Finally, to improve the ability of convolution, ODConv is added after the last ELANN-2 structure in the Head layer. ODConv improves the feature extraction ability of small targets and obtains more feature information about ripe tomatoes. Experiments show that compared with YOLOv7, Map@.5 of Tomato-YOLOv7 has increased by 1.3%. The model is overall better than other models. The overall contribution of the Tomato-YOLO model is to provide important insights into agricultural product detection and provide a theoretical basis for automated tomato harvesting in orchards.</abstract><cop>Piscataway</cop><pub>IEEE</pub><doi>10.1109/ACCESS.2023.3336562</doi><tpages>13</tpages><orcidid>https://orcid.org/0000-0003-4355-9720</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 2169-3536
ispartof IEEE access, 2023, Vol.11, p.133086-133098
issn 2169-3536
2169-3536
language eng
recordid cdi_crossref_primary_10_1109_ACCESS_2023_3336562
source DOAJ Directory of Open Access Journals; IEEE Xplore Open Access Journals; EZB Electronic Journals Library
subjects Agricultural practices
Algorithms
Crops
Feature extraction
Harvesting
improved YOLOv7
Magnetic heads
missed detection
Neural networks
Occlusion
Picking
Remote sensing
Residual neural networks
Robot arms
Smart agriculture
target detection
Tomato
Tomatoes
Training
YOLO
title Revolutionizing Agriculture: Real-Time Ripe Tomato Detection With the Enhanced Tomato-YOLOv7 System
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-20T23%3A47%3A35IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Revolutionizing%20Agriculture:%20Real-Time%20Ripe%20Tomato%20Detection%20With%20the%20Enhanced%20Tomato-YOLOv7%20System&rft.jtitle=IEEE%20access&rft.au=Guo,%20Jun&rft.date=2023&rft.volume=11&rft.spage=133086&rft.epage=133098&rft.pages=133086-133098&rft.issn=2169-3536&rft.eissn=2169-3536&rft.coden=IAECCG&rft_id=info:doi/10.1109/ACCESS.2023.3336562&rft_dat=%3Cproquest_cross%3E2895874901%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2895874901&rft_id=info:pmid/&rft_ieee_id=10328593&rft_doaj_id=oai_doaj_org_article_6f4bd5d1bc1a4ba3bba5fd41bf0833a3&rfr_iscdi=true