Revolutionizing Agriculture: Real-Time Ripe Tomato Detection With the Enhanced Tomato-YOLOv7 System
Traditional agricultural practices of hand-picking ripe tomatoes are labor-intensive and inefficient for large-scale harvesting. To address this, we propose an innovative approach using the YOLOv7 algorithm for ripe tomato detection, enabling robotic arms to perform the picking. However, the occlusi...
Gespeichert in:
Veröffentlicht in: | IEEE access 2023, Vol.11, p.133086-133098 |
---|---|
Hauptverfasser: | , , , , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 133098 |
---|---|
container_issue | |
container_start_page | 133086 |
container_title | IEEE access |
container_volume | 11 |
creator | Guo, Jun Yang, Yue Lin, Xinyan Memon, Muhammad Sohail Liu, Wei Zhang, Meiqi Sun, Enhui |
description | Traditional agricultural practices of hand-picking ripe tomatoes are labor-intensive and inefficient for large-scale harvesting. To address this, we propose an innovative approach using the YOLOv7 algorithm for ripe tomato detection, enabling robotic arms to perform the picking. However, the occlusion of tomatoes in the field often leads to unclear target features, causing false or missed detections. So it is worth studying and this paper proposes a tomato detection method based on improved YOLOv7. The novelty is shown below. First, a new structure called ReplkDext is redesigned to increase the receptive field. ReplkDext is introduced before the last layer of CBS in the backbone. Secondly, to overcome the problem of low FLOPS caused by frequent access to memory in traditional neural networks, the head structure of YOLOv7 is redesigned. By using FasterNet to optimize the structure between Concat and CBS in the head, FasterNet makes the model balance between running speed and detection accuracy. Finally, to improve the ability of convolution, ODConv is added after the last ELANN-2 structure in the Head layer. ODConv improves the feature extraction ability of small targets and obtains more feature information about ripe tomatoes. Experiments show that compared with YOLOv7, Map@.5 of Tomato-YOLOv7 has increased by 1.3%. The model is overall better than other models. The overall contribution of the Tomato-YOLO model is to provide important insights into agricultural product detection and provide a theoretical basis for automated tomato harvesting in orchards. |
doi_str_mv | 10.1109/ACCESS.2023.3336562 |
format | Article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_crossref_primary_10_1109_ACCESS_2023_3336562</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>10328593</ieee_id><doaj_id>oai_doaj_org_article_6f4bd5d1bc1a4ba3bba5fd41bf0833a3</doaj_id><sourcerecordid>2895874901</sourcerecordid><originalsourceid>FETCH-LOGICAL-c409t-a40850f23a8e1488dc2e92ed7b6ed615772dea48c5614525d40aa8bdc490b7533</originalsourceid><addsrcrecordid>eNpNUctq20AUFSWFhDRf0CwGspYzT2nUnXGcNGAw2C6lq2EeV_YYWeOMRobk6ytXpuRu7uVwHhdOln0neEIIrh6ns9l8vZ5QTNmEMVaIgn7JbigpqpwJVlx9uq-zu67b42HkAInyJrMrOIWmTz60_sO3WzTdRm_7JvURfqAV6Cbf-AOglT8C2oSDTgE9QQJ7VqDfPu1Q2gGatzvdWnAXSv5nuVieSrR-7xIcvmVfa910cHfZt9mv5_lm9jNfLF9eZ9NFbjmuUq45lgLXlGkJhEvpLIWKgitNAa4goiypA82lFQXhggrHsdbSOMsrbErB2G32Ovq6oPfqGP1Bx3cVtFf_gBC3SsfkbQOqqLlxwhFjieZGM2O0qB0npsaSMX32ehi9jjG89dAltQ99bIf3FZWVkOUQSgYWG1k2hq6LUP9PJVidy1FjOepcjrqUM6juR5UHgE8KRqWoGPsLZ_6LLQ</addsrcrecordid><sourcetype>Open Website</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2895874901</pqid></control><display><type>article</type><title>Revolutionizing Agriculture: Real-Time Ripe Tomato Detection With the Enhanced Tomato-YOLOv7 System</title><source>DOAJ Directory of Open Access Journals</source><source>IEEE Xplore Open Access Journals</source><source>EZB Electronic Journals Library</source><creator>Guo, Jun ; Yang, Yue ; Lin, Xinyan ; Memon, Muhammad Sohail ; Liu, Wei ; Zhang, Meiqi ; Sun, Enhui</creator><creatorcontrib>Guo, Jun ; Yang, Yue ; Lin, Xinyan ; Memon, Muhammad Sohail ; Liu, Wei ; Zhang, Meiqi ; Sun, Enhui</creatorcontrib><description>Traditional agricultural practices of hand-picking ripe tomatoes are labor-intensive and inefficient for large-scale harvesting. To address this, we propose an innovative approach using the YOLOv7 algorithm for ripe tomato detection, enabling robotic arms to perform the picking. However, the occlusion of tomatoes in the field often leads to unclear target features, causing false or missed detections. So it is worth studying and this paper proposes a tomato detection method based on improved YOLOv7. The novelty is shown below. First, a new structure called ReplkDext is redesigned to increase the receptive field. ReplkDext is introduced before the last layer of CBS in the backbone. Secondly, to overcome the problem of low FLOPS caused by frequent access to memory in traditional neural networks, the head structure of YOLOv7 is redesigned. By using FasterNet to optimize the structure between Concat and CBS in the head, FasterNet makes the model balance between running speed and detection accuracy. Finally, to improve the ability of convolution, ODConv is added after the last ELANN-2 structure in the Head layer. ODConv improves the feature extraction ability of small targets and obtains more feature information about ripe tomatoes. Experiments show that compared with YOLOv7, Map@.5 of Tomato-YOLOv7 has increased by 1.3%. The model is overall better than other models. The overall contribution of the Tomato-YOLO model is to provide important insights into agricultural product detection and provide a theoretical basis for automated tomato harvesting in orchards.</description><identifier>ISSN: 2169-3536</identifier><identifier>EISSN: 2169-3536</identifier><identifier>DOI: 10.1109/ACCESS.2023.3336562</identifier><identifier>CODEN: IAECCG</identifier><language>eng</language><publisher>Piscataway: IEEE</publisher><subject>Agricultural practices ; Algorithms ; Crops ; Feature extraction ; Harvesting ; improved YOLOv7 ; Magnetic heads ; missed detection ; Neural networks ; Occlusion ; Picking ; Remote sensing ; Residual neural networks ; Robot arms ; Smart agriculture ; target detection ; Tomato ; Tomatoes ; Training ; YOLO</subject><ispartof>IEEE access, 2023, Vol.11, p.133086-133098</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2023</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c409t-a40850f23a8e1488dc2e92ed7b6ed615772dea48c5614525d40aa8bdc490b7533</citedby><cites>FETCH-LOGICAL-c409t-a40850f23a8e1488dc2e92ed7b6ed615772dea48c5614525d40aa8bdc490b7533</cites><orcidid>0000-0003-4355-9720</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/10328593$$EHTML$$P50$$Gieee$$Hfree_for_read</linktohtml><link.rule.ids>314,780,784,864,2102,4024,27633,27923,27924,27925,54933</link.rule.ids></links><search><creatorcontrib>Guo, Jun</creatorcontrib><creatorcontrib>Yang, Yue</creatorcontrib><creatorcontrib>Lin, Xinyan</creatorcontrib><creatorcontrib>Memon, Muhammad Sohail</creatorcontrib><creatorcontrib>Liu, Wei</creatorcontrib><creatorcontrib>Zhang, Meiqi</creatorcontrib><creatorcontrib>Sun, Enhui</creatorcontrib><title>Revolutionizing Agriculture: Real-Time Ripe Tomato Detection With the Enhanced Tomato-YOLOv7 System</title><title>IEEE access</title><addtitle>Access</addtitle><description>Traditional agricultural practices of hand-picking ripe tomatoes are labor-intensive and inefficient for large-scale harvesting. To address this, we propose an innovative approach using the YOLOv7 algorithm for ripe tomato detection, enabling robotic arms to perform the picking. However, the occlusion of tomatoes in the field often leads to unclear target features, causing false or missed detections. So it is worth studying and this paper proposes a tomato detection method based on improved YOLOv7. The novelty is shown below. First, a new structure called ReplkDext is redesigned to increase the receptive field. ReplkDext is introduced before the last layer of CBS in the backbone. Secondly, to overcome the problem of low FLOPS caused by frequent access to memory in traditional neural networks, the head structure of YOLOv7 is redesigned. By using FasterNet to optimize the structure between Concat and CBS in the head, FasterNet makes the model balance between running speed and detection accuracy. Finally, to improve the ability of convolution, ODConv is added after the last ELANN-2 structure in the Head layer. ODConv improves the feature extraction ability of small targets and obtains more feature information about ripe tomatoes. Experiments show that compared with YOLOv7, Map@.5 of Tomato-YOLOv7 has increased by 1.3%. The model is overall better than other models. The overall contribution of the Tomato-YOLO model is to provide important insights into agricultural product detection and provide a theoretical basis for automated tomato harvesting in orchards.</description><subject>Agricultural practices</subject><subject>Algorithms</subject><subject>Crops</subject><subject>Feature extraction</subject><subject>Harvesting</subject><subject>improved YOLOv7</subject><subject>Magnetic heads</subject><subject>missed detection</subject><subject>Neural networks</subject><subject>Occlusion</subject><subject>Picking</subject><subject>Remote sensing</subject><subject>Residual neural networks</subject><subject>Robot arms</subject><subject>Smart agriculture</subject><subject>target detection</subject><subject>Tomato</subject><subject>Tomatoes</subject><subject>Training</subject><subject>YOLO</subject><issn>2169-3536</issn><issn>2169-3536</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><sourceid>ESBDL</sourceid><sourceid>RIE</sourceid><sourceid>DOA</sourceid><recordid>eNpNUctq20AUFSWFhDRf0CwGspYzT2nUnXGcNGAw2C6lq2EeV_YYWeOMRobk6ytXpuRu7uVwHhdOln0neEIIrh6ns9l8vZ5QTNmEMVaIgn7JbigpqpwJVlx9uq-zu67b42HkAInyJrMrOIWmTz60_sO3WzTdRm_7JvURfqAV6Cbf-AOglT8C2oSDTgE9QQJ7VqDfPu1Q2gGatzvdWnAXSv5nuVieSrR-7xIcvmVfa910cHfZt9mv5_lm9jNfLF9eZ9NFbjmuUq45lgLXlGkJhEvpLIWKgitNAa4goiypA82lFQXhggrHsdbSOMsrbErB2G32Ovq6oPfqGP1Bx3cVtFf_gBC3SsfkbQOqqLlxwhFjieZGM2O0qB0npsaSMX32ehi9jjG89dAltQ99bIf3FZWVkOUQSgYWG1k2hq6LUP9PJVidy1FjOepcjrqUM6juR5UHgE8KRqWoGPsLZ_6LLQ</recordid><startdate>2023</startdate><enddate>2023</enddate><creator>Guo, Jun</creator><creator>Yang, Yue</creator><creator>Lin, Xinyan</creator><creator>Memon, Muhammad Sohail</creator><creator>Liu, Wei</creator><creator>Zhang, Meiqi</creator><creator>Sun, Enhui</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>ESBDL</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7SP</scope><scope>7SR</scope><scope>8BQ</scope><scope>8FD</scope><scope>JG9</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>DOA</scope><orcidid>https://orcid.org/0000-0003-4355-9720</orcidid></search><sort><creationdate>2023</creationdate><title>Revolutionizing Agriculture: Real-Time Ripe Tomato Detection With the Enhanced Tomato-YOLOv7 System</title><author>Guo, Jun ; Yang, Yue ; Lin, Xinyan ; Memon, Muhammad Sohail ; Liu, Wei ; Zhang, Meiqi ; Sun, Enhui</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c409t-a40850f23a8e1488dc2e92ed7b6ed615772dea48c5614525d40aa8bdc490b7533</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Agricultural practices</topic><topic>Algorithms</topic><topic>Crops</topic><topic>Feature extraction</topic><topic>Harvesting</topic><topic>improved YOLOv7</topic><topic>Magnetic heads</topic><topic>missed detection</topic><topic>Neural networks</topic><topic>Occlusion</topic><topic>Picking</topic><topic>Remote sensing</topic><topic>Residual neural networks</topic><topic>Robot arms</topic><topic>Smart agriculture</topic><topic>target detection</topic><topic>Tomato</topic><topic>Tomatoes</topic><topic>Training</topic><topic>YOLO</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Guo, Jun</creatorcontrib><creatorcontrib>Yang, Yue</creatorcontrib><creatorcontrib>Lin, Xinyan</creatorcontrib><creatorcontrib>Memon, Muhammad Sohail</creatorcontrib><creatorcontrib>Liu, Wei</creatorcontrib><creatorcontrib>Zhang, Meiqi</creatorcontrib><creatorcontrib>Sun, Enhui</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE Xplore Open Access Journals</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics & Communications Abstracts</collection><collection>Engineered Materials Abstracts</collection><collection>METADEX</collection><collection>Technology Research Database</collection><collection>Materials Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>DOAJ Directory of Open Access Journals</collection><jtitle>IEEE access</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Guo, Jun</au><au>Yang, Yue</au><au>Lin, Xinyan</au><au>Memon, Muhammad Sohail</au><au>Liu, Wei</au><au>Zhang, Meiqi</au><au>Sun, Enhui</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Revolutionizing Agriculture: Real-Time Ripe Tomato Detection With the Enhanced Tomato-YOLOv7 System</atitle><jtitle>IEEE access</jtitle><stitle>Access</stitle><date>2023</date><risdate>2023</risdate><volume>11</volume><spage>133086</spage><epage>133098</epage><pages>133086-133098</pages><issn>2169-3536</issn><eissn>2169-3536</eissn><coden>IAECCG</coden><abstract>Traditional agricultural practices of hand-picking ripe tomatoes are labor-intensive and inefficient for large-scale harvesting. To address this, we propose an innovative approach using the YOLOv7 algorithm for ripe tomato detection, enabling robotic arms to perform the picking. However, the occlusion of tomatoes in the field often leads to unclear target features, causing false or missed detections. So it is worth studying and this paper proposes a tomato detection method based on improved YOLOv7. The novelty is shown below. First, a new structure called ReplkDext is redesigned to increase the receptive field. ReplkDext is introduced before the last layer of CBS in the backbone. Secondly, to overcome the problem of low FLOPS caused by frequent access to memory in traditional neural networks, the head structure of YOLOv7 is redesigned. By using FasterNet to optimize the structure between Concat and CBS in the head, FasterNet makes the model balance between running speed and detection accuracy. Finally, to improve the ability of convolution, ODConv is added after the last ELANN-2 structure in the Head layer. ODConv improves the feature extraction ability of small targets and obtains more feature information about ripe tomatoes. Experiments show that compared with YOLOv7, Map@.5 of Tomato-YOLOv7 has increased by 1.3%. The model is overall better than other models. The overall contribution of the Tomato-YOLO model is to provide important insights into agricultural product detection and provide a theoretical basis for automated tomato harvesting in orchards.</abstract><cop>Piscataway</cop><pub>IEEE</pub><doi>10.1109/ACCESS.2023.3336562</doi><tpages>13</tpages><orcidid>https://orcid.org/0000-0003-4355-9720</orcidid><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | ISSN: 2169-3536 |
ispartof | IEEE access, 2023, Vol.11, p.133086-133098 |
issn | 2169-3536 2169-3536 |
language | eng |
recordid | cdi_crossref_primary_10_1109_ACCESS_2023_3336562 |
source | DOAJ Directory of Open Access Journals; IEEE Xplore Open Access Journals; EZB Electronic Journals Library |
subjects | Agricultural practices Algorithms Crops Feature extraction Harvesting improved YOLOv7 Magnetic heads missed detection Neural networks Occlusion Picking Remote sensing Residual neural networks Robot arms Smart agriculture target detection Tomato Tomatoes Training YOLO |
title | Revolutionizing Agriculture: Real-Time Ripe Tomato Detection With the Enhanced Tomato-YOLOv7 System |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-20T23%3A47%3A35IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Revolutionizing%20Agriculture:%20Real-Time%20Ripe%20Tomato%20Detection%20With%20the%20Enhanced%20Tomato-YOLOv7%20System&rft.jtitle=IEEE%20access&rft.au=Guo,%20Jun&rft.date=2023&rft.volume=11&rft.spage=133086&rft.epage=133098&rft.pages=133086-133098&rft.issn=2169-3536&rft.eissn=2169-3536&rft.coden=IAECCG&rft_id=info:doi/10.1109/ACCESS.2023.3336562&rft_dat=%3Cproquest_cross%3E2895874901%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2895874901&rft_id=info:pmid/&rft_ieee_id=10328593&rft_doaj_id=oai_doaj_org_article_6f4bd5d1bc1a4ba3bba5fd41bf0833a3&rfr_iscdi=true |