Algorithm Design and Integration for a Robotic Apple Harvesting System

Due to labor shortage and rising labor cost for the apple industry, there is an urgent need for the development of robotic systems to efficiently and autonomously harvest apples. In this paper, we present a system overview and algorithm design of our recently developed robotic apple harvester protot...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Zhang, Kaixiang, Lammers, Kyle, Chu, Pengyu, Dickinson, Nathan, Li, Zhaojian, Lu, Renfu
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator Zhang, Kaixiang
Lammers, Kyle
Chu, Pengyu
Dickinson, Nathan
Li, Zhaojian
Lu, Renfu
description Due to labor shortage and rising labor cost for the apple industry, there is an urgent need for the development of robotic systems to efficiently and autonomously harvest apples. In this paper, we present a system overview and algorithm design of our recently developed robotic apple harvester prototype. Our robotic system is enabled by the close integration of several core modules, including visual perception, planning, and control. This paper covers the main methods and advancements in deep learning-based multi-view fruit detection and localization, unified picking and dropping planning, and dexterous manipulation control. Indoor and field experiments were conducted to evaluate the performance of the developed system, which achieved an average picking rate of 3.6 seconds per apple. This is a significant improvement over other reported apple harvesting robots with a picking rate in the range of 7-10 seconds per apple. The current prototype shows promising performance towards further development of efficient and automated apple harvesting technology. Finally, limitations of the current system and future work are discussed.
doi_str_mv 10.48550/arxiv.2203.00582
format Article
fullrecord <record><control><sourceid>arxiv_GOX</sourceid><recordid>TN_cdi_arxiv_primary_2203_00582</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2203_00582</sourcerecordid><originalsourceid>FETCH-LOGICAL-a672-7ba79983f0ab30d963e0bc78d26304f26482950b6724786910755cbb7e25d6e13</originalsourceid><addsrcrecordid>eNotz71OwzAYhWEvDKhwAUz4BhK-2PHfGBVKK1VCgu7R58QJlhI7cqyK3j1QmM7y6kgPIQ8VlLUWAp4wfflzyRjwEkBodkt2zTTG5PPnTJ_d6sdAMfT0ELIbE2YfAx1iokjfo43Zd7RZlsnRPaazW7MPI_24rNnNd-RmwGl19_-7Iafdy2m7L45vr4dtcyxQKlYoi8oYzQdAy6E3kjuwndI9kxzqgclaMyPA_rS10tJUoITorFWOiV66im_I49_tFdIuyc-YLu0vqL2C-DeEXkSO</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Algorithm Design and Integration for a Robotic Apple Harvesting System</title><source>arXiv.org</source><creator>Zhang, Kaixiang ; Lammers, Kyle ; Chu, Pengyu ; Dickinson, Nathan ; Li, Zhaojian ; Lu, Renfu</creator><creatorcontrib>Zhang, Kaixiang ; Lammers, Kyle ; Chu, Pengyu ; Dickinson, Nathan ; Li, Zhaojian ; Lu, Renfu</creatorcontrib><description>Due to labor shortage and rising labor cost for the apple industry, there is an urgent need for the development of robotic systems to efficiently and autonomously harvest apples. In this paper, we present a system overview and algorithm design of our recently developed robotic apple harvester prototype. Our robotic system is enabled by the close integration of several core modules, including visual perception, planning, and control. This paper covers the main methods and advancements in deep learning-based multi-view fruit detection and localization, unified picking and dropping planning, and dexterous manipulation control. Indoor and field experiments were conducted to evaluate the performance of the developed system, which achieved an average picking rate of 3.6 seconds per apple. This is a significant improvement over other reported apple harvesting robots with a picking rate in the range of 7-10 seconds per apple. The current prototype shows promising performance towards further development of efficient and automated apple harvesting technology. Finally, limitations of the current system and future work are discussed.</description><identifier>DOI: 10.48550/arxiv.2203.00582</identifier><language>eng</language><subject>Computer Science - Robotics ; Computer Science - Systems and Control</subject><creationdate>2022-03</creationdate><rights>http://arxiv.org/licenses/nonexclusive-distrib/1.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,776,881</link.rule.ids><linktorsrc>$$Uhttps://arxiv.org/abs/2203.00582$$EView_record_in_Cornell_University$$FView_record_in_$$GCornell_University$$Hfree_for_read</linktorsrc><backlink>$$Uhttps://doi.org/10.48550/arXiv.2203.00582$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Zhang, Kaixiang</creatorcontrib><creatorcontrib>Lammers, Kyle</creatorcontrib><creatorcontrib>Chu, Pengyu</creatorcontrib><creatorcontrib>Dickinson, Nathan</creatorcontrib><creatorcontrib>Li, Zhaojian</creatorcontrib><creatorcontrib>Lu, Renfu</creatorcontrib><title>Algorithm Design and Integration for a Robotic Apple Harvesting System</title><description>Due to labor shortage and rising labor cost for the apple industry, there is an urgent need for the development of robotic systems to efficiently and autonomously harvest apples. In this paper, we present a system overview and algorithm design of our recently developed robotic apple harvester prototype. Our robotic system is enabled by the close integration of several core modules, including visual perception, planning, and control. This paper covers the main methods and advancements in deep learning-based multi-view fruit detection and localization, unified picking and dropping planning, and dexterous manipulation control. Indoor and field experiments were conducted to evaluate the performance of the developed system, which achieved an average picking rate of 3.6 seconds per apple. This is a significant improvement over other reported apple harvesting robots with a picking rate in the range of 7-10 seconds per apple. The current prototype shows promising performance towards further development of efficient and automated apple harvesting technology. Finally, limitations of the current system and future work are discussed.</description><subject>Computer Science - Robotics</subject><subject>Computer Science - Systems and Control</subject><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><sourceid>GOX</sourceid><recordid>eNotz71OwzAYhWEvDKhwAUz4BhK-2PHfGBVKK1VCgu7R58QJlhI7cqyK3j1QmM7y6kgPIQ8VlLUWAp4wfflzyRjwEkBodkt2zTTG5PPnTJ_d6sdAMfT0ELIbE2YfAx1iokjfo43Zd7RZlsnRPaazW7MPI_24rNnNd-RmwGl19_-7Iafdy2m7L45vr4dtcyxQKlYoi8oYzQdAy6E3kjuwndI9kxzqgclaMyPA_rS10tJUoITorFWOiV66im_I49_tFdIuyc-YLu0vqL2C-DeEXkSO</recordid><startdate>20220301</startdate><enddate>20220301</enddate><creator>Zhang, Kaixiang</creator><creator>Lammers, Kyle</creator><creator>Chu, Pengyu</creator><creator>Dickinson, Nathan</creator><creator>Li, Zhaojian</creator><creator>Lu, Renfu</creator><scope>AKY</scope><scope>GOX</scope></search><sort><creationdate>20220301</creationdate><title>Algorithm Design and Integration for a Robotic Apple Harvesting System</title><author>Zhang, Kaixiang ; Lammers, Kyle ; Chu, Pengyu ; Dickinson, Nathan ; Li, Zhaojian ; Lu, Renfu</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a672-7ba79983f0ab30d963e0bc78d26304f26482950b6724786910755cbb7e25d6e13</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>Computer Science - Robotics</topic><topic>Computer Science - Systems and Control</topic><toplevel>online_resources</toplevel><creatorcontrib>Zhang, Kaixiang</creatorcontrib><creatorcontrib>Lammers, Kyle</creatorcontrib><creatorcontrib>Chu, Pengyu</creatorcontrib><creatorcontrib>Dickinson, Nathan</creatorcontrib><creatorcontrib>Li, Zhaojian</creatorcontrib><creatorcontrib>Lu, Renfu</creatorcontrib><collection>arXiv Computer Science</collection><collection>arXiv.org</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Zhang, Kaixiang</au><au>Lammers, Kyle</au><au>Chu, Pengyu</au><au>Dickinson, Nathan</au><au>Li, Zhaojian</au><au>Lu, Renfu</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Algorithm Design and Integration for a Robotic Apple Harvesting System</atitle><date>2022-03-01</date><risdate>2022</risdate><abstract>Due to labor shortage and rising labor cost for the apple industry, there is an urgent need for the development of robotic systems to efficiently and autonomously harvest apples. In this paper, we present a system overview and algorithm design of our recently developed robotic apple harvester prototype. Our robotic system is enabled by the close integration of several core modules, including visual perception, planning, and control. This paper covers the main methods and advancements in deep learning-based multi-view fruit detection and localization, unified picking and dropping planning, and dexterous manipulation control. Indoor and field experiments were conducted to evaluate the performance of the developed system, which achieved an average picking rate of 3.6 seconds per apple. This is a significant improvement over other reported apple harvesting robots with a picking rate in the range of 7-10 seconds per apple. The current prototype shows promising performance towards further development of efficient and automated apple harvesting technology. Finally, limitations of the current system and future work are discussed.</abstract><doi>10.48550/arxiv.2203.00582</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier DOI: 10.48550/arxiv.2203.00582
ispartof
issn
language eng
recordid cdi_arxiv_primary_2203_00582
source arXiv.org
subjects Computer Science - Robotics
Computer Science - Systems and Control
title Algorithm Design and Integration for a Robotic Apple Harvesting System
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-04T14%3A52%3A46IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-arxiv_GOX&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Algorithm%20Design%20and%20Integration%20for%20a%20Robotic%20Apple%20Harvesting%20System&rft.au=Zhang,%20Kaixiang&rft.date=2022-03-01&rft_id=info:doi/10.48550/arxiv.2203.00582&rft_dat=%3Carxiv_GOX%3E2203_00582%3C/arxiv_GOX%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true