Evaluation of cotton emergence using UAV-based imagery and deep learning

•Developed near real-time data processing framework for single UAV frames.•Developed a deep learning architecture for effective image data processing.•Evaluated stand count and seedling area autonomously.•Developed an open-source data processing pipeline available to the community. Crop emergence is...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Computers and electronics in agriculture 2020-10, Vol.177, p.105711, Article 105711
Hauptverfasser: Feng, Aijing, Zhou, Jianfeng, Vories, Earl, Sudduth, Kenneth A.
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page 105711
container_title Computers and electronics in agriculture
container_volume 177
creator Feng, Aijing
Zhou, Jianfeng
Vories, Earl
Sudduth, Kenneth A.
description •Developed near real-time data processing framework for single UAV frames.•Developed a deep learning architecture for effective image data processing.•Evaluated stand count and seedling area autonomously.•Developed an open-source data processing pipeline available to the community. Crop emergence is an important agronomic factor for making field management decisions, such as replanting, that are time-sensitive and need to be made at very early stages. Crop emergence, evaluated using plant population, stand count and uniformity, is conventionally quantified manually, not accurate, and labor and time intensive. Unmanned aerial vehicle (UAV)-based imaging systems are able to scout crop fields rapidly. However, data processing can be too slow to make timely decision making. The goal of this study was to develop a novel image processing method for processing UAV images in nearly real-time. In this study, a UAV imaging system was used to capture RGB image frames of cotton seedlings to evaluate stand count and canopy size. Images were pre-processed to correct distortions, calculate ground sample distance and geo-reference cotton rows in the images. A pre-trained deep learning model, resnet 18, was used to estimate stand count and canopy size of cotton seedlings in each image frame. Results showed that the developed method could estimate stand count accurately with R2 = 0.95 in the test dataset. Similar results were achieved for canopy size with an estimation accuracy of R2 = 0.93 in the test dataset. The processing time for each image frame of 20 M pixels with each crop row geo-referenced was 2.22 s (including 1.80 s for pre-processing), which was more efficient than traditional mosaic-based image processing methods. An open-source automated image-processing framework was developed for cotton emergence evaluation and is available to the community for efficient data processing and analytics.
doi_str_mv 10.1016/j.compag.2020.105711
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_2985573697</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S0168169920314216</els_id><sourcerecordid>2449675776</sourcerecordid><originalsourceid>FETCH-LOGICAL-c413t-d08e6a2a6c78ccde074bc6fb444b967f21159f5b00dc499410cda8127fd4221d3</originalsourceid><addsrcrecordid>eNp9kE1LwzAYx4MoOKffwEPBi5fOJEub5iKMoU4YeHFeQ5o8LSltM5N2sG9vSj158JQXfs_L_4fQPcErgkn-1Ky0646qXlFMp6-ME3KBFqTgNOUE80u0iFiRklyIa3QTQoPjWxR8gXYvJ9WOarCuT1yVaDcM8QYd-Bp6DckYbF8nh81XWqoAJrGdqsGfE9WbxAAckxaU7yNzi64q1Qa4-z2X6PD68rndpfuPt_ftZp9qRtZDanABuaIq17zQ2gDmrNR5VTLGSpHzihKSiSorMTaaCcEI1kYVhPLKMEqJWS_R49z36N33CGGQnQ0a2lb14MYgqSiyjK9zwSP68Adt3Oj7uJ2kjMVpGed5pNhMae9C8FDJo48p_VkSLCe9spGzXjnplbPeWPY8l0EMe7LgZdB2UmasBz1I4-z_DX4AosuD3g</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2449675776</pqid></control><display><type>article</type><title>Evaluation of cotton emergence using UAV-based imagery and deep learning</title><source>Elsevier ScienceDirect Journals</source><creator>Feng, Aijing ; Zhou, Jianfeng ; Vories, Earl ; Sudduth, Kenneth A.</creator><creatorcontrib>Feng, Aijing ; Zhou, Jianfeng ; Vories, Earl ; Sudduth, Kenneth A.</creatorcontrib><description>•Developed near real-time data processing framework for single UAV frames.•Developed a deep learning architecture for effective image data processing.•Evaluated stand count and seedling area autonomously.•Developed an open-source data processing pipeline available to the community. Crop emergence is an important agronomic factor for making field management decisions, such as replanting, that are time-sensitive and need to be made at very early stages. Crop emergence, evaluated using plant population, stand count and uniformity, is conventionally quantified manually, not accurate, and labor and time intensive. Unmanned aerial vehicle (UAV)-based imaging systems are able to scout crop fields rapidly. However, data processing can be too slow to make timely decision making. The goal of this study was to develop a novel image processing method for processing UAV images in nearly real-time. In this study, a UAV imaging system was used to capture RGB image frames of cotton seedlings to evaluate stand count and canopy size. Images were pre-processed to correct distortions, calculate ground sample distance and geo-reference cotton rows in the images. A pre-trained deep learning model, resnet 18, was used to estimate stand count and canopy size of cotton seedlings in each image frame. Results showed that the developed method could estimate stand count accurately with R2 = 0.95 in the test dataset. Similar results were achieved for canopy size with an estimation accuracy of R2 = 0.93 in the test dataset. The processing time for each image frame of 20 M pixels with each crop row geo-referenced was 2.22 s (including 1.80 s for pre-processing), which was more efficient than traditional mosaic-based image processing methods. An open-source automated image-processing framework was developed for cotton emergence evaluation and is available to the community for efficient data processing and analytics.</description><identifier>ISSN: 0168-1699</identifier><identifier>EISSN: 1872-7107</identifier><identifier>DOI: 10.1016/j.compag.2020.105711</identifier><language>eng</language><publisher>Amsterdam: Elsevier B.V</publisher><subject>Agronomy ; automation ; Canopies ; canopy ; Cotton ; data collection ; Data processing ; Datasets ; Decision making ; Deep learning ; Emergence evaluation ; georeferencing ; Gossypium ; image analysis ; Image processing ; information processing ; processing time ; Real-time processing ; Row geo-reference ; seedlings ; Stand count ; Unmanned aerial vehicles</subject><ispartof>Computers and electronics in agriculture, 2020-10, Vol.177, p.105711, Article 105711</ispartof><rights>2020 Elsevier B.V.</rights><rights>Copyright Elsevier BV Oct 2020</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c413t-d08e6a2a6c78ccde074bc6fb444b967f21159f5b00dc499410cda8127fd4221d3</citedby><cites>FETCH-LOGICAL-c413t-d08e6a2a6c78ccde074bc6fb444b967f21159f5b00dc499410cda8127fd4221d3</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://www.sciencedirect.com/science/article/pii/S0168169920314216$$EHTML$$P50$$Gelsevier$$H</linktohtml><link.rule.ids>314,776,780,3537,27901,27902,65306</link.rule.ids></links><search><creatorcontrib>Feng, Aijing</creatorcontrib><creatorcontrib>Zhou, Jianfeng</creatorcontrib><creatorcontrib>Vories, Earl</creatorcontrib><creatorcontrib>Sudduth, Kenneth A.</creatorcontrib><title>Evaluation of cotton emergence using UAV-based imagery and deep learning</title><title>Computers and electronics in agriculture</title><description>•Developed near real-time data processing framework for single UAV frames.•Developed a deep learning architecture for effective image data processing.•Evaluated stand count and seedling area autonomously.•Developed an open-source data processing pipeline available to the community. Crop emergence is an important agronomic factor for making field management decisions, such as replanting, that are time-sensitive and need to be made at very early stages. Crop emergence, evaluated using plant population, stand count and uniformity, is conventionally quantified manually, not accurate, and labor and time intensive. Unmanned aerial vehicle (UAV)-based imaging systems are able to scout crop fields rapidly. However, data processing can be too slow to make timely decision making. The goal of this study was to develop a novel image processing method for processing UAV images in nearly real-time. In this study, a UAV imaging system was used to capture RGB image frames of cotton seedlings to evaluate stand count and canopy size. Images were pre-processed to correct distortions, calculate ground sample distance and geo-reference cotton rows in the images. A pre-trained deep learning model, resnet 18, was used to estimate stand count and canopy size of cotton seedlings in each image frame. Results showed that the developed method could estimate stand count accurately with R2 = 0.95 in the test dataset. Similar results were achieved for canopy size with an estimation accuracy of R2 = 0.93 in the test dataset. The processing time for each image frame of 20 M pixels with each crop row geo-referenced was 2.22 s (including 1.80 s for pre-processing), which was more efficient than traditional mosaic-based image processing methods. An open-source automated image-processing framework was developed for cotton emergence evaluation and is available to the community for efficient data processing and analytics.</description><subject>Agronomy</subject><subject>automation</subject><subject>Canopies</subject><subject>canopy</subject><subject>Cotton</subject><subject>data collection</subject><subject>Data processing</subject><subject>Datasets</subject><subject>Decision making</subject><subject>Deep learning</subject><subject>Emergence evaluation</subject><subject>georeferencing</subject><subject>Gossypium</subject><subject>image analysis</subject><subject>Image processing</subject><subject>information processing</subject><subject>processing time</subject><subject>Real-time processing</subject><subject>Row geo-reference</subject><subject>seedlings</subject><subject>Stand count</subject><subject>Unmanned aerial vehicles</subject><issn>0168-1699</issn><issn>1872-7107</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2020</creationdate><recordtype>article</recordtype><recordid>eNp9kE1LwzAYx4MoOKffwEPBi5fOJEub5iKMoU4YeHFeQ5o8LSltM5N2sG9vSj158JQXfs_L_4fQPcErgkn-1Ky0646qXlFMp6-ME3KBFqTgNOUE80u0iFiRklyIa3QTQoPjWxR8gXYvJ9WOarCuT1yVaDcM8QYd-Bp6DckYbF8nh81XWqoAJrGdqsGfE9WbxAAckxaU7yNzi64q1Qa4-z2X6PD68rndpfuPt_ftZp9qRtZDanABuaIq17zQ2gDmrNR5VTLGSpHzihKSiSorMTaaCcEI1kYVhPLKMEqJWS_R49z36N33CGGQnQ0a2lb14MYgqSiyjK9zwSP68Adt3Oj7uJ2kjMVpGed5pNhMae9C8FDJo48p_VkSLCe9spGzXjnplbPeWPY8l0EMe7LgZdB2UmasBz1I4-z_DX4AosuD3g</recordid><startdate>202010</startdate><enddate>202010</enddate><creator>Feng, Aijing</creator><creator>Zhou, Jianfeng</creator><creator>Vories, Earl</creator><creator>Sudduth, Kenneth A.</creator><general>Elsevier B.V</general><general>Elsevier BV</general><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7SP</scope><scope>8FD</scope><scope>FR3</scope><scope>JQ2</scope><scope>KR7</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>7S9</scope><scope>L.6</scope></search><sort><creationdate>202010</creationdate><title>Evaluation of cotton emergence using UAV-based imagery and deep learning</title><author>Feng, Aijing ; Zhou, Jianfeng ; Vories, Earl ; Sudduth, Kenneth A.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c413t-d08e6a2a6c78ccde074bc6fb444b967f21159f5b00dc499410cda8127fd4221d3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2020</creationdate><topic>Agronomy</topic><topic>automation</topic><topic>Canopies</topic><topic>canopy</topic><topic>Cotton</topic><topic>data collection</topic><topic>Data processing</topic><topic>Datasets</topic><topic>Decision making</topic><topic>Deep learning</topic><topic>Emergence evaluation</topic><topic>georeferencing</topic><topic>Gossypium</topic><topic>image analysis</topic><topic>Image processing</topic><topic>information processing</topic><topic>processing time</topic><topic>Real-time processing</topic><topic>Row geo-reference</topic><topic>seedlings</topic><topic>Stand count</topic><topic>Unmanned aerial vehicles</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Feng, Aijing</creatorcontrib><creatorcontrib>Zhou, Jianfeng</creatorcontrib><creatorcontrib>Vories, Earl</creatorcontrib><creatorcontrib>Sudduth, Kenneth A.</creatorcontrib><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics &amp; Communications Abstracts</collection><collection>Technology Research Database</collection><collection>Engineering Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Civil Engineering Abstracts</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>AGRICOLA</collection><collection>AGRICOLA - Academic</collection><jtitle>Computers and electronics in agriculture</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Feng, Aijing</au><au>Zhou, Jianfeng</au><au>Vories, Earl</au><au>Sudduth, Kenneth A.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Evaluation of cotton emergence using UAV-based imagery and deep learning</atitle><jtitle>Computers and electronics in agriculture</jtitle><date>2020-10</date><risdate>2020</risdate><volume>177</volume><spage>105711</spage><pages>105711-</pages><artnum>105711</artnum><issn>0168-1699</issn><eissn>1872-7107</eissn><abstract>•Developed near real-time data processing framework for single UAV frames.•Developed a deep learning architecture for effective image data processing.•Evaluated stand count and seedling area autonomously.•Developed an open-source data processing pipeline available to the community. Crop emergence is an important agronomic factor for making field management decisions, such as replanting, that are time-sensitive and need to be made at very early stages. Crop emergence, evaluated using plant population, stand count and uniformity, is conventionally quantified manually, not accurate, and labor and time intensive. Unmanned aerial vehicle (UAV)-based imaging systems are able to scout crop fields rapidly. However, data processing can be too slow to make timely decision making. The goal of this study was to develop a novel image processing method for processing UAV images in nearly real-time. In this study, a UAV imaging system was used to capture RGB image frames of cotton seedlings to evaluate stand count and canopy size. Images were pre-processed to correct distortions, calculate ground sample distance and geo-reference cotton rows in the images. A pre-trained deep learning model, resnet 18, was used to estimate stand count and canopy size of cotton seedlings in each image frame. Results showed that the developed method could estimate stand count accurately with R2 = 0.95 in the test dataset. Similar results were achieved for canopy size with an estimation accuracy of R2 = 0.93 in the test dataset. The processing time for each image frame of 20 M pixels with each crop row geo-referenced was 2.22 s (including 1.80 s for pre-processing), which was more efficient than traditional mosaic-based image processing methods. An open-source automated image-processing framework was developed for cotton emergence evaluation and is available to the community for efficient data processing and analytics.</abstract><cop>Amsterdam</cop><pub>Elsevier B.V</pub><doi>10.1016/j.compag.2020.105711</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 0168-1699
ispartof Computers and electronics in agriculture, 2020-10, Vol.177, p.105711, Article 105711
issn 0168-1699
1872-7107
language eng
recordid cdi_proquest_miscellaneous_2985573697
source Elsevier ScienceDirect Journals
subjects Agronomy
automation
Canopies
canopy
Cotton
data collection
Data processing
Datasets
Decision making
Deep learning
Emergence evaluation
georeferencing
Gossypium
image analysis
Image processing
information processing
processing time
Real-time processing
Row geo-reference
seedlings
Stand count
Unmanned aerial vehicles
title Evaluation of cotton emergence using UAV-based imagery and deep learning
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-04T04%3A53%3A34IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Evaluation%20of%20cotton%20emergence%20using%20UAV-based%20imagery%20and%20deep%20learning&rft.jtitle=Computers%20and%20electronics%20in%20agriculture&rft.au=Feng,%20Aijing&rft.date=2020-10&rft.volume=177&rft.spage=105711&rft.pages=105711-&rft.artnum=105711&rft.issn=0168-1699&rft.eissn=1872-7107&rft_id=info:doi/10.1016/j.compag.2020.105711&rft_dat=%3Cproquest_cross%3E2449675776%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2449675776&rft_id=info:pmid/&rft_els_id=S0168169920314216&rfr_iscdi=true