Using UAV LiDAR Intensity Frequency and Hyperspectral Features to Improve the Accuracy of Urban Tree Species Classification

The accurate classification of tree species in urban forests is crucial for effective management of urban forest resources and ecological environment evaluation. To achieve this goal, unmanned aerial vehicle (UAV) hyperspectral systems and LiDAR systems are useful technologies for monitoring urban f...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE journal of selected topics in applied earth observations and remote sensing 2024-01, Vol.17, p.1-25
Hauptverfasser: Gong, Yulin, Zhu, Di'en, Li, Xuejian, Lv, Lujin, Zhang, Bo, Xuan, Jie, Du, Huaqiang
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 25
container_issue
container_start_page 1
container_title IEEE journal of selected topics in applied earth observations and remote sensing
container_volume 17
creator Gong, Yulin
Zhu, Di'en
Li, Xuejian
Lv, Lujin
Zhang, Bo
Xuan, Jie
Du, Huaqiang
description The accurate classification of tree species in urban forests is crucial for effective management of urban forest resources and ecological environment evaluation. To achieve this goal, unmanned aerial vehicle (UAV) hyperspectral systems and LiDAR systems are useful technologies for monitoring urban forest resources. Accurately classifying tree species in urban forests remains a major challenge due to the limitations of existing methods. While hyperspectral imaging is capable of capturing detailed spectral information, it struggles with the issue of 'same species different spectrum'. On the other hand, the intensity frequency curve also has the problem of 'unsimilar intensity frequency curves for the same species' and 'similar intensity frequency curves for different species'. Therefore, the aim of this study is to overcome these challenges by a new method. The method combines UAV LiDAR intensity frequency features (IF) and hyperspectral features (HF) to accurately classify tree species, abbreviated as HICM. The method uses the complementarity of the two techniques to effectively solve the "same species different spectra" and "same species different frequencies" problems in hyperspectral analysis and intensity frequency analysis, respectively, while ensuring data quality and processing efficiency, significantly improving the accuracy of urban forest tree species classification. Firstly, high-density LiDAR data (230 points/m²) and hyperspectral data are obtained. Then, individual tree crowns are segmented using the deep learning Mask R-CNN algorithm, and IF and HF features are extracted. Finally, a random forest (RF) model is used to classify the 16 main tree species in the study area. The results of the study demonstrate that HICM can accurately classify 16 common urban tree species with an overall accuracy (OA) of 92.0% and kappa of 91.2%. Compared with using only IF or HF for classification, HICM improves OA by 16.9% and 12%, and kappa by 21.6% and 10.1%, respectively. This shows that HF and IF have complementarity, and the combination of these two features effectively addresses the problems of "same species different frequency" and "same species different spectrum".
doi_str_mv 10.1109/JSTARS.2023.3324475
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_crossref_primary_10_1109_JSTARS_2023_3324475</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>10286301</ieee_id><doaj_id>oai_doaj_org_article_96eb77911582417a840ba3b41179b04b</doaj_id><sourcerecordid>2913512881</sourcerecordid><originalsourceid>FETCH-LOGICAL-c409t-55427493718855efd762c688ac17367315cd55ba1ab626cdfcce09caa68040f13</originalsourceid><addsrcrecordid>eNpNkU-L2zAQxU3ZQrNpP0F7EPTsrEZ_LOlo0qabJVDYJL0KWR5vFbJ2KikLoV--Tr2UngaG-b03M68oPgJdAFBz97Dd1Y_bBaOMLzhnQij5ppgxkFCC5PKmmIHhpgRBxbviNqUDpRVThs-K3_sU-ieyr3-QTfhSP5J1n7FPIV_IKuKvM_b-QlzfkvvLCWM6oc_RHckKXT5HTCQPZP18isMLkvwTSe39OboRGTqyj43ryS4iku3IhXF6eXQphS54l8PQvy_edu6Y8MNrnRf71dfd8r7cfP-2Xtab0gtqcimlYEoYrkBrKbFrVcV8pbXzoHilOEjfStk4cE3FKt923iM13rlKU0E74PNiPem2gzvYUwzPLl7s4IL92xjik3UxB39EaypslDIAUjMBymlBG8cbAaBMQ0Uzan2etMabx--kbA_DOfbj-pYZ4BKY1ldHPk35OKQUsfvnCtReE7NTYvaamH1NbKQ-TVRAxP8IpitOgf8BQ9CRmw</addsrcrecordid><sourcetype>Open Website</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2913512881</pqid></control><display><type>article</type><title>Using UAV LiDAR Intensity Frequency and Hyperspectral Features to Improve the Accuracy of Urban Tree Species Classification</title><source>DOAJ Directory of Open Access Journals</source><source>EZB-FREE-00999 freely available EZB journals</source><creator>Gong, Yulin ; Zhu, Di'en ; Li, Xuejian ; Lv, Lujin ; Zhang, Bo ; Xuan, Jie ; Du, Huaqiang</creator><creatorcontrib>Gong, Yulin ; Zhu, Di'en ; Li, Xuejian ; Lv, Lujin ; Zhang, Bo ; Xuan, Jie ; Du, Huaqiang</creatorcontrib><description>The accurate classification of tree species in urban forests is crucial for effective management of urban forest resources and ecological environment evaluation. To achieve this goal, unmanned aerial vehicle (UAV) hyperspectral systems and LiDAR systems are useful technologies for monitoring urban forest resources. Accurately classifying tree species in urban forests remains a major challenge due to the limitations of existing methods. While hyperspectral imaging is capable of capturing detailed spectral information, it struggles with the issue of 'same species different spectrum'. On the other hand, the intensity frequency curve also has the problem of 'unsimilar intensity frequency curves for the same species' and 'similar intensity frequency curves for different species'. Therefore, the aim of this study is to overcome these challenges by a new method. The method combines UAV LiDAR intensity frequency features (IF) and hyperspectral features (HF) to accurately classify tree species, abbreviated as HICM. The method uses the complementarity of the two techniques to effectively solve the "same species different spectra" and "same species different frequencies" problems in hyperspectral analysis and intensity frequency analysis, respectively, while ensuring data quality and processing efficiency, significantly improving the accuracy of urban forest tree species classification. Firstly, high-density LiDAR data (230 points/m²) and hyperspectral data are obtained. Then, individual tree crowns are segmented using the deep learning Mask R-CNN algorithm, and IF and HF features are extracted. Finally, a random forest (RF) model is used to classify the 16 main tree species in the study area. The results of the study demonstrate that HICM can accurately classify 16 common urban tree species with an overall accuracy (OA) of 92.0% and kappa of 91.2%. Compared with using only IF or HF for classification, HICM improves OA by 16.9% and 12%, and kappa by 21.6% and 10.1%, respectively. This shows that HF and IF have complementarity, and the combination of these two features effectively addresses the problems of "same species different frequency" and "same species different spectrum".</description><identifier>ISSN: 1939-1404</identifier><identifier>EISSN: 2151-1535</identifier><identifier>DOI: 10.1109/JSTARS.2023.3324475</identifier><identifier>CODEN: IJSTHZ</identifier><language>eng</language><publisher>Piscataway: IEEE</publisher><subject>Accuracy ; Autonomous aerial vehicles ; Complementarity ; Feature extraction ; Forestry ; Hyperspectral ; Hyperspectral imaging ; Laser radar ; LiDAR ; light detection and ranging (LiDAR) ; Mask R-CNN ; mask R-convolutional neural networks (CNN) ; Plant species ; Random forests ; Reflectance ; Reflectance curves ; Species ; Species classification ; Tree Species Classification ; Urban forests ; Vegetation</subject><ispartof>IEEE journal of selected topics in applied earth observations and remote sensing, 2024-01, Vol.17, p.1-25</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2024</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c409t-55427493718855efd762c688ac17367315cd55ba1ab626cdfcce09caa68040f13</citedby><cites>FETCH-LOGICAL-c409t-55427493718855efd762c688ac17367315cd55ba1ab626cdfcce09caa68040f13</cites><orcidid>0000-0002-6765-2279 ; 0000-0002-2593-768X</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,780,784,864,2100,27922,27923</link.rule.ids></links><search><creatorcontrib>Gong, Yulin</creatorcontrib><creatorcontrib>Zhu, Di'en</creatorcontrib><creatorcontrib>Li, Xuejian</creatorcontrib><creatorcontrib>Lv, Lujin</creatorcontrib><creatorcontrib>Zhang, Bo</creatorcontrib><creatorcontrib>Xuan, Jie</creatorcontrib><creatorcontrib>Du, Huaqiang</creatorcontrib><title>Using UAV LiDAR Intensity Frequency and Hyperspectral Features to Improve the Accuracy of Urban Tree Species Classification</title><title>IEEE journal of selected topics in applied earth observations and remote sensing</title><addtitle>JSTARS</addtitle><description>The accurate classification of tree species in urban forests is crucial for effective management of urban forest resources and ecological environment evaluation. To achieve this goal, unmanned aerial vehicle (UAV) hyperspectral systems and LiDAR systems are useful technologies for monitoring urban forest resources. Accurately classifying tree species in urban forests remains a major challenge due to the limitations of existing methods. While hyperspectral imaging is capable of capturing detailed spectral information, it struggles with the issue of 'same species different spectrum'. On the other hand, the intensity frequency curve also has the problem of 'unsimilar intensity frequency curves for the same species' and 'similar intensity frequency curves for different species'. Therefore, the aim of this study is to overcome these challenges by a new method. The method combines UAV LiDAR intensity frequency features (IF) and hyperspectral features (HF) to accurately classify tree species, abbreviated as HICM. The method uses the complementarity of the two techniques to effectively solve the "same species different spectra" and "same species different frequencies" problems in hyperspectral analysis and intensity frequency analysis, respectively, while ensuring data quality and processing efficiency, significantly improving the accuracy of urban forest tree species classification. Firstly, high-density LiDAR data (230 points/m²) and hyperspectral data are obtained. Then, individual tree crowns are segmented using the deep learning Mask R-CNN algorithm, and IF and HF features are extracted. Finally, a random forest (RF) model is used to classify the 16 main tree species in the study area. The results of the study demonstrate that HICM can accurately classify 16 common urban tree species with an overall accuracy (OA) of 92.0% and kappa of 91.2%. Compared with using only IF or HF for classification, HICM improves OA by 16.9% and 12%, and kappa by 21.6% and 10.1%, respectively. This shows that HF and IF have complementarity, and the combination of these two features effectively addresses the problems of "same species different frequency" and "same species different spectrum".</description><subject>Accuracy</subject><subject>Autonomous aerial vehicles</subject><subject>Complementarity</subject><subject>Feature extraction</subject><subject>Forestry</subject><subject>Hyperspectral</subject><subject>Hyperspectral imaging</subject><subject>Laser radar</subject><subject>LiDAR</subject><subject>light detection and ranging (LiDAR)</subject><subject>Mask R-CNN</subject><subject>mask R-convolutional neural networks (CNN)</subject><subject>Plant species</subject><subject>Random forests</subject><subject>Reflectance</subject><subject>Reflectance curves</subject><subject>Species</subject><subject>Species classification</subject><subject>Tree Species Classification</subject><subject>Urban forests</subject><subject>Vegetation</subject><issn>1939-1404</issn><issn>2151-1535</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><sourceid>ESBDL</sourceid><sourceid>RIE</sourceid><sourceid>DOA</sourceid><recordid>eNpNkU-L2zAQxU3ZQrNpP0F7EPTsrEZ_LOlo0qabJVDYJL0KWR5vFbJ2KikLoV--Tr2UngaG-b03M68oPgJdAFBz97Dd1Y_bBaOMLzhnQij5ppgxkFCC5PKmmIHhpgRBxbviNqUDpRVThs-K3_sU-ieyr3-QTfhSP5J1n7FPIV_IKuKvM_b-QlzfkvvLCWM6oc_RHckKXT5HTCQPZP18isMLkvwTSe39OboRGTqyj43ryS4iku3IhXF6eXQphS54l8PQvy_edu6Y8MNrnRf71dfd8r7cfP-2Xtab0gtqcimlYEoYrkBrKbFrVcV8pbXzoHilOEjfStk4cE3FKt923iM13rlKU0E74PNiPem2gzvYUwzPLl7s4IL92xjik3UxB39EaypslDIAUjMBymlBG8cbAaBMQ0Uzan2etMabx--kbA_DOfbj-pYZ4BKY1ldHPk35OKQUsfvnCtReE7NTYvaamH1NbKQ-TVRAxP8IpitOgf8BQ9CRmw</recordid><startdate>20240101</startdate><enddate>20240101</enddate><creator>Gong, Yulin</creator><creator>Zhu, Di'en</creator><creator>Li, Xuejian</creator><creator>Lv, Lujin</creator><creator>Zhang, Bo</creator><creator>Xuan, Jie</creator><creator>Du, Huaqiang</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>ESBDL</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7UA</scope><scope>8FD</scope><scope>C1K</scope><scope>F1W</scope><scope>FR3</scope><scope>H8D</scope><scope>H96</scope><scope>KR7</scope><scope>L.G</scope><scope>L7M</scope><scope>DOA</scope><orcidid>https://orcid.org/0000-0002-6765-2279</orcidid><orcidid>https://orcid.org/0000-0002-2593-768X</orcidid></search><sort><creationdate>20240101</creationdate><title>Using UAV LiDAR Intensity Frequency and Hyperspectral Features to Improve the Accuracy of Urban Tree Species Classification</title><author>Gong, Yulin ; Zhu, Di'en ; Li, Xuejian ; Lv, Lujin ; Zhang, Bo ; Xuan, Jie ; Du, Huaqiang</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c409t-55427493718855efd762c688ac17367315cd55ba1ab626cdfcce09caa68040f13</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Accuracy</topic><topic>Autonomous aerial vehicles</topic><topic>Complementarity</topic><topic>Feature extraction</topic><topic>Forestry</topic><topic>Hyperspectral</topic><topic>Hyperspectral imaging</topic><topic>Laser radar</topic><topic>LiDAR</topic><topic>light detection and ranging (LiDAR)</topic><topic>Mask R-CNN</topic><topic>mask R-convolutional neural networks (CNN)</topic><topic>Plant species</topic><topic>Random forests</topic><topic>Reflectance</topic><topic>Reflectance curves</topic><topic>Species</topic><topic>Species classification</topic><topic>Tree Species Classification</topic><topic>Urban forests</topic><topic>Vegetation</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Gong, Yulin</creatorcontrib><creatorcontrib>Zhu, Di'en</creatorcontrib><creatorcontrib>Li, Xuejian</creatorcontrib><creatorcontrib>Lv, Lujin</creatorcontrib><creatorcontrib>Zhang, Bo</creatorcontrib><creatorcontrib>Xuan, Jie</creatorcontrib><creatorcontrib>Du, Huaqiang</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE Open Access Journals</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Water Resources Abstracts</collection><collection>Technology Research Database</collection><collection>Environmental Sciences and Pollution Management</collection><collection>ASFA: Aquatic Sciences and Fisheries Abstracts</collection><collection>Engineering Research Database</collection><collection>Aerospace Database</collection><collection>Aquatic Science &amp; Fisheries Abstracts (ASFA) 2: Ocean Technology, Policy &amp; Non-Living Resources</collection><collection>Civil Engineering Abstracts</collection><collection>Aquatic Science &amp; Fisheries Abstracts (ASFA) Professional</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>DOAJ Directory of Open Access Journals</collection><jtitle>IEEE journal of selected topics in applied earth observations and remote sensing</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Gong, Yulin</au><au>Zhu, Di'en</au><au>Li, Xuejian</au><au>Lv, Lujin</au><au>Zhang, Bo</au><au>Xuan, Jie</au><au>Du, Huaqiang</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Using UAV LiDAR Intensity Frequency and Hyperspectral Features to Improve the Accuracy of Urban Tree Species Classification</atitle><jtitle>IEEE journal of selected topics in applied earth observations and remote sensing</jtitle><stitle>JSTARS</stitle><date>2024-01-01</date><risdate>2024</risdate><volume>17</volume><spage>1</spage><epage>25</epage><pages>1-25</pages><issn>1939-1404</issn><eissn>2151-1535</eissn><coden>IJSTHZ</coden><abstract>The accurate classification of tree species in urban forests is crucial for effective management of urban forest resources and ecological environment evaluation. To achieve this goal, unmanned aerial vehicle (UAV) hyperspectral systems and LiDAR systems are useful technologies for monitoring urban forest resources. Accurately classifying tree species in urban forests remains a major challenge due to the limitations of existing methods. While hyperspectral imaging is capable of capturing detailed spectral information, it struggles with the issue of 'same species different spectrum'. On the other hand, the intensity frequency curve also has the problem of 'unsimilar intensity frequency curves for the same species' and 'similar intensity frequency curves for different species'. Therefore, the aim of this study is to overcome these challenges by a new method. The method combines UAV LiDAR intensity frequency features (IF) and hyperspectral features (HF) to accurately classify tree species, abbreviated as HICM. The method uses the complementarity of the two techniques to effectively solve the "same species different spectra" and "same species different frequencies" problems in hyperspectral analysis and intensity frequency analysis, respectively, while ensuring data quality and processing efficiency, significantly improving the accuracy of urban forest tree species classification. Firstly, high-density LiDAR data (230 points/m²) and hyperspectral data are obtained. Then, individual tree crowns are segmented using the deep learning Mask R-CNN algorithm, and IF and HF features are extracted. Finally, a random forest (RF) model is used to classify the 16 main tree species in the study area. The results of the study demonstrate that HICM can accurately classify 16 common urban tree species with an overall accuracy (OA) of 92.0% and kappa of 91.2%. Compared with using only IF or HF for classification, HICM improves OA by 16.9% and 12%, and kappa by 21.6% and 10.1%, respectively. This shows that HF and IF have complementarity, and the combination of these two features effectively addresses the problems of "same species different frequency" and "same species different spectrum".</abstract><cop>Piscataway</cop><pub>IEEE</pub><doi>10.1109/JSTARS.2023.3324475</doi><tpages>25</tpages><orcidid>https://orcid.org/0000-0002-6765-2279</orcidid><orcidid>https://orcid.org/0000-0002-2593-768X</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 1939-1404
ispartof IEEE journal of selected topics in applied earth observations and remote sensing, 2024-01, Vol.17, p.1-25
issn 1939-1404
2151-1535
language eng
recordid cdi_crossref_primary_10_1109_JSTARS_2023_3324475
source DOAJ Directory of Open Access Journals; EZB-FREE-00999 freely available EZB journals
subjects Accuracy
Autonomous aerial vehicles
Complementarity
Feature extraction
Forestry
Hyperspectral
Hyperspectral imaging
Laser radar
LiDAR
light detection and ranging (LiDAR)
Mask R-CNN
mask R-convolutional neural networks (CNN)
Plant species
Random forests
Reflectance
Reflectance curves
Species
Species classification
Tree Species Classification
Urban forests
Vegetation
title Using UAV LiDAR Intensity Frequency and Hyperspectral Features to Improve the Accuracy of Urban Tree Species Classification
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-09T21%3A40%3A05IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Using%20UAV%20LiDAR%20Intensity%20Frequency%20and%20Hyperspectral%20Features%20to%20Improve%20the%20Accuracy%20of%20Urban%20Tree%20Species%20Classification&rft.jtitle=IEEE%20journal%20of%20selected%20topics%20in%20applied%20earth%20observations%20and%20remote%20sensing&rft.au=Gong,%20Yulin&rft.date=2024-01-01&rft.volume=17&rft.spage=1&rft.epage=25&rft.pages=1-25&rft.issn=1939-1404&rft.eissn=2151-1535&rft.coden=IJSTHZ&rft_id=info:doi/10.1109/JSTARS.2023.3324475&rft_dat=%3Cproquest_cross%3E2913512881%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2913512881&rft_id=info:pmid/&rft_ieee_id=10286301&rft_doaj_id=oai_doaj_org_article_96eb77911582417a840ba3b41179b04b&rfr_iscdi=true