High-Resolution Vehicle Trajectory Extraction and Denoising From Aerial Videos

In recent years, unmanned aerial vehicle (UAV) has become an increasingly popular tool for traffic monitoring and data collection on highways due to its advantage of low cost, high resolution, good flexibility, and wide spatial coverage. Extracting high-resolution vehicle trajectory data from aerial...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on intelligent transportation systems 2021-05, Vol.22 (5), p.3190-3202
Hauptverfasser: Chen, Xinqiang, Li, Zhibin, Yang, Yongsheng, Qi, Lei, Ke, Ruimin
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 3202
container_issue 5
container_start_page 3190
container_title IEEE transactions on intelligent transportation systems
container_volume 22
creator Chen, Xinqiang
Li, Zhibin
Yang, Yongsheng
Qi, Lei
Ke, Ruimin
description In recent years, unmanned aerial vehicle (UAV) has become an increasingly popular tool for traffic monitoring and data collection on highways due to its advantage of low cost, high resolution, good flexibility, and wide spatial coverage. Extracting high-resolution vehicle trajectory data from aerial videos taken by a UAV flying over target highway segment becomes a critical research task for traffic flow modeling and analysis. This study aims at proposing a novel methodological framework for automatic and accurate vehicle trajectory extraction from aerial videos. The method starts by developing an ensemble detector to detect vehicles in the target region. Then, the kernelized correlation filter is applied to track vehicles fast and accurately. After that, a mapping algorithm is proposed to transform vehicle positions from the Cartesian coordinates in image to the Frenet coordinates to extract raw vehicle trajectories along the roadway curves. The data denoising is then performed using a wavelet transform to eliminate the biased vehicle trajectory positions. Our method is tested on two aerial videos taken on different urban expressway segments in both peak and non-peak hours on weekdays. The extracted vehicle trajectories are compared with manual calibrated data to testify the framework performance. The experimental results show that the proposed method successfully extracts vehicle trajectories with a high accuracy: the measurement error of Mean Squared Deviation is 2.301 m, the Root-mean-square deviation is 0.175 m, and the Pearson correlation coefficient is 0.999. The video and trajectory data in this study are publicly accessible for serving as benchmark at https://seutraffic.com .
doi_str_mv 10.1109/TITS.2020.3003782
format Article
fullrecord <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_proquest_journals_2519967414</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>9133275</ieee_id><sourcerecordid>2519967414</sourcerecordid><originalsourceid>FETCH-LOGICAL-c293t-d737a2c29b7b196572eefcb69cf097d884ca727ad5e9803c68ab3c647d8e66293</originalsourceid><addsrcrecordid>eNo9UF1LwzAUDaLgnP4A8aXgc2c-mqZ5HHNzg6Ggda8hTW-3jK2ZSQfu35s68eXewz0fFw5C9wSPCMHyqVyUHyOKKR4xjJko6AUaEM6LFGOSX_aYZqnEHF-jmxC28ZpxQgbodW7Xm_QdgtsdO-vaZAUba3aQlF5vwXTOn5Lpd-e1-WV1WyfP0DobbLtOZt7tkzF4q3fJytbgwi26avQuwN3fHqLP2bSczNPl28tiMl6mhkrWpbVgQtOIK1ERmXNBARpT5dI0WIq6KDKjBRW65iALzExe6CrOLFKQ5zFiiB7PuQfvvo4QOrV1R9_Gl4pyImUuMpJFFTmrjHcheGjUwdu99idFsOprU31tqq9N_dUWPQ9njwWAf70kjFHB2Q8wXGjB</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2519967414</pqid></control><display><type>article</type><title>High-Resolution Vehicle Trajectory Extraction and Denoising From Aerial Videos</title><source>IEEE Electronic Library (IEL)</source><creator>Chen, Xinqiang ; Li, Zhibin ; Yang, Yongsheng ; Qi, Lei ; Ke, Ruimin</creator><creatorcontrib>Chen, Xinqiang ; Li, Zhibin ; Yang, Yongsheng ; Qi, Lei ; Ke, Ruimin</creatorcontrib><description>In recent years, unmanned aerial vehicle (UAV) has become an increasingly popular tool for traffic monitoring and data collection on highways due to its advantage of low cost, high resolution, good flexibility, and wide spatial coverage. Extracting high-resolution vehicle trajectory data from aerial videos taken by a UAV flying over target highway segment becomes a critical research task for traffic flow modeling and analysis. This study aims at proposing a novel methodological framework for automatic and accurate vehicle trajectory extraction from aerial videos. The method starts by developing an ensemble detector to detect vehicles in the target region. Then, the kernelized correlation filter is applied to track vehicles fast and accurately. After that, a mapping algorithm is proposed to transform vehicle positions from the Cartesian coordinates in image to the Frenet coordinates to extract raw vehicle trajectories along the roadway curves. The data denoising is then performed using a wavelet transform to eliminate the biased vehicle trajectory positions. Our method is tested on two aerial videos taken on different urban expressway segments in both peak and non-peak hours on weekdays. The extracted vehicle trajectories are compared with manual calibrated data to testify the framework performance. The experimental results show that the proposed method successfully extracts vehicle trajectories with a high accuracy: the measurement error of Mean Squared Deviation is 2.301 m, the Root-mean-square deviation is 0.175 m, and the Pearson correlation coefficient is 0.999. The video and trajectory data in this study are publicly accessible for serving as benchmark at https://seutraffic.com .</description><identifier>ISSN: 1524-9050</identifier><identifier>EISSN: 1558-0016</identifier><identifier>DOI: 10.1109/TITS.2020.3003782</identifier><identifier>CODEN: ITISFG</identifier><language>eng</language><publisher>New York: IEEE</publisher><subject>Algorithms ; Cameras ; Cartesian coordinates ; Correlation coefficients ; Data collection ; data quality control ; Detectors ; Deviation ; Error analysis ; High resolution ; Image edge detection ; Noise reduction ; Roads ; Segments ; Target detection ; Traffic flow ; Traffic models ; Trajectories ; Trajectory ; unmanned aerial vehicle ; Unmanned aerial vehicles ; Vehicle detection ; vehicle tracking ; Vehicle trajectory ; Vehicles ; Video ; Videos ; Wavelet transforms</subject><ispartof>IEEE transactions on intelligent transportation systems, 2021-05, Vol.22 (5), p.3190-3202</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2021</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c293t-d737a2c29b7b196572eefcb69cf097d884ca727ad5e9803c68ab3c647d8e66293</citedby><cites>FETCH-LOGICAL-c293t-d737a2c29b7b196572eefcb69cf097d884ca727ad5e9803c68ab3c647d8e66293</cites><orcidid>0000-0001-7192-6853 ; 0000-0001-9139-6765 ; 0000-0001-8959-5108 ; 0000-0001-7091-0702</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/9133275$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,780,784,796,27924,27925,54758</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/9133275$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Chen, Xinqiang</creatorcontrib><creatorcontrib>Li, Zhibin</creatorcontrib><creatorcontrib>Yang, Yongsheng</creatorcontrib><creatorcontrib>Qi, Lei</creatorcontrib><creatorcontrib>Ke, Ruimin</creatorcontrib><title>High-Resolution Vehicle Trajectory Extraction and Denoising From Aerial Videos</title><title>IEEE transactions on intelligent transportation systems</title><addtitle>TITS</addtitle><description>In recent years, unmanned aerial vehicle (UAV) has become an increasingly popular tool for traffic monitoring and data collection on highways due to its advantage of low cost, high resolution, good flexibility, and wide spatial coverage. Extracting high-resolution vehicle trajectory data from aerial videos taken by a UAV flying over target highway segment becomes a critical research task for traffic flow modeling and analysis. This study aims at proposing a novel methodological framework for automatic and accurate vehicle trajectory extraction from aerial videos. The method starts by developing an ensemble detector to detect vehicles in the target region. Then, the kernelized correlation filter is applied to track vehicles fast and accurately. After that, a mapping algorithm is proposed to transform vehicle positions from the Cartesian coordinates in image to the Frenet coordinates to extract raw vehicle trajectories along the roadway curves. The data denoising is then performed using a wavelet transform to eliminate the biased vehicle trajectory positions. Our method is tested on two aerial videos taken on different urban expressway segments in both peak and non-peak hours on weekdays. The extracted vehicle trajectories are compared with manual calibrated data to testify the framework performance. The experimental results show that the proposed method successfully extracts vehicle trajectories with a high accuracy: the measurement error of Mean Squared Deviation is 2.301 m, the Root-mean-square deviation is 0.175 m, and the Pearson correlation coefficient is 0.999. The video and trajectory data in this study are publicly accessible for serving as benchmark at https://seutraffic.com .</description><subject>Algorithms</subject><subject>Cameras</subject><subject>Cartesian coordinates</subject><subject>Correlation coefficients</subject><subject>Data collection</subject><subject>data quality control</subject><subject>Detectors</subject><subject>Deviation</subject><subject>Error analysis</subject><subject>High resolution</subject><subject>Image edge detection</subject><subject>Noise reduction</subject><subject>Roads</subject><subject>Segments</subject><subject>Target detection</subject><subject>Traffic flow</subject><subject>Traffic models</subject><subject>Trajectories</subject><subject>Trajectory</subject><subject>unmanned aerial vehicle</subject><subject>Unmanned aerial vehicles</subject><subject>Vehicle detection</subject><subject>vehicle tracking</subject><subject>Vehicle trajectory</subject><subject>Vehicles</subject><subject>Video</subject><subject>Videos</subject><subject>Wavelet transforms</subject><issn>1524-9050</issn><issn>1558-0016</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2021</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNo9UF1LwzAUDaLgnP4A8aXgc2c-mqZ5HHNzg6Ggda8hTW-3jK2ZSQfu35s68eXewz0fFw5C9wSPCMHyqVyUHyOKKR4xjJko6AUaEM6LFGOSX_aYZqnEHF-jmxC28ZpxQgbodW7Xm_QdgtsdO-vaZAUba3aQlF5vwXTOn5Lpd-e1-WV1WyfP0DobbLtOZt7tkzF4q3fJytbgwi26avQuwN3fHqLP2bSczNPl28tiMl6mhkrWpbVgQtOIK1ERmXNBARpT5dI0WIq6KDKjBRW65iALzExe6CrOLFKQ5zFiiB7PuQfvvo4QOrV1R9_Gl4pyImUuMpJFFTmrjHcheGjUwdu99idFsOprU31tqq9N_dUWPQ9njwWAf70kjFHB2Q8wXGjB</recordid><startdate>20210501</startdate><enddate>20210501</enddate><creator>Chen, Xinqiang</creator><creator>Li, Zhibin</creator><creator>Yang, Yongsheng</creator><creator>Qi, Lei</creator><creator>Ke, Ruimin</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7SP</scope><scope>8FD</scope><scope>FR3</scope><scope>JQ2</scope><scope>KR7</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><orcidid>https://orcid.org/0000-0001-7192-6853</orcidid><orcidid>https://orcid.org/0000-0001-9139-6765</orcidid><orcidid>https://orcid.org/0000-0001-8959-5108</orcidid><orcidid>https://orcid.org/0000-0001-7091-0702</orcidid></search><sort><creationdate>20210501</creationdate><title>High-Resolution Vehicle Trajectory Extraction and Denoising From Aerial Videos</title><author>Chen, Xinqiang ; Li, Zhibin ; Yang, Yongsheng ; Qi, Lei ; Ke, Ruimin</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c293t-d737a2c29b7b196572eefcb69cf097d884ca727ad5e9803c68ab3c647d8e66293</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2021</creationdate><topic>Algorithms</topic><topic>Cameras</topic><topic>Cartesian coordinates</topic><topic>Correlation coefficients</topic><topic>Data collection</topic><topic>data quality control</topic><topic>Detectors</topic><topic>Deviation</topic><topic>Error analysis</topic><topic>High resolution</topic><topic>Image edge detection</topic><topic>Noise reduction</topic><topic>Roads</topic><topic>Segments</topic><topic>Target detection</topic><topic>Traffic flow</topic><topic>Traffic models</topic><topic>Trajectories</topic><topic>Trajectory</topic><topic>unmanned aerial vehicle</topic><topic>Unmanned aerial vehicles</topic><topic>Vehicle detection</topic><topic>vehicle tracking</topic><topic>Vehicle trajectory</topic><topic>Vehicles</topic><topic>Video</topic><topic>Videos</topic><topic>Wavelet transforms</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Chen, Xinqiang</creatorcontrib><creatorcontrib>Li, Zhibin</creatorcontrib><creatorcontrib>Yang, Yongsheng</creatorcontrib><creatorcontrib>Qi, Lei</creatorcontrib><creatorcontrib>Ke, Ruimin</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics &amp; Communications Abstracts</collection><collection>Technology Research Database</collection><collection>Engineering Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Civil Engineering Abstracts</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>IEEE transactions on intelligent transportation systems</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Chen, Xinqiang</au><au>Li, Zhibin</au><au>Yang, Yongsheng</au><au>Qi, Lei</au><au>Ke, Ruimin</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>High-Resolution Vehicle Trajectory Extraction and Denoising From Aerial Videos</atitle><jtitle>IEEE transactions on intelligent transportation systems</jtitle><stitle>TITS</stitle><date>2021-05-01</date><risdate>2021</risdate><volume>22</volume><issue>5</issue><spage>3190</spage><epage>3202</epage><pages>3190-3202</pages><issn>1524-9050</issn><eissn>1558-0016</eissn><coden>ITISFG</coden><abstract>In recent years, unmanned aerial vehicle (UAV) has become an increasingly popular tool for traffic monitoring and data collection on highways due to its advantage of low cost, high resolution, good flexibility, and wide spatial coverage. Extracting high-resolution vehicle trajectory data from aerial videos taken by a UAV flying over target highway segment becomes a critical research task for traffic flow modeling and analysis. This study aims at proposing a novel methodological framework for automatic and accurate vehicle trajectory extraction from aerial videos. The method starts by developing an ensemble detector to detect vehicles in the target region. Then, the kernelized correlation filter is applied to track vehicles fast and accurately. After that, a mapping algorithm is proposed to transform vehicle positions from the Cartesian coordinates in image to the Frenet coordinates to extract raw vehicle trajectories along the roadway curves. The data denoising is then performed using a wavelet transform to eliminate the biased vehicle trajectory positions. Our method is tested on two aerial videos taken on different urban expressway segments in both peak and non-peak hours on weekdays. The extracted vehicle trajectories are compared with manual calibrated data to testify the framework performance. The experimental results show that the proposed method successfully extracts vehicle trajectories with a high accuracy: the measurement error of Mean Squared Deviation is 2.301 m, the Root-mean-square deviation is 0.175 m, and the Pearson correlation coefficient is 0.999. The video and trajectory data in this study are publicly accessible for serving as benchmark at https://seutraffic.com .</abstract><cop>New York</cop><pub>IEEE</pub><doi>10.1109/TITS.2020.3003782</doi><tpages>13</tpages><orcidid>https://orcid.org/0000-0001-7192-6853</orcidid><orcidid>https://orcid.org/0000-0001-9139-6765</orcidid><orcidid>https://orcid.org/0000-0001-8959-5108</orcidid><orcidid>https://orcid.org/0000-0001-7091-0702</orcidid></addata></record>
fulltext fulltext_linktorsrc
identifier ISSN: 1524-9050
ispartof IEEE transactions on intelligent transportation systems, 2021-05, Vol.22 (5), p.3190-3202
issn 1524-9050
1558-0016
language eng
recordid cdi_proquest_journals_2519967414
source IEEE Electronic Library (IEL)
subjects Algorithms
Cameras
Cartesian coordinates
Correlation coefficients
Data collection
data quality control
Detectors
Deviation
Error analysis
High resolution
Image edge detection
Noise reduction
Roads
Segments
Target detection
Traffic flow
Traffic models
Trajectories
Trajectory
unmanned aerial vehicle
Unmanned aerial vehicles
Vehicle detection
vehicle tracking
Vehicle trajectory
Vehicles
Video
Videos
Wavelet transforms
title High-Resolution Vehicle Trajectory Extraction and Denoising From Aerial Videos
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-21T09%3A25%3A26IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=High-Resolution%20Vehicle%20Trajectory%20Extraction%20and%20Denoising%20From%20Aerial%20Videos&rft.jtitle=IEEE%20transactions%20on%20intelligent%20transportation%20systems&rft.au=Chen,%20Xinqiang&rft.date=2021-05-01&rft.volume=22&rft.issue=5&rft.spage=3190&rft.epage=3202&rft.pages=3190-3202&rft.issn=1524-9050&rft.eissn=1558-0016&rft.coden=ITISFG&rft_id=info:doi/10.1109/TITS.2020.3003782&rft_dat=%3Cproquest_RIE%3E2519967414%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2519967414&rft_id=info:pmid/&rft_ieee_id=9133275&rfr_iscdi=true