Road Marking Damage Detection Based on Deep Learning for Infrastructure Evaluation in Emerging Autonomous Driving

The future of autonomous driving is slowly approaching, but there are still many steps to take before it can become a reality. It is crucial to pay attention to road infrastructure, because without it, intelligent vehicles will not be able to operate reliably, and it will never be possible to dispen...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on intelligent transportation systems 2022-11, Vol.23 (11), p.22378-22385
Hauptverfasser: Iparraguirre, Olatz, Iturbe-Olleta, Nagore, Brazalez, Alfonso, Borro, Diego
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 22385
container_issue 11
container_start_page 22378
container_title IEEE transactions on intelligent transportation systems
container_volume 23
creator Iparraguirre, Olatz
Iturbe-Olleta, Nagore
Brazalez, Alfonso
Borro, Diego
description The future of autonomous driving is slowly approaching, but there are still many steps to take before it can become a reality. It is crucial to pay attention to road infrastructure, because without it, intelligent vehicles will not be able to operate reliably, and it will never be possible to dispense of driver's control. This paper presents the work carried out for the detection of road markings damage using computer vision techniques. This is a complex task for which there are currently not many papers and large image sets in the literature. This study uses images from the public Road Damage Detection dataset for the D44 defect and also provides 971 new labelled images for Spanish roads. For this purpose, three detectors based on deep learning architectures (Faster RCNN, SDD and EfficientDet) have been used and single-source and mixed-source models have been studied to find the model that best fits the target images. Finally, F1-score values reaching 0.929 and 0.934 have been obtained for Japanese and Spanish images respectively which improve the state-of-the-art results by 25%. It can be concluded that the results of this study are promising, although the collection of many more images will be necessary for the scientific community to continue advancing in the future in this field of research.
doi_str_mv 10.1109/TITS.2022.3192916
format Article
fullrecord <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_proquest_journals_2734387186</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>9843894</ieee_id><sourcerecordid>2734387186</sourcerecordid><originalsourceid>FETCH-LOGICAL-c223t-48f89b7f7b21a44c4ec9b86c5423bea47317cfcf836c31cec397ef7fc711c6553</originalsourceid><addsrcrecordid>eNo9kFFLwzAUhYsoOKc_QHwJ-NzZm6RN8jjt1MFE0Plc0uxmdK7NlrQD_72tGz7dw-E758KJoltIJgCJeljOl58TmlA6YaCoguwsGkGayjhJIDsfNOWxStLkMroKYdO7PAUYRfsPp1fkTfvvqlmTXNd6jSTHFk1buYY86oAr0osccUcWqH0zcNZ5Mm-s16H1nWk7j2R20NtO_4Wqhsxq9OuBnHata1ztukByXx166zq6sHob8OZ0x9HX82z59Bov3l_mT9NFbChlbcyllaoUVpQUNOeGo1GlzEzKKStRc8FAGGusZJlhYNAwJdAKawSAydKUjaP7Y-_Ou32HoS02rvNN_7KggnEmBcisp-BIGe9C8GiLna9q7X8KSIph2WJYthiWLU7L9pm7Y6ZCxH9eyb5TcfYL2uJ18Q</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2734387186</pqid></control><display><type>article</type><title>Road Marking Damage Detection Based on Deep Learning for Infrastructure Evaluation in Emerging Autonomous Driving</title><source>IEEE/IET Electronic Library (IEL)</source><creator>Iparraguirre, Olatz ; Iturbe-Olleta, Nagore ; Brazalez, Alfonso ; Borro, Diego</creator><creatorcontrib>Iparraguirre, Olatz ; Iturbe-Olleta, Nagore ; Brazalez, Alfonso ; Borro, Diego</creatorcontrib><description>The future of autonomous driving is slowly approaching, but there are still many steps to take before it can become a reality. It is crucial to pay attention to road infrastructure, because without it, intelligent vehicles will not be able to operate reliably, and it will never be possible to dispense of driver's control. This paper presents the work carried out for the detection of road markings damage using computer vision techniques. This is a complex task for which there are currently not many papers and large image sets in the literature. This study uses images from the public Road Damage Detection dataset for the D44 defect and also provides 971 new labelled images for Spanish roads. For this purpose, three detectors based on deep learning architectures (Faster RCNN, SDD and EfficientDet) have been used and single-source and mixed-source models have been studied to find the model that best fits the target images. Finally, F1-score values reaching 0.929 and 0.934 have been obtained for Japanese and Spanish images respectively which improve the state-of-the-art results by 25%. It can be concluded that the results of this study are promising, although the collection of many more images will be necessary for the scientific community to continue advancing in the future in this field of research.</description><identifier>ISSN: 1524-9050</identifier><identifier>EISSN: 1558-0016</identifier><identifier>DOI: 10.1109/TITS.2022.3192916</identifier><identifier>CODEN: ITISFG</identifier><language>eng</language><publisher>New York: IEEE</publisher><subject>Automation ; Autonomous driving ; Computer vision ; Damage detection ; Deep learning ; deep learning object detector ; Detectors ; Driving ; Infrastructure ; Inspection ; Intelligent vehicles ; Maintenance engineering ; road damage detection ; road infrastructure maintenance ; Roads ; Roads &amp; highways ; Vehicles</subject><ispartof>IEEE transactions on intelligent transportation systems, 2022-11, Vol.23 (11), p.22378-22385</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2022</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c223t-48f89b7f7b21a44c4ec9b86c5423bea47317cfcf836c31cec397ef7fc711c6553</citedby><cites>FETCH-LOGICAL-c223t-48f89b7f7b21a44c4ec9b86c5423bea47317cfcf836c31cec397ef7fc711c6553</cites><orcidid>0000-0001-5661-0287 ; 0000-0002-8789-4777 ; 0000-0002-5826-3458</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/9843894$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,776,780,792,27903,27904,54736</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/9843894$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Iparraguirre, Olatz</creatorcontrib><creatorcontrib>Iturbe-Olleta, Nagore</creatorcontrib><creatorcontrib>Brazalez, Alfonso</creatorcontrib><creatorcontrib>Borro, Diego</creatorcontrib><title>Road Marking Damage Detection Based on Deep Learning for Infrastructure Evaluation in Emerging Autonomous Driving</title><title>IEEE transactions on intelligent transportation systems</title><addtitle>TITS</addtitle><description>The future of autonomous driving is slowly approaching, but there are still many steps to take before it can become a reality. It is crucial to pay attention to road infrastructure, because without it, intelligent vehicles will not be able to operate reliably, and it will never be possible to dispense of driver's control. This paper presents the work carried out for the detection of road markings damage using computer vision techniques. This is a complex task for which there are currently not many papers and large image sets in the literature. This study uses images from the public Road Damage Detection dataset for the D44 defect and also provides 971 new labelled images for Spanish roads. For this purpose, three detectors based on deep learning architectures (Faster RCNN, SDD and EfficientDet) have been used and single-source and mixed-source models have been studied to find the model that best fits the target images. Finally, F1-score values reaching 0.929 and 0.934 have been obtained for Japanese and Spanish images respectively which improve the state-of-the-art results by 25%. It can be concluded that the results of this study are promising, although the collection of many more images will be necessary for the scientific community to continue advancing in the future in this field of research.</description><subject>Automation</subject><subject>Autonomous driving</subject><subject>Computer vision</subject><subject>Damage detection</subject><subject>Deep learning</subject><subject>deep learning object detector</subject><subject>Detectors</subject><subject>Driving</subject><subject>Infrastructure</subject><subject>Inspection</subject><subject>Intelligent vehicles</subject><subject>Maintenance engineering</subject><subject>road damage detection</subject><subject>road infrastructure maintenance</subject><subject>Roads</subject><subject>Roads &amp; highways</subject><subject>Vehicles</subject><issn>1524-9050</issn><issn>1558-0016</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNo9kFFLwzAUhYsoOKc_QHwJ-NzZm6RN8jjt1MFE0Plc0uxmdK7NlrQD_72tGz7dw-E758KJoltIJgCJeljOl58TmlA6YaCoguwsGkGayjhJIDsfNOWxStLkMroKYdO7PAUYRfsPp1fkTfvvqlmTXNd6jSTHFk1buYY86oAr0osccUcWqH0zcNZ5Mm-s16H1nWk7j2R20NtO_4Wqhsxq9OuBnHata1ztukByXx166zq6sHob8OZ0x9HX82z59Bov3l_mT9NFbChlbcyllaoUVpQUNOeGo1GlzEzKKStRc8FAGGusZJlhYNAwJdAKawSAydKUjaP7Y-_Ou32HoS02rvNN_7KggnEmBcisp-BIGe9C8GiLna9q7X8KSIph2WJYthiWLU7L9pm7Y6ZCxH9eyb5TcfYL2uJ18Q</recordid><startdate>20221101</startdate><enddate>20221101</enddate><creator>Iparraguirre, Olatz</creator><creator>Iturbe-Olleta, Nagore</creator><creator>Brazalez, Alfonso</creator><creator>Borro, Diego</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7SP</scope><scope>8FD</scope><scope>FR3</scope><scope>JQ2</scope><scope>KR7</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><orcidid>https://orcid.org/0000-0001-5661-0287</orcidid><orcidid>https://orcid.org/0000-0002-8789-4777</orcidid><orcidid>https://orcid.org/0000-0002-5826-3458</orcidid></search><sort><creationdate>20221101</creationdate><title>Road Marking Damage Detection Based on Deep Learning for Infrastructure Evaluation in Emerging Autonomous Driving</title><author>Iparraguirre, Olatz ; Iturbe-Olleta, Nagore ; Brazalez, Alfonso ; Borro, Diego</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c223t-48f89b7f7b21a44c4ec9b86c5423bea47317cfcf836c31cec397ef7fc711c6553</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>Automation</topic><topic>Autonomous driving</topic><topic>Computer vision</topic><topic>Damage detection</topic><topic>Deep learning</topic><topic>deep learning object detector</topic><topic>Detectors</topic><topic>Driving</topic><topic>Infrastructure</topic><topic>Inspection</topic><topic>Intelligent vehicles</topic><topic>Maintenance engineering</topic><topic>road damage detection</topic><topic>road infrastructure maintenance</topic><topic>Roads</topic><topic>Roads &amp; highways</topic><topic>Vehicles</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Iparraguirre, Olatz</creatorcontrib><creatorcontrib>Iturbe-Olleta, Nagore</creatorcontrib><creatorcontrib>Brazalez, Alfonso</creatorcontrib><creatorcontrib>Borro, Diego</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE/IET Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics &amp; Communications Abstracts</collection><collection>Technology Research Database</collection><collection>Engineering Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Civil Engineering Abstracts</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>IEEE transactions on intelligent transportation systems</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Iparraguirre, Olatz</au><au>Iturbe-Olleta, Nagore</au><au>Brazalez, Alfonso</au><au>Borro, Diego</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Road Marking Damage Detection Based on Deep Learning for Infrastructure Evaluation in Emerging Autonomous Driving</atitle><jtitle>IEEE transactions on intelligent transportation systems</jtitle><stitle>TITS</stitle><date>2022-11-01</date><risdate>2022</risdate><volume>23</volume><issue>11</issue><spage>22378</spage><epage>22385</epage><pages>22378-22385</pages><issn>1524-9050</issn><eissn>1558-0016</eissn><coden>ITISFG</coden><abstract>The future of autonomous driving is slowly approaching, but there are still many steps to take before it can become a reality. It is crucial to pay attention to road infrastructure, because without it, intelligent vehicles will not be able to operate reliably, and it will never be possible to dispense of driver's control. This paper presents the work carried out for the detection of road markings damage using computer vision techniques. This is a complex task for which there are currently not many papers and large image sets in the literature. This study uses images from the public Road Damage Detection dataset for the D44 defect and also provides 971 new labelled images for Spanish roads. For this purpose, three detectors based on deep learning architectures (Faster RCNN, SDD and EfficientDet) have been used and single-source and mixed-source models have been studied to find the model that best fits the target images. Finally, F1-score values reaching 0.929 and 0.934 have been obtained for Japanese and Spanish images respectively which improve the state-of-the-art results by 25%. It can be concluded that the results of this study are promising, although the collection of many more images will be necessary for the scientific community to continue advancing in the future in this field of research.</abstract><cop>New York</cop><pub>IEEE</pub><doi>10.1109/TITS.2022.3192916</doi><tpages>8</tpages><orcidid>https://orcid.org/0000-0001-5661-0287</orcidid><orcidid>https://orcid.org/0000-0002-8789-4777</orcidid><orcidid>https://orcid.org/0000-0002-5826-3458</orcidid></addata></record>
fulltext fulltext_linktorsrc
identifier ISSN: 1524-9050
ispartof IEEE transactions on intelligent transportation systems, 2022-11, Vol.23 (11), p.22378-22385
issn 1524-9050
1558-0016
language eng
recordid cdi_proquest_journals_2734387186
source IEEE/IET Electronic Library (IEL)
subjects Automation
Autonomous driving
Computer vision
Damage detection
Deep learning
deep learning object detector
Detectors
Driving
Infrastructure
Inspection
Intelligent vehicles
Maintenance engineering
road damage detection
road infrastructure maintenance
Roads
Roads & highways
Vehicles
title Road Marking Damage Detection Based on Deep Learning for Infrastructure Evaluation in Emerging Autonomous Driving
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-24T16%3A40%3A11IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Road%20Marking%20Damage%20Detection%20Based%20on%20Deep%20Learning%20for%20Infrastructure%20Evaluation%20in%20Emerging%20Autonomous%20Driving&rft.jtitle=IEEE%20transactions%20on%20intelligent%20transportation%20systems&rft.au=Iparraguirre,%20Olatz&rft.date=2022-11-01&rft.volume=23&rft.issue=11&rft.spage=22378&rft.epage=22385&rft.pages=22378-22385&rft.issn=1524-9050&rft.eissn=1558-0016&rft.coden=ITISFG&rft_id=info:doi/10.1109/TITS.2022.3192916&rft_dat=%3Cproquest_RIE%3E2734387186%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2734387186&rft_id=info:pmid/&rft_ieee_id=9843894&rfr_iscdi=true