Road Marking Damage Detection Based on Deep Learning for Infrastructure Evaluation in Emerging Autonomous Driving
The future of autonomous driving is slowly approaching, but there are still many steps to take before it can become a reality. It is crucial to pay attention to road infrastructure, because without it, intelligent vehicles will not be able to operate reliably, and it will never be possible to dispen...
Gespeichert in:
Veröffentlicht in: | IEEE transactions on intelligent transportation systems 2022-11, Vol.23 (11), p.22378-22385 |
---|---|
Hauptverfasser: | , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 22385 |
---|---|
container_issue | 11 |
container_start_page | 22378 |
container_title | IEEE transactions on intelligent transportation systems |
container_volume | 23 |
creator | Iparraguirre, Olatz Iturbe-Olleta, Nagore Brazalez, Alfonso Borro, Diego |
description | The future of autonomous driving is slowly approaching, but there are still many steps to take before it can become a reality. It is crucial to pay attention to road infrastructure, because without it, intelligent vehicles will not be able to operate reliably, and it will never be possible to dispense of driver's control. This paper presents the work carried out for the detection of road markings damage using computer vision techniques. This is a complex task for which there are currently not many papers and large image sets in the literature. This study uses images from the public Road Damage Detection dataset for the D44 defect and also provides 971 new labelled images for Spanish roads. For this purpose, three detectors based on deep learning architectures (Faster RCNN, SDD and EfficientDet) have been used and single-source and mixed-source models have been studied to find the model that best fits the target images. Finally, F1-score values reaching 0.929 and 0.934 have been obtained for Japanese and Spanish images respectively which improve the state-of-the-art results by 25%. It can be concluded that the results of this study are promising, although the collection of many more images will be necessary for the scientific community to continue advancing in the future in this field of research. |
doi_str_mv | 10.1109/TITS.2022.3192916 |
format | Article |
fullrecord | <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_proquest_journals_2734387186</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>9843894</ieee_id><sourcerecordid>2734387186</sourcerecordid><originalsourceid>FETCH-LOGICAL-c223t-48f89b7f7b21a44c4ec9b86c5423bea47317cfcf836c31cec397ef7fc711c6553</originalsourceid><addsrcrecordid>eNo9kFFLwzAUhYsoOKc_QHwJ-NzZm6RN8jjt1MFE0Plc0uxmdK7NlrQD_72tGz7dw-E758KJoltIJgCJeljOl58TmlA6YaCoguwsGkGayjhJIDsfNOWxStLkMroKYdO7PAUYRfsPp1fkTfvvqlmTXNd6jSTHFk1buYY86oAr0osccUcWqH0zcNZ5Mm-s16H1nWk7j2R20NtO_4Wqhsxq9OuBnHata1ztukByXx166zq6sHob8OZ0x9HX82z59Bov3l_mT9NFbChlbcyllaoUVpQUNOeGo1GlzEzKKStRc8FAGGusZJlhYNAwJdAKawSAydKUjaP7Y-_Ou32HoS02rvNN_7KggnEmBcisp-BIGe9C8GiLna9q7X8KSIph2WJYthiWLU7L9pm7Y6ZCxH9eyb5TcfYL2uJ18Q</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2734387186</pqid></control><display><type>article</type><title>Road Marking Damage Detection Based on Deep Learning for Infrastructure Evaluation in Emerging Autonomous Driving</title><source>IEEE/IET Electronic Library (IEL)</source><creator>Iparraguirre, Olatz ; Iturbe-Olleta, Nagore ; Brazalez, Alfonso ; Borro, Diego</creator><creatorcontrib>Iparraguirre, Olatz ; Iturbe-Olleta, Nagore ; Brazalez, Alfonso ; Borro, Diego</creatorcontrib><description>The future of autonomous driving is slowly approaching, but there are still many steps to take before it can become a reality. It is crucial to pay attention to road infrastructure, because without it, intelligent vehicles will not be able to operate reliably, and it will never be possible to dispense of driver's control. This paper presents the work carried out for the detection of road markings damage using computer vision techniques. This is a complex task for which there are currently not many papers and large image sets in the literature. This study uses images from the public Road Damage Detection dataset for the D44 defect and also provides 971 new labelled images for Spanish roads. For this purpose, three detectors based on deep learning architectures (Faster RCNN, SDD and EfficientDet) have been used and single-source and mixed-source models have been studied to find the model that best fits the target images. Finally, F1-score values reaching 0.929 and 0.934 have been obtained for Japanese and Spanish images respectively which improve the state-of-the-art results by 25%. It can be concluded that the results of this study are promising, although the collection of many more images will be necessary for the scientific community to continue advancing in the future in this field of research.</description><identifier>ISSN: 1524-9050</identifier><identifier>EISSN: 1558-0016</identifier><identifier>DOI: 10.1109/TITS.2022.3192916</identifier><identifier>CODEN: ITISFG</identifier><language>eng</language><publisher>New York: IEEE</publisher><subject>Automation ; Autonomous driving ; Computer vision ; Damage detection ; Deep learning ; deep learning object detector ; Detectors ; Driving ; Infrastructure ; Inspection ; Intelligent vehicles ; Maintenance engineering ; road damage detection ; road infrastructure maintenance ; Roads ; Roads & highways ; Vehicles</subject><ispartof>IEEE transactions on intelligent transportation systems, 2022-11, Vol.23 (11), p.22378-22385</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2022</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c223t-48f89b7f7b21a44c4ec9b86c5423bea47317cfcf836c31cec397ef7fc711c6553</citedby><cites>FETCH-LOGICAL-c223t-48f89b7f7b21a44c4ec9b86c5423bea47317cfcf836c31cec397ef7fc711c6553</cites><orcidid>0000-0001-5661-0287 ; 0000-0002-8789-4777 ; 0000-0002-5826-3458</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/9843894$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,776,780,792,27903,27904,54736</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/9843894$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Iparraguirre, Olatz</creatorcontrib><creatorcontrib>Iturbe-Olleta, Nagore</creatorcontrib><creatorcontrib>Brazalez, Alfonso</creatorcontrib><creatorcontrib>Borro, Diego</creatorcontrib><title>Road Marking Damage Detection Based on Deep Learning for Infrastructure Evaluation in Emerging Autonomous Driving</title><title>IEEE transactions on intelligent transportation systems</title><addtitle>TITS</addtitle><description>The future of autonomous driving is slowly approaching, but there are still many steps to take before it can become a reality. It is crucial to pay attention to road infrastructure, because without it, intelligent vehicles will not be able to operate reliably, and it will never be possible to dispense of driver's control. This paper presents the work carried out for the detection of road markings damage using computer vision techniques. This is a complex task for which there are currently not many papers and large image sets in the literature. This study uses images from the public Road Damage Detection dataset for the D44 defect and also provides 971 new labelled images for Spanish roads. For this purpose, three detectors based on deep learning architectures (Faster RCNN, SDD and EfficientDet) have been used and single-source and mixed-source models have been studied to find the model that best fits the target images. Finally, F1-score values reaching 0.929 and 0.934 have been obtained for Japanese and Spanish images respectively which improve the state-of-the-art results by 25%. It can be concluded that the results of this study are promising, although the collection of many more images will be necessary for the scientific community to continue advancing in the future in this field of research.</description><subject>Automation</subject><subject>Autonomous driving</subject><subject>Computer vision</subject><subject>Damage detection</subject><subject>Deep learning</subject><subject>deep learning object detector</subject><subject>Detectors</subject><subject>Driving</subject><subject>Infrastructure</subject><subject>Inspection</subject><subject>Intelligent vehicles</subject><subject>Maintenance engineering</subject><subject>road damage detection</subject><subject>road infrastructure maintenance</subject><subject>Roads</subject><subject>Roads & highways</subject><subject>Vehicles</subject><issn>1524-9050</issn><issn>1558-0016</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNo9kFFLwzAUhYsoOKc_QHwJ-NzZm6RN8jjt1MFE0Plc0uxmdK7NlrQD_72tGz7dw-E758KJoltIJgCJeljOl58TmlA6YaCoguwsGkGayjhJIDsfNOWxStLkMroKYdO7PAUYRfsPp1fkTfvvqlmTXNd6jSTHFk1buYY86oAr0osccUcWqH0zcNZ5Mm-s16H1nWk7j2R20NtO_4Wqhsxq9OuBnHata1ztukByXx166zq6sHob8OZ0x9HX82z59Bov3l_mT9NFbChlbcyllaoUVpQUNOeGo1GlzEzKKStRc8FAGGusZJlhYNAwJdAKawSAydKUjaP7Y-_Ou32HoS02rvNN_7KggnEmBcisp-BIGe9C8GiLna9q7X8KSIph2WJYthiWLU7L9pm7Y6ZCxH9eyb5TcfYL2uJ18Q</recordid><startdate>20221101</startdate><enddate>20221101</enddate><creator>Iparraguirre, Olatz</creator><creator>Iturbe-Olleta, Nagore</creator><creator>Brazalez, Alfonso</creator><creator>Borro, Diego</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7SP</scope><scope>8FD</scope><scope>FR3</scope><scope>JQ2</scope><scope>KR7</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><orcidid>https://orcid.org/0000-0001-5661-0287</orcidid><orcidid>https://orcid.org/0000-0002-8789-4777</orcidid><orcidid>https://orcid.org/0000-0002-5826-3458</orcidid></search><sort><creationdate>20221101</creationdate><title>Road Marking Damage Detection Based on Deep Learning for Infrastructure Evaluation in Emerging Autonomous Driving</title><author>Iparraguirre, Olatz ; Iturbe-Olleta, Nagore ; Brazalez, Alfonso ; Borro, Diego</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c223t-48f89b7f7b21a44c4ec9b86c5423bea47317cfcf836c31cec397ef7fc711c6553</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>Automation</topic><topic>Autonomous driving</topic><topic>Computer vision</topic><topic>Damage detection</topic><topic>Deep learning</topic><topic>deep learning object detector</topic><topic>Detectors</topic><topic>Driving</topic><topic>Infrastructure</topic><topic>Inspection</topic><topic>Intelligent vehicles</topic><topic>Maintenance engineering</topic><topic>road damage detection</topic><topic>road infrastructure maintenance</topic><topic>Roads</topic><topic>Roads & highways</topic><topic>Vehicles</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Iparraguirre, Olatz</creatorcontrib><creatorcontrib>Iturbe-Olleta, Nagore</creatorcontrib><creatorcontrib>Brazalez, Alfonso</creatorcontrib><creatorcontrib>Borro, Diego</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE/IET Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics & Communications Abstracts</collection><collection>Technology Research Database</collection><collection>Engineering Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Civil Engineering Abstracts</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>IEEE transactions on intelligent transportation systems</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Iparraguirre, Olatz</au><au>Iturbe-Olleta, Nagore</au><au>Brazalez, Alfonso</au><au>Borro, Diego</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Road Marking Damage Detection Based on Deep Learning for Infrastructure Evaluation in Emerging Autonomous Driving</atitle><jtitle>IEEE transactions on intelligent transportation systems</jtitle><stitle>TITS</stitle><date>2022-11-01</date><risdate>2022</risdate><volume>23</volume><issue>11</issue><spage>22378</spage><epage>22385</epage><pages>22378-22385</pages><issn>1524-9050</issn><eissn>1558-0016</eissn><coden>ITISFG</coden><abstract>The future of autonomous driving is slowly approaching, but there are still many steps to take before it can become a reality. It is crucial to pay attention to road infrastructure, because without it, intelligent vehicles will not be able to operate reliably, and it will never be possible to dispense of driver's control. This paper presents the work carried out for the detection of road markings damage using computer vision techniques. This is a complex task for which there are currently not many papers and large image sets in the literature. This study uses images from the public Road Damage Detection dataset for the D44 defect and also provides 971 new labelled images for Spanish roads. For this purpose, three detectors based on deep learning architectures (Faster RCNN, SDD and EfficientDet) have been used and single-source and mixed-source models have been studied to find the model that best fits the target images. Finally, F1-score values reaching 0.929 and 0.934 have been obtained for Japanese and Spanish images respectively which improve the state-of-the-art results by 25%. It can be concluded that the results of this study are promising, although the collection of many more images will be necessary for the scientific community to continue advancing in the future in this field of research.</abstract><cop>New York</cop><pub>IEEE</pub><doi>10.1109/TITS.2022.3192916</doi><tpages>8</tpages><orcidid>https://orcid.org/0000-0001-5661-0287</orcidid><orcidid>https://orcid.org/0000-0002-8789-4777</orcidid><orcidid>https://orcid.org/0000-0002-5826-3458</orcidid></addata></record> |
fulltext | fulltext_linktorsrc |
identifier | ISSN: 1524-9050 |
ispartof | IEEE transactions on intelligent transportation systems, 2022-11, Vol.23 (11), p.22378-22385 |
issn | 1524-9050 1558-0016 |
language | eng |
recordid | cdi_proquest_journals_2734387186 |
source | IEEE/IET Electronic Library (IEL) |
subjects | Automation Autonomous driving Computer vision Damage detection Deep learning deep learning object detector Detectors Driving Infrastructure Inspection Intelligent vehicles Maintenance engineering road damage detection road infrastructure maintenance Roads Roads & highways Vehicles |
title | Road Marking Damage Detection Based on Deep Learning for Infrastructure Evaluation in Emerging Autonomous Driving |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-24T16%3A40%3A11IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Road%20Marking%20Damage%20Detection%20Based%20on%20Deep%20Learning%20for%20Infrastructure%20Evaluation%20in%20Emerging%20Autonomous%20Driving&rft.jtitle=IEEE%20transactions%20on%20intelligent%20transportation%20systems&rft.au=Iparraguirre,%20Olatz&rft.date=2022-11-01&rft.volume=23&rft.issue=11&rft.spage=22378&rft.epage=22385&rft.pages=22378-22385&rft.issn=1524-9050&rft.eissn=1558-0016&rft.coden=ITISFG&rft_id=info:doi/10.1109/TITS.2022.3192916&rft_dat=%3Cproquest_RIE%3E2734387186%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2734387186&rft_id=info:pmid/&rft_ieee_id=9843894&rfr_iscdi=true |