Toward Reliable License Plate Detection in Varied Contexts: Overcoming the Issue of Undersized Plate Annotations

License plate detection and recognition (LPDR) is of paramount importance in the Intelligent Transportation Systems. Most existing license plate (LP) detectors rely on anchors, rendering them vulnerable to multi-scale LPs, especially those of smaller scales, which limited the overall performance of...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on intelligent transportation systems 2024-11, Vol.25 (11), p.18107-18121
Hauptverfasser: Peng, Zhongxing, Gao, Yilin, Mu, Shiyi, Xu, Shugong
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 18121
container_issue 11
container_start_page 18107
container_title IEEE transactions on intelligent transportation systems
container_volume 25
creator Peng, Zhongxing
Gao, Yilin
Mu, Shiyi
Xu, Shugong
description License plate detection and recognition (LPDR) is of paramount importance in the Intelligent Transportation Systems. Most existing license plate (LP) detectors rely on anchors, rendering them vulnerable to multi-scale LPs, especially those of smaller scales, which limited the overall performance of LPDR. Another issue prevalent in LP datasets arises from the inherent ambiguity in manual labeling standards. Owing to this uncertainty, certain small-scale LPs that are distinctly detectable often suffer from annotation omissions. The presence of such noisy data has a detrimental impact on the training of LP detectors. In this paper, we propose ALPD, an anchor-free LP detector along with three key designs, namely the Multi-To-One scale-fusion block (MTO) for cross-scale feature integration, the Multi-Domain Feature Simulation (MDFS) for narrowing the disparities across multiple domains even the unseen ones, and the decoupled heads for better optimizing classification and regression tasks. Besides, ALPD incorporates a semi-supervised training framework using an abstention strategy known as arbitration, wherein a Teacher model and a Student model are trained collaboratively, enabling the supplementation of missing annotations for small license plates. Furthermore, it possesses immunity to model performance degradation when fed with massive quantities of unlabeled or even mislabeled data. The arbitration method along with a penalty factor can effectively guarantee the pseudo-label quality and balance complexity between the Teacher and Student tasks, thus preventing the Student from being constrained by ambiguous pseudo-labels. ALPD outperforms previous state-of-the-art methods on two widely recognized benchmarks and exhibits its robustness and generalizability on the All-round CCPD dataset.
doi_str_mv 10.1109/TITS.2024.3424663
format Article
fullrecord <record><control><sourceid>crossref_RIE</sourceid><recordid>TN_cdi_crossref_primary_10_1109_TITS_2024_3424663</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>10598829</ieee_id><sourcerecordid>10_1109_TITS_2024_3424663</sourcerecordid><originalsourceid>FETCH-LOGICAL-c148t-f7742a9246e6ea7c8ea714b232694a592800814bc483f23f11ff3c6a6502f0c43</originalsourceid><addsrcrecordid>eNpNkN1KAzEQhYMoWKsPIHiRF9iav02z3pVqtVCo6NbbJU0nGtkmJYm_T-8u7YU3M8PhnAPzIXRJyYhSUl3X8_p5xAgTIy6YkJIfoQEtS1UQQuVxfzNRVKQkp-gspfdOFSWlA7Srw5eOG_wErdPrFvDCGfAJ8GOrM-BbyGCyCx47j190dLDB0-AzfOd0g5efEE3YOv-K8xvgeUofgIPFK7-BmNxvZ97XTLwPWfc96RydWN0muDjsIVrN7urpQ7FY3s-nk0VhqFC5sOOxYLrqXgEJemxUN6hYM85kJXRZMUWI6gQjFLeMW0qt5UZqWRJmiRF8iOi-18SQUgTb7KLb6vjTUNL0yJoeWdMjaw7IuszVPuMA4J-_rJRiFf8DebBoyw</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Toward Reliable License Plate Detection in Varied Contexts: Overcoming the Issue of Undersized Plate Annotations</title><source>IEEE Electronic Library (IEL)</source><creator>Peng, Zhongxing ; Gao, Yilin ; Mu, Shiyi ; Xu, Shugong</creator><creatorcontrib>Peng, Zhongxing ; Gao, Yilin ; Mu, Shiyi ; Xu, Shugong</creatorcontrib><description>License plate detection and recognition (LPDR) is of paramount importance in the Intelligent Transportation Systems. Most existing license plate (LP) detectors rely on anchors, rendering them vulnerable to multi-scale LPs, especially those of smaller scales, which limited the overall performance of LPDR. Another issue prevalent in LP datasets arises from the inherent ambiguity in manual labeling standards. Owing to this uncertainty, certain small-scale LPs that are distinctly detectable often suffer from annotation omissions. The presence of such noisy data has a detrimental impact on the training of LP detectors. In this paper, we propose ALPD, an anchor-free LP detector along with three key designs, namely the Multi-To-One scale-fusion block (MTO) for cross-scale feature integration, the Multi-Domain Feature Simulation (MDFS) for narrowing the disparities across multiple domains even the unseen ones, and the decoupled heads for better optimizing classification and regression tasks. Besides, ALPD incorporates a semi-supervised training framework using an abstention strategy known as arbitration, wherein a Teacher model and a Student model are trained collaboratively, enabling the supplementation of missing annotations for small license plates. Furthermore, it possesses immunity to model performance degradation when fed with massive quantities of unlabeled or even mislabeled data. The arbitration method along with a penalty factor can effectively guarantee the pseudo-label quality and balance complexity between the Teacher and Student tasks, thus preventing the Student from being constrained by ambiguous pseudo-labels. ALPD outperforms previous state-of-the-art methods on two widely recognized benchmarks and exhibits its robustness and generalizability on the All-round CCPD dataset.</description><identifier>ISSN: 1524-9050</identifier><identifier>EISSN: 1558-0016</identifier><identifier>DOI: 10.1109/TITS.2024.3424663</identifier><identifier>CODEN: ITISFG</identifier><language>eng</language><publisher>IEEE</publisher><subject>anchor-free ; Annotations ; Detection algorithms ; Feature extraction ; License plate detection ; License plate recognition ; Robustness ; semi-supervised learning ; Semisupervised learning</subject><ispartof>IEEE transactions on intelligent transportation systems, 2024-11, Vol.25 (11), p.18107-18121</ispartof><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-c148t-f7742a9246e6ea7c8ea714b232694a592800814bc483f23f11ff3c6a6502f0c43</cites><orcidid>0000-0003-4985-4034 ; 0000-0002-5870-0101 ; 0000-0003-1905-6269</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/10598829$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,776,780,792,27903,27904,54736</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/10598829$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Peng, Zhongxing</creatorcontrib><creatorcontrib>Gao, Yilin</creatorcontrib><creatorcontrib>Mu, Shiyi</creatorcontrib><creatorcontrib>Xu, Shugong</creatorcontrib><title>Toward Reliable License Plate Detection in Varied Contexts: Overcoming the Issue of Undersized Plate Annotations</title><title>IEEE transactions on intelligent transportation systems</title><addtitle>TITS</addtitle><description>License plate detection and recognition (LPDR) is of paramount importance in the Intelligent Transportation Systems. Most existing license plate (LP) detectors rely on anchors, rendering them vulnerable to multi-scale LPs, especially those of smaller scales, which limited the overall performance of LPDR. Another issue prevalent in LP datasets arises from the inherent ambiguity in manual labeling standards. Owing to this uncertainty, certain small-scale LPs that are distinctly detectable often suffer from annotation omissions. The presence of such noisy data has a detrimental impact on the training of LP detectors. In this paper, we propose ALPD, an anchor-free LP detector along with three key designs, namely the Multi-To-One scale-fusion block (MTO) for cross-scale feature integration, the Multi-Domain Feature Simulation (MDFS) for narrowing the disparities across multiple domains even the unseen ones, and the decoupled heads for better optimizing classification and regression tasks. Besides, ALPD incorporates a semi-supervised training framework using an abstention strategy known as arbitration, wherein a Teacher model and a Student model are trained collaboratively, enabling the supplementation of missing annotations for small license plates. Furthermore, it possesses immunity to model performance degradation when fed with massive quantities of unlabeled or even mislabeled data. The arbitration method along with a penalty factor can effectively guarantee the pseudo-label quality and balance complexity between the Teacher and Student tasks, thus preventing the Student from being constrained by ambiguous pseudo-labels. ALPD outperforms previous state-of-the-art methods on two widely recognized benchmarks and exhibits its robustness and generalizability on the All-round CCPD dataset.</description><subject>anchor-free</subject><subject>Annotations</subject><subject>Detection algorithms</subject><subject>Feature extraction</subject><subject>License plate detection</subject><subject>License plate recognition</subject><subject>Robustness</subject><subject>semi-supervised learning</subject><subject>Semisupervised learning</subject><issn>1524-9050</issn><issn>1558-0016</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNpNkN1KAzEQhYMoWKsPIHiRF9iav02z3pVqtVCo6NbbJU0nGtkmJYm_T-8u7YU3M8PhnAPzIXRJyYhSUl3X8_p5xAgTIy6YkJIfoQEtS1UQQuVxfzNRVKQkp-gspfdOFSWlA7Srw5eOG_wErdPrFvDCGfAJ8GOrM-BbyGCyCx47j190dLDB0-AzfOd0g5efEE3YOv-K8xvgeUofgIPFK7-BmNxvZ97XTLwPWfc96RydWN0muDjsIVrN7urpQ7FY3s-nk0VhqFC5sOOxYLrqXgEJemxUN6hYM85kJXRZMUWI6gQjFLeMW0qt5UZqWRJmiRF8iOi-18SQUgTb7KLb6vjTUNL0yJoeWdMjaw7IuszVPuMA4J-_rJRiFf8DebBoyw</recordid><startdate>202411</startdate><enddate>202411</enddate><creator>Peng, Zhongxing</creator><creator>Gao, Yilin</creator><creator>Mu, Shiyi</creator><creator>Xu, Shugong</creator><general>IEEE</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><orcidid>https://orcid.org/0000-0003-4985-4034</orcidid><orcidid>https://orcid.org/0000-0002-5870-0101</orcidid><orcidid>https://orcid.org/0000-0003-1905-6269</orcidid></search><sort><creationdate>202411</creationdate><title>Toward Reliable License Plate Detection in Varied Contexts: Overcoming the Issue of Undersized Plate Annotations</title><author>Peng, Zhongxing ; Gao, Yilin ; Mu, Shiyi ; Xu, Shugong</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c148t-f7742a9246e6ea7c8ea714b232694a592800814bc483f23f11ff3c6a6502f0c43</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>anchor-free</topic><topic>Annotations</topic><topic>Detection algorithms</topic><topic>Feature extraction</topic><topic>License plate detection</topic><topic>License plate recognition</topic><topic>Robustness</topic><topic>semi-supervised learning</topic><topic>Semisupervised learning</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Peng, Zhongxing</creatorcontrib><creatorcontrib>Gao, Yilin</creatorcontrib><creatorcontrib>Mu, Shiyi</creatorcontrib><creatorcontrib>Xu, Shugong</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><jtitle>IEEE transactions on intelligent transportation systems</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Peng, Zhongxing</au><au>Gao, Yilin</au><au>Mu, Shiyi</au><au>Xu, Shugong</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Toward Reliable License Plate Detection in Varied Contexts: Overcoming the Issue of Undersized Plate Annotations</atitle><jtitle>IEEE transactions on intelligent transportation systems</jtitle><stitle>TITS</stitle><date>2024-11</date><risdate>2024</risdate><volume>25</volume><issue>11</issue><spage>18107</spage><epage>18121</epage><pages>18107-18121</pages><issn>1524-9050</issn><eissn>1558-0016</eissn><coden>ITISFG</coden><abstract>License plate detection and recognition (LPDR) is of paramount importance in the Intelligent Transportation Systems. Most existing license plate (LP) detectors rely on anchors, rendering them vulnerable to multi-scale LPs, especially those of smaller scales, which limited the overall performance of LPDR. Another issue prevalent in LP datasets arises from the inherent ambiguity in manual labeling standards. Owing to this uncertainty, certain small-scale LPs that are distinctly detectable often suffer from annotation omissions. The presence of such noisy data has a detrimental impact on the training of LP detectors. In this paper, we propose ALPD, an anchor-free LP detector along with three key designs, namely the Multi-To-One scale-fusion block (MTO) for cross-scale feature integration, the Multi-Domain Feature Simulation (MDFS) for narrowing the disparities across multiple domains even the unseen ones, and the decoupled heads for better optimizing classification and regression tasks. Besides, ALPD incorporates a semi-supervised training framework using an abstention strategy known as arbitration, wherein a Teacher model and a Student model are trained collaboratively, enabling the supplementation of missing annotations for small license plates. Furthermore, it possesses immunity to model performance degradation when fed with massive quantities of unlabeled or even mislabeled data. The arbitration method along with a penalty factor can effectively guarantee the pseudo-label quality and balance complexity between the Teacher and Student tasks, thus preventing the Student from being constrained by ambiguous pseudo-labels. ALPD outperforms previous state-of-the-art methods on two widely recognized benchmarks and exhibits its robustness and generalizability on the All-round CCPD dataset.</abstract><pub>IEEE</pub><doi>10.1109/TITS.2024.3424663</doi><tpages>15</tpages><orcidid>https://orcid.org/0000-0003-4985-4034</orcidid><orcidid>https://orcid.org/0000-0002-5870-0101</orcidid><orcidid>https://orcid.org/0000-0003-1905-6269</orcidid></addata></record>
fulltext fulltext_linktorsrc
identifier ISSN: 1524-9050
ispartof IEEE transactions on intelligent transportation systems, 2024-11, Vol.25 (11), p.18107-18121
issn 1524-9050
1558-0016
language eng
recordid cdi_crossref_primary_10_1109_TITS_2024_3424663
source IEEE Electronic Library (IEL)
subjects anchor-free
Annotations
Detection algorithms
Feature extraction
License plate detection
License plate recognition
Robustness
semi-supervised learning
Semisupervised learning
title Toward Reliable License Plate Detection in Varied Contexts: Overcoming the Issue of Undersized Plate Annotations
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-23T18%3A38%3A36IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-crossref_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Toward%20Reliable%20License%20Plate%20Detection%20in%20Varied%20Contexts:%20Overcoming%20the%20Issue%20of%20Undersized%20Plate%20Annotations&rft.jtitle=IEEE%20transactions%20on%20intelligent%20transportation%20systems&rft.au=Peng,%20Zhongxing&rft.date=2024-11&rft.volume=25&rft.issue=11&rft.spage=18107&rft.epage=18121&rft.pages=18107-18121&rft.issn=1524-9050&rft.eissn=1558-0016&rft.coden=ITISFG&rft_id=info:doi/10.1109/TITS.2024.3424663&rft_dat=%3Ccrossref_RIE%3E10_1109_TITS_2024_3424663%3C/crossref_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rft_ieee_id=10598829&rfr_iscdi=true