Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3461353.3461391acmotherconferencesArticle/Chapter ViewAbstractPublication PagesiciaiConference Proceedingsconference-collections
research-article

RT-LPDRnet: A Real-Time License Plate Detection and Recognition Network

Published: 04 September 2021 Publication History

Abstract

Benefiting from the rapid development of deep learning, the accuracy of license plate (LP) detection and recognition has been greatly developed. However, the low computing power of embedded devices is difficult to complete this task in real-time. To tackle this problem, we propose a real-time license plate detection and recognition network in this paper. The detection head we designed can detect the bounding box and four corner points of the license plate, and then we apply the ROIAlign method to extract the features on the same backbone in order to perform license plate recognition. The resulting architecture, called RT-LPDRnet, outperforms all the SOTA methods on the large-scale license plate data set Chinese City Parking Dataset (CCPD), meanwhile with faster inference time than recent methods. Our code will be publicly available.

References

[1]
Bao Ming, Lu Xiaobo. License plate tilt detection algorithm based on Hough transform[D]., 2004. (in Chinese)
[2]
Lu Xiaobo, Bao Ming, Huang Wei. Projection-based detection method of license plate tilt[D]., 2004. (in Chinese)
[3]
Shen Yongwu, Zhang Zhuan. License plate location method based on feature color edge detection[D]., 2008. (in Chinese)
[4]
Xiong Jun, Gao Duntang, Shen Qinghong, Fast positioning algorithm based on character texture features[D]., 2003. (in Chinese)
[5]
Dalal N, Triggs B. Histograms of oriented gradients for human detection[C]//2005 IEEE computer society conference on computer vision and pattern recognition (CVPR'05). Ieee, 2005, 1: 886-893.
[6]
Lowe D G. Distinctive image features from scale-invariant keypoints[J]. International journal of computer vision, 2004, 60(2): 91-110.
[7]
Ojala T, Pietikainen M, Harwood D. Performance evaluation of texture measures with classification based on Kullback discrimination of distributions[C]//Proceedings of 12th international conference on pattern recognition. IEEE, 1994, 1: 582-585.
[8]
Zhao Xuechun, Qi Feihu. Automatic license plate recognition technology based on color segmentation[D]., 1998. (in Chinese)
[9]
Gan Ling, Lin Xiaojing. License plate character segmentation algorithm based on connected domain extraction[D]., 2011. (in Chinese)
[10]
Encyclopedia of the Sciences of Learning[M]. Springer Science & Business Media, 2011.
[11]
Schapire R E. The strength of weak learnability[J]. Machine learning, 1990, 5(2): 197-227.
[12]
Breiman L. Random forests[J]. Machine learning, 2001, 45(1): 5-32.
[13]
Ren S, He K, Girshick R, Faster R-CNN: towards real-time object detection with region proposal networks[J]. IEEE transactions on pattern analysis and machine intelligence, 2016, 39(6): 1137-1149.
[14]
He K, Gkioxari G, Dollár P, Mask r-cnn[C]//Proceedings of the IEEE international conference on computer vision. 2017: 2961-2969.
[15]
Redmon J, Divvala S, Girshick R, You only look once: Unified, real-time object detection[C]//Proceedings of the IEEE conference on computer vision and pattern recognition. 2016: 779-788.
[16]
Liu W, Anguelov D, Erhan D, Ssd: Single shot multibox detector[C]//European conference on computer vision. Springer, Cham, 2016: 21-37.
[17]
Graves A, Fernández S, Gomez F, Connectionist temporal classification: labelling unsegmented sequence data with recurrent neural networks[C]//Proceedings of the 23rd international conference on Machine learning. 2006: 369-376.
[18]
Li H, Wang P, You M, Reading car license plates using deep neural networks[J]. Image and Vision Computing, 2018, 72: 14-23.
[19]
Xu Z, Yang W, Meng A, Towards end-to-end license plate detection and recognition: A large dataset and baseline[C]//Proceedings of the European conference on computer vision (ECCV). 2018: 255-271.
[20]
Glenn Jocher, Alex Stoken, Jirka Borovec, 2020. ultralytics/yolov5. Retrieved from https://github.com/ultralytics/yolov5.
[21]
Lin T Y, Dollár P, Girshick R, Feature pyramid networks for object detection[C]//Proceedings of the IEEE conference on computer vision and pattern recognition. 2017: 2117-2125.
[22]
Liu S, Qi L, Qin H, Path aggregation network for instance segmentation[C]//Proceedings of the IEEE conference on computer vision and pattern recognition. 2018: 8759-8768.
[23]
Wang C Y, Liao H Y M, Wu Y H, CSPNet: A new backbone that can enhance learning capability of CNN[C]//Proceedings of the IEEE/CVF conference on computer vision and pattern recognition workshops. 2020: 390-391.
[24]
He K, Zhang X, Ren S, Spatial pyramid pooling in deep convolutional networks for visual recognition[J]. IEEE transactions on pattern analysis and machine intelligence, 2015, 37(9): 1904-1916.
[25]
Long J, Shelhamer E, Darrell T. Fully convolutional networks for semantic segmentation[C]//Proceedings of the IEEE conference on computer vision and pattern recognition. 2015: 3431-3440.
[26]
Lin M, Chen Q, Yan S. Network in network[J]. arXiv preprint arXiv:1312.4400, 2013.
[27]
Girshick R. Fast r-cnn[C]//Proceedings of the IEEE international conference on computer vision. 2015: 1440-1448.
[28]
Wang S Z, Lee H J. A cascade framework for a real-time statistical plate recognition system[J]. IEEE Transactions on Information Forensics and Security, 2007, 2(2): 267-282.
[29]
Redmon J, Farhadi A. YOLO9000: better, faster, stronger[C]//Proceedings of the IEEE conference on computer vision and pattern recognition. 2017: 7263-7271.
[30]
Špaňhel J, Sochor J, Juránek R, Holistic recognition of low quality license plates by CNN using track annotated data[C]//2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS). IEEE, 2017: 1-6.
[31]
Li H, Wang P, Shen C. Toward end-to-end car license plate detection and recognition with deep neural networks[J]. IEEE Transactions on Intelligent Transportation Systems, 2018, 20(3): 1126-1136.

Index Terms

  1. RT-LPDRnet: A Real-Time License Plate Detection and Recognition Network
        Index terms have been assigned to the content through auto-classification.

        Recommendations

        Comments

        Please enable JavaScript to view thecomments powered by Disqus.

        Information & Contributors

        Information

        Published In

        cover image ACM Other conferences
        ICIAI '21: Proceedings of the 2021 5th International Conference on Innovation in Artificial Intelligence
        March 2021
        246 pages
        ISBN:9781450388634
        DOI:10.1145/3461353
        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        Published: 04 September 2021

        Permissions

        Request permissions for this article.

        Check for updates

        Author Tags

        1. Convolutional neural network
        2. Detection
        3. License Plate
        4. Recognition

        Qualifiers

        • Research-article
        • Research
        • Refereed limited

        Conference

        ICIAI 2021

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • 0
          Total Citations
        • 103
          Total Downloads
        • Downloads (Last 12 months)10
        • Downloads (Last 6 weeks)3
        Reflects downloads up to 12 Nov 2024

        Other Metrics

        Citations

        View Options

        Get Access

        Login options

        View options

        PDF

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        HTML Format

        View this article in HTML Format.

        HTML Format

        Media

        Figures

        Other

        Tables

        Share

        Share

        Share this Publication link

        Share on social media