Nothing Special   »   [go: up one dir, main page]

CN108537223B - A license plate detection method, system and device and storage medium - Google Patents

A license plate detection method, system and device and storage medium Download PDF

Info

Publication number
CN108537223B
CN108537223B CN201810338018.0A CN201810338018A CN108537223B CN 108537223 B CN108537223 B CN 108537223B CN 201810338018 A CN201810338018 A CN 201810338018A CN 108537223 B CN108537223 B CN 108537223B
Authority
CN
China
Prior art keywords
license plate
feature
character
test sample
target
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810338018.0A
Other languages
Chinese (zh)
Other versions
CN108537223A (en
Inventor
王涛
王静
程良伦
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong University of Technology
Original Assignee
Guangdong University of Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong University of Technology filed Critical Guangdong University of Technology
Priority to CN201810338018.0A priority Critical patent/CN108537223B/en
Publication of CN108537223A publication Critical patent/CN108537223A/en
Application granted granted Critical
Publication of CN108537223B publication Critical patent/CN108537223B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/60Type of objects
    • G06V20/62Text, e.g. of license plates, overlay texts or captions on TV images
    • G06V20/63Scene text, e.g. street names
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/24Classification techniques
    • G06F18/241Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
    • G06F18/2411Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches based on the proximity to a decision surface, e.g. support vector machines
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/44Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/50Extraction of image or video features by performing operations within image blocks; by using histograms, e.g. histogram of oriented gradients [HoG]; by summing image-intensity values; Projection analysis
    • G06V10/507Summing image-intensity values; Histogram projection analysis
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/56Extraction of image or video features relating to colour
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/60Type of objects
    • G06V20/62Text, e.g. of license plates, overlay texts or captions on TV images
    • G06V20/625License plates

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Data Mining & Analysis (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Evolutionary Biology (AREA)
  • Evolutionary Computation (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • General Engineering & Computer Science (AREA)
  • Artificial Intelligence (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Image Analysis (AREA)

Abstract

本发明公开了一种车牌检测方法、系统及设备和一种计算机可读存储介质,该方法包括:获取测试样本,并提取测试样本的边缘特征、HOG特征和HSV特征;根据所述边缘特征计算测试样本与训练集中每个字符的欧式距离,并将所有所述欧氏距离中的最小值对应的字符确定为目标字符;通过训练集获取车牌类型,利用多分类的逻辑回归算法和所述HOG特征确定目标车牌类型;通过训练集获取车牌颜色特征,根据所述车牌颜色特征构建SVM分类器,将所述HSV特征输入所述SVM分类器中得到目标车牌颜色特征;根据所述目标字符、所述目标车牌类型、所述目标车牌颜色特征确定测试样本的车牌检测结果。本发明提供的车牌检测方法,提高了车牌检测的精度。

Figure 201810338018

The invention discloses a license plate detection method, system and device, and a computer-readable storage medium. The method includes: acquiring a test sample, and extracting edge features, HOG features and HSV features of the test sample; calculating according to the edge features The Euclidean distance between the test sample and each character in the training set, and the character corresponding to the minimum value of all the Euclidean distances is determined as the target character; the license plate type is obtained through the training set, and the multi-class logistic regression algorithm and the HOG are used. The feature determines the target license plate type; obtains the license plate color feature through the training set, constructs an SVM classifier according to the license plate color feature, and inputs the HSV feature into the SVM classifier to obtain the target license plate color feature; The type of the target license plate and the color feature of the target license plate determine the license plate detection result of the test sample. The license plate detection method provided by the invention improves the accuracy of the license plate detection.

Figure 201810338018

Description

一种车牌检测方法、系统及设备和存储介质A license plate detection method, system and device and storage medium

技术领域technical field

本发明涉及图像处理技术领域,更具体地说,涉及一种车牌检测方法、系统及设备和一种计算机可读存储介质。The present invention relates to the technical field of image processing, and more particularly, to a license plate detection method, system and device, and a computer-readable storage medium.

背景技术Background technique

近年来,车牌识别设备已经被广泛应用于停车场、城市道路等区域进行车辆号牌的自动抓拍和识别。现有技术中的车牌检测方式主要针对单个特征进行检测,对于噪音太强、模糊、半遮挡以及相似车牌等复杂环境往往检测精度不高。In recent years, license plate recognition equipment has been widely used in parking lots, urban roads and other areas to automatically capture and recognize vehicle license plates. The license plate detection method in the prior art mainly detects a single feature, and the detection accuracy is often low in complex environments such as too strong noise, blur, half occlusion, and similar license plates.

因此,如何提高车牌检测精度是本领域技术人员需要解决的问题。Therefore, how to improve the license plate detection accuracy is a problem to be solved by those skilled in the art.

发明内容SUMMARY OF THE INVENTION

本发明的目的在于提供一种车牌检测方法、系统及设备和一种计算机可读存储介质,提高了车牌检测精度。The purpose of the present invention is to provide a license plate detection method, system and device and a computer-readable storage medium, which improve the license plate detection accuracy.

为实现上述目的,本发明提供了一种车牌检测方法,包括:To achieve the above purpose, the present invention provides a license plate detection method, comprising:

获取测试样本,并提取所述测试样本的边缘特征、HOG特征和HSV特征;Obtain a test sample, and extract the edge feature, HOG feature and HSV feature of the test sample;

根据所述边缘特征计算所述测试样本与训练集中每个字符的欧式距离,并将所有所述欧氏距离中的最小值对应的字符确定为目标字符;Calculate the Euclidean distance between the test sample and each character in the training set according to the edge feature, and determine the character corresponding to the minimum value of all the Euclidean distances as the target character;

通过所述训练集获取车牌类型,利用多分类的逻辑回归算法和所述HOG特征确定目标车牌类型;Obtain the license plate type through the training set, and use the multi-class logistic regression algorithm and the HOG feature to determine the target license plate type;

通过所述训练集获取车牌颜色特征,根据所述车牌颜色特征构建SVM分类器,将所述HSV特征输入所述SVM分类器中得到目标车牌颜色特征;Obtain the license plate color feature through the training set, construct an SVM classifier according to the license plate color feature, and input the HSV feature into the SVM classifier to obtain the target license plate color feature;

根据所述目标字符、所述目标车牌类型、所述目标车牌颜色特征确定所述测试样本的车牌检测结果。The license plate detection result of the test sample is determined according to the target character, the type of the target license plate, and the color feature of the target license plate.

其中,根据所述边缘特征计算所述测试样本与训练集中每个字符的欧式距离,并将所有所述欧氏距离中的最小值对应的字符确定为目标字符,包括:Wherein, calculate the Euclidean distance between the test sample and each character in the training set according to the edge feature, and determine the character corresponding to the minimum value of all the Euclidean distances as the target character, including:

根据所述边缘特征计算所述测试样本与训练集中每个字符的欧式距离,并将所有所述欧式距离进行归一化处理;Calculate the Euclidean distance between the test sample and each character in the training set according to the edge feature, and normalize all the Euclidean distances;

计算归一化处理后的欧式距离的第一基本概率分布,并将所有基本概率中的最大值对应的字符确定为所述目标字符。The first basic probability distribution of the Euclidean distance after normalization is calculated, and the character corresponding to the maximum value among all the basic probabilities is determined as the target character.

其中,利用多分类的逻辑回归算法和所述HOG特征确定目标车牌类型,包括:Wherein, the multi-class logistic regression algorithm and the HOG feature are used to determine the target license plate type, including:

根据所述HOG特征利用多分类的逻辑回归算法,计算车牌类型的第二基本分布概率,并将所有基本概率中的最大值对应的车牌类型确定为所述目标车牌类型。Using the multi-class logistic regression algorithm according to the HOG feature, the second basic distribution probability of the license plate type is calculated, and the license plate type corresponding to the maximum value among all the basic probabilities is determined as the target license plate type.

其中,将所述HSV特征输入所述SVM分类器中得到目标车牌颜色类型,包括:Wherein, the HSV feature is input into the SVM classifier to obtain the target license plate color type, including:

根据所述HSV特征利用所述SVM分类器,计算所述车牌颜色类型的第三基本概率分布,并将所有基本概率中的最大值对应的车牌颜色类型确定为所述目标车牌颜色类型。Using the SVM classifier according to the HSV feature, the third basic probability distribution of the license plate color type is calculated, and the license plate color type corresponding to the maximum value among all the basic probabilities is determined as the target license plate color type.

其中,还包括:Among them, it also includes:

根据所述第一基本概率分布、所述第二基本概率分布和所述第三基本概率分布按预设的融合规则计算所述车牌检测结果的信任度。The trust degree of the license plate detection result is calculated according to the first basic probability distribution, the second basic probability distribution and the third basic probability distribution according to a preset fusion rule.

其中,所述第一基本概率m1(Ai)分布为:Wherein, the distribution of the first basic probability m 1 (A i ) is:

Figure BDA0001629787690000021
Figure BDA0001629787690000021

其中,ni为所述训练集中的第i个字符,di为所述测试样本与所述第i个字符的欧式距离;α为1或2;Wherein, n i is the ith character in the training set, d i is the Euclidean distance between the test sample and the ith character; α is 1 or 2;

所述第二基本概率分布m2(Bi)为:The second basic probability distribution m 2 (B i ) is:

Figure BDA0001629787690000022
Figure BDA0001629787690000022

其中,K为车牌类型总数,k∈(0,K],W为权重组成的矩阵,WT为W的转置,b为所述多分类的逻辑回归算法的偏值,xi为第i个测试样本,yi为第i个测试样本的车牌类型;Among them, K is the total number of license plate types, k∈(0,K], W is the matrix composed of weights, W T is the transpose of W, b is the bias value of the multi-class logistic regression algorithm, and x i is the i-th test samples, y i is the license plate type of the ith test sample;

所述第三基本概率m3(Ci)分布为:The third basic probability m 3 (C i ) distribution is:

Figure BDA0001629787690000031
Figure BDA0001629787690000031

其中,ni为第i个车辆颜色特征,xi为第i个测试样本,yi为第i个车牌颜色特征。Among them, n i is the i-th vehicle color feature, xi is the i-th test sample, and y i is the i-th license plate color feature.

其中,所述融合规则为:Wherein, the fusion rule is:

Figure BDA0001629787690000032
Figure BDA0001629787690000032

其中,

Figure BDA0001629787690000033
φ为辨识框架,s为所述辨识框架中所有支持车牌识别的证据集合。in,
Figure BDA0001629787690000033
φ is the identification frame, and s is the set of all evidence supporting license plate recognition in the identification frame.

为实现上述目的,本发明提供了一种车牌检测系统,包括:To achieve the above purpose, the present invention provides a license plate detection system, comprising:

提取模块,用于获取测试样本,并提取所述测试样本的边缘特征、HOG特征和HSV特征;an extraction module for acquiring a test sample and extracting edge features, HOG features and HSV features of the test sample;

第一确定模块,用于根据所述边缘特征计算所述测试样本与训练集中每个字符的欧式距离,并将所有所述欧氏距离中的最小值对应的字符确定为目标字符;The first determination module is used to calculate the Euclidean distance between the test sample and each character in the training set according to the edge feature, and determine the character corresponding to the minimum value of all the Euclidean distances as the target character;

第二确定模块,用于通过所述训练集获取车牌类型,利用多分类的逻辑回归算法和所述HOG特征确定目标车牌类型;The second determination module is used to obtain the license plate type through the training set, and use the multi-class logistic regression algorithm and the HOG feature to determine the target license plate type;

第三确定模块,用于通过所述训练集获取车牌颜色特征,根据所述车牌颜色特征构建SVM分类器,将所述HSV特征输入所述SVM分类器中得到目标车牌颜色特征;The third determination module is used to obtain the license plate color feature through the training set, construct an SVM classifier according to the license plate color feature, and input the HSV feature into the SVM classifier to obtain the target license plate color feature;

检测模块,用于根据所述目标字符、所述目标车牌类型、所述目标车牌颜色特征确定所述测试样本的车牌检测结果。A detection module, configured to determine the license plate detection result of the test sample according to the target character, the type of the target license plate, and the color feature of the target license plate.

为实现上述目的,本发明提供了一种车牌检测设备,包括:To achieve the above purpose, the present invention provides a license plate detection device, comprising:

存储器,用于存储计算机程序;memory for storing computer programs;

处理器,用于执行所述计算机程序时实现如上述车牌检测方法的步骤。The processor is configured to implement the steps of the above-mentioned license plate detection method when executing the computer program.

为实现上述目的,本发明提供了一种计算机可读存储介质,,所述计算机可读存储介质上存储有计算机程序,所述计算机程序被处理器执行时实现如上述车牌检测方法的步骤。To achieve the above object, the present invention provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the steps of the above-mentioned license plate detection method are implemented.

通过以上方案可知,本发明提供的一种车牌检测方法包括:获取测试样本,并提取所述测试样本的边缘特征、HOG特征和HSV特征;根据所述边缘特征计算所述测试样本与训练集中每个字符的欧式距离,并将所有所述欧氏距离中的最小值对应的字符确定为目标字符;通过所述训练集获取车牌类型,利用多分类的逻辑回归算法和所述HOG特征确定目标车牌类型;通过所述训练集获取车牌颜色特征,根据所述车牌颜色特征构建SVM分类器,将所述HSV特征输入所述SVM分类器中得到目标车牌颜色特征;根据所述目标字符、所述目标车牌类型、所述目标车牌颜色特征确定所述测试样本的车牌检测结果。It can be seen from the above solutions that a license plate detection method provided by the present invention includes: acquiring a test sample, and extracting edge features, HOG features and HSV features of the test sample; The Euclidean distance of each character, and the character corresponding to the minimum value of all the Euclidean distances is determined as the target character; the license plate type is obtained through the training set, and the multi-class logistic regression algorithm and the HOG feature are used to determine the target license plate Type; obtain the license plate color feature through the training set, construct an SVM classifier according to the license plate color feature, and input the HSV feature into the SVM classifier to obtain the target license plate color feature; According to the target character, the target The license plate type and the color feature of the target license plate determine the license plate detection result of the test sample.

本发明提供的车牌检测方法,提取测试样本的边缘特征、HOG特征和HSV特征,对不同的特征针对性的采取不同的分类方式,以获得测试样本的目标字符、目标车牌类型、目标车牌颜色特征,并确定最终的检测结果。与现有技术中检测单个特征采取单一分类方式的方案相比,通过结合多个特征多种分类方法得到检测结果,多数据的集成提高了在多车道交通方式场景下的多视点和遮挡问题的车牌检测精度。本发明还公开了一种车牌检测系统及设备和一种计算机可读存储介质,同样能实现上述技术效果。The license plate detection method provided by the present invention extracts the edge feature, HOG feature and HSV feature of the test sample, and adopts different classification methods for different features, so as to obtain the target character, target license plate type and target license plate color feature of the test sample. , and determine the final test result. Compared with the prior art scheme that detects a single feature and adopts a single classification method, the detection result is obtained by combining multiple features and multiple classification methods, and the integration of multiple data improves the multi-viewpoint and occlusion problems in multi-lane traffic scenarios. License plate detection accuracy. The invention also discloses a license plate detection system and device and a computer-readable storage medium, which can also achieve the above technical effects.

附图说明Description of drawings

为了更清楚地说明本发明实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to explain the embodiments of the present invention or the technical solutions in the prior art more clearly, the following briefly introduces the accompanying drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present invention. For those of ordinary skill in the art, other drawings can also be obtained according to these drawings without creative efforts.

图1为本发明实施例公开的一种车牌检测方法的流程图;1 is a flowchart of a method for detecting a license plate disclosed in an embodiment of the present invention;

图2为本发明实施例公开的另一种车牌检测方法的流程图;2 is a flowchart of another license plate detection method disclosed in an embodiment of the present invention;

图3为本发明实施例公开的一种车牌检测系统的结构图;3 is a structural diagram of a license plate detection system disclosed in an embodiment of the present invention;

图4为本发明实施例公开的一种车牌检测设备的结构图。FIG. 4 is a structural diagram of a license plate detection device disclosed in an embodiment of the present invention.

具体实施方式Detailed ways

下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

本发明实施例公开了一种车牌检测方法,提高了车牌检测精度。The embodiment of the invention discloses a license plate detection method, which improves the license plate detection accuracy.

参见图1,本发明实施例公开的一种车牌检测方法的流程图,如图1所示,包括:Referring to FIG. 1, a flowchart of a license plate detection method disclosed in an embodiment of the present invention, as shown in FIG. 1, includes:

S101:获取测试样本,并提取所述测试样本的边缘特征、HOG特征和HSV特征;S101: Obtain a test sample, and extract edge features, HOG features, and HSV features of the test sample;

在具体实施中,训练样本实则为车辆图像,此处获取测试样本,可以是由普通摄像头采集的,也可以是高清、超高清等其他摄像头采集,当然还可以是其他能够进行图像采集的设备进行采集所获得的图像,在此不作具体限定。获取车辆图像后,需要对该图像进行预处理操作,以便提取边缘特征、HOG(中文全称:方向梯度直方图,英文全称:Histogram oforiented gradients)特征和HSV(英文全称:Hue,Saturation,Value,是根据颜色的直观特性由A.R.Smith在1978年创建的一种颜色空间,也称六角锥体模型)特征,此处的预处理操作包含图像处理领域的常规技术手段。In the specific implementation, the training samples are actually vehicle images. The test samples obtained here can be collected by ordinary cameras, or by other cameras such as high-definition and ultra-high-definition cameras. Of course, they can also be collected by other devices capable of image collection. The acquired images are not specifically limited here. After obtaining the vehicle image, the image needs to be preprocessed to extract edge features, HOG (full name in Chinese: Histogram of oriented gradients, full name in English: Histogram of oriented gradients) features and HSV (full name in English: Hue, Saturation, Value, yes According to the intuitive characteristics of color, a color space created by A.R. Smith in 1978, also known as the hexagonal pyramid model) features, the preprocessing operations here include conventional technical means in the field of image processing.

S102:根据所述边缘特征计算所述测试样本与训练集中每个字符的欧式距离,并将所有所述欧氏距离中的最小值对应的字符确定为目标字符;S102: Calculate the Euclidean distance between the test sample and each character in the training set according to the edge feature, and determine the character corresponding to the minimum value of all the Euclidean distances as the target character;

可以理解的是,边缘特征即车辆图片中的车牌字符。测试集中包含多个车牌,每个车牌包含多个字符,例如,A、B、京、粤等。利用欧式距离表征车牌字符与测试集中每个字符的相似度,相似度最高的即欧式距离最小的对应的字符即为车牌字符的目标字符。It can be understood that the edge features are the license plate characters in the vehicle picture. The test set contains multiple license plates, and each license plate contains multiple characters, such as A, B, Jing, Yue, etc. The Euclidean distance is used to represent the similarity between the license plate character and each character in the test set. The character with the highest similarity, that is, the corresponding character with the smallest Euclidean distance, is the target character of the license plate character.

S103:通过所述训练集获取车牌类型,利用多分类的逻辑回归算法和所述HOG特征确定目标车牌类型;S103: Obtain the license plate type through the training set, and use the multi-class logistic regression algorithm and the HOG feature to determine the target license plate type;

在具体实施中,利用测试集中的车牌获取所有种类的车牌类型,例如,8位字符的新能源车牌、武警车牌、教练车牌、港澳车牌等。HOG特征刻画图像的局部梯度幅值和方向特征,HOG允许块之间相互重叠,因此对光照变化和小量的偏移并不敏感,能有效地刻画出边缘特征,对于角度大的车标检测效果好。通过HOG特征表征测试样本的车牌类型,利用多分类的逻辑回归算法判断测试样本的车牌属于哪一车牌类型,以此保证多分类逻辑回归具有最佳的性能,减少LR分类器训练时发生过拟合的情况。In a specific implementation, the license plates in the test set are used to obtain all types of license plates, such as 8-character new energy license plates, armed police license plates, coach license plates, Hong Kong and Macau license plates, etc. The HOG feature describes the local gradient magnitude and direction features of the image. HOG allows blocks to overlap each other, so it is not sensitive to illumination changes and small offsets, and can effectively describe edge features. Works well. The license plate type of the test sample is represented by the HOG feature, and the multi-class logistic regression algorithm is used to determine which license plate type the test sample belongs to, so as to ensure the best performance of the multi-class logistic regression and reduce the occurrence of overfitting during the training of the LR classifier. matching situation.

S104:通过所述训练集获取车牌颜色特征,根据所述车牌颜色特征构建SVM分类器,将所述HSV特征输入所述SVM分类器中得到目标车牌颜色特征;S104: Obtain the license plate color feature through the training set, construct an SVM classifier according to the license plate color feature, and input the HSV feature into the SVM classifier to obtain the target license plate color feature;

在具体实施中,利用测试集中的车牌获取所有种类的车牌颜色特征,例如,白色,蓝色,黄色等。通过HSV特征表征测试样本的颜色特征,利用SVM(英文全称:Support VectorMachine,中文全称:支持向量机,是一种快速的模式识别方法)分类器判断测试样本的车牌属于哪一底色。In a specific implementation, the license plates in the test set are used to obtain all kinds of license plate color features, such as white, blue, yellow, etc. The color features of the test samples are represented by HSV features, and the SVM (full name in English: Support VectorMachine, full name in Chinese: Support Vector Machine, is a fast pattern recognition method) classifier is used to determine which background color the license plate of the test sample belongs to.

需要说明的是,上述S102、S103、S104的执行过程并无先后顺序。It should be noted that, the above-mentioned execution processes of S102, S103, and S104 have no sequence.

S105:根据所述目标字符、所述目标车牌类型、所述目标车牌颜色特征确定所述测试样本的车牌检测结果。S105: Determine the license plate detection result of the test sample according to the target character, the type of the target license plate, and the color feature of the target license plate.

上述步骤得到的目标字符、目标车牌类型和目标车牌颜色特征共同组成了测试样本的车牌检测结果。The target character, target license plate type and target license plate color feature obtained in the above steps together constitute the license plate detection result of the test sample.

本发明实施例提供的车牌检测方法,提取测试样本的边缘特征、HOG特征和HSV特征,对不同的特征针对性的采取不同的分类方式,以获得测试样本的目标字符、目标车牌类型、目标车牌颜色特征,并确定最终的检测结果。与现有技术中检测单个特征采取单一分类方式的方案相比,通过结合多个特征多种分类方法得到检测结果,多数据的集成提高了在多车道交通方式场景下的多视点和遮挡问题的车牌检测精度。The license plate detection method provided by the embodiment of the present invention extracts the edge feature, HOG feature and HSV feature of the test sample, and adopts different classification methods for different features, so as to obtain the target character, target license plate type, target license plate of the test sample. color features and determine the final detection result. Compared with the prior art scheme that detects a single feature and adopts a single classification method, the detection result is obtained by combining multiple features and multiple classification methods, and the integration of multiple data improves the multi-viewpoint and occlusion problems in multi-lane traffic scenarios. License plate detection accuracy.

本发明实施例公开了一种车牌检测方法,相对于上一实施例,本实施例对技术方案作了进一步的说明和优化。具体的:The embodiment of the present invention discloses a license plate detection method. Compared with the previous embodiment, this embodiment further describes and optimizes the technical solution. specific:

参见图2,本发明实施例提供的另一种车牌检测方法的流程图,如图2所示,包括:Referring to FIG. 2 , a flowchart of another license plate detection method provided by an embodiment of the present invention, as shown in FIG. 2 , includes:

S201:获取测试样本,并提取所述测试样本的边缘特征、HOG特征和HSV特征;S201: Obtain a test sample, and extract edge features, HOG features, and HSV features of the test sample;

S221:根据所述边缘特征计算所述测试样本与训练集中每个字符的欧式距离,并将所有所述欧式距离进行归一化处理;S221: Calculate the Euclidean distance between the test sample and each character in the training set according to the edge feature, and normalize all the Euclidean distances;

S222:计算归一化处理后的欧式距离的第一基本概率分布,并将所有基本概率中的最大值对应的字符确定为目标字符;S222: Calculate the first basic probability distribution of the Euclidean distance after the normalization process, and determine the character corresponding to the maximum value among all the basic probabilities as the target character;

可以理解的是,由于欧式距离的真实值为[0,∞),因此需将欧式距离进行归一化处理,即

Figure BDA0001629787690000071
将其归一化范围为(0,1),其中,j∈[1,i]。It can be understood that since the true value of the Euclidean distance is [0, ∞), the Euclidean distance needs to be normalized, that is
Figure BDA0001629787690000071
Normalize it to the range (0,1), where j∈[1,i].

所述第一基本概率m1(Ai)分布为:The distribution of the first basic probability m 1 (A i ) is:

Figure BDA0001629787690000072
Figure BDA0001629787690000072

其中,ni为所述训练集中的第i个字符,di为所述测试样本与所述第i个字符的欧式距离;α为1或2;Wherein, n i is the ith character in the training set, d i is the Euclidean distance between the test sample and the ith character; α is 1 or 2;

也就是说,如果欧式距离为0,则相似度最大,这时候置信度为1,欧式距离不为0,则根据上述公式计算该字符对应的置信度。That is to say, if the Euclidean distance is 0, the similarity is the largest. At this time, the confidence is 1, and the Euclidean distance is not 0, then the confidence corresponding to the character is calculated according to the above formula.

S203:通过所述训练集获取车牌类型,根据所述HOG特征利用多分类的逻辑回归算法,计算车牌类型的第二基本分布概率,并将所有基本概率中的最大值对应的车牌类型确定为目标车牌类型;S203: Obtain the license plate type through the training set, use the multi-class logistic regression algorithm according to the HOG feature, calculate the second basic distribution probability of the license plate type, and determine the license plate type corresponding to the maximum value among all the basic probabilities as the target license plate type;

所述第二基本概率分布m2(Bi)为:The second basic probability distribution m 2 (B i ) is:

Figure BDA0001629787690000073
Figure BDA0001629787690000073

其中,K为车牌类型总数,k∈(0,K],W为权重组成的矩阵,WT为W的转置,b为所述多分类的逻辑回归算法的偏值,xi为第i个测试样本,yi为第i个测试样本的车牌类型;Among them, K is the total number of license plate types, k∈(0,K], W is the matrix composed of weights, W T is the transpose of W, b is the bias value of the multi-class logistic regression algorithm, and x i is the i-th test samples, y i is the license plate type of the ith test sample;

S204:通过所述训练集获取车牌颜色特征,根据所述HSV特征利用所述SVM分类器,计算所述车牌颜色特征的第三基本概率分布,并将所有基本概率中的最大值对应的车牌颜色特征确定为所述目标车牌颜色特征;S204: Obtain the license plate color feature through the training set, use the SVM classifier according to the HSV feature, calculate the third basic probability distribution of the license plate color feature, and assign the license plate color corresponding to the maximum value of all the basic probabilities The feature is determined as the color feature of the target license plate;

所述第三基本概率m3(Ci)分布为:The third basic probability m 3 (C i ) distribution is:

Figure BDA0001629787690000081
Figure BDA0001629787690000081

其中,ni为第i个车辆颜色特征,xi为第i个测试样本,yi为第i个车牌颜色特征。Among them, n i is the i-th vehicle color feature, xi is the i-th test sample, and y i is the i-th license plate color feature.

在具体实施中,SVM分类器以Sigmod函数作为连接函数,输出范围为0-1,通过该SVM分类器利用上述公式可计算出车牌颜色特征的概率分布。In a specific implementation, the SVM classifier uses the Sigmod function as the connection function, and the output range is 0-1. The SVM classifier can use the above formula to calculate the probability distribution of the license plate color feature.

S205:根据所述目标字符、所述目标车牌类型、所述目标车牌颜色特征确定所述测试样本的车牌检测结果;S205: Determine the license plate detection result of the test sample according to the target character, the target license plate type, and the color feature of the target license plate;

S206:根据所述第一基本概率分布、所述第二基本概率分布和所述第三基本概率分布按预设的融合规则计算所述车牌检测结果的信任度。S206: Calculate the degree of confidence of the license plate detection result according to the first basic probability distribution, the second basic probability distribution, and the third basic probability distribution according to a preset fusion rule.

在辨识框架θ上,有互为相互独立的三个证据Ai、Bi、Ci,其基本概率赋值函数分别为m1(Ai)、m2(Bi)、m3(Ci),本领域技术人员可以根据实际情况选择合适的融合规则进行融合,在此不作具体限定,优选为:On the identification frame θ, there are three mutually independent evidences A i , B i , C i , and their basic probability assignment functions are m 1 (A i ), m 2 (B i ), m 3 (C i respectively ), those skilled in the art can select suitable fusion rules to fuse according to the actual situation, which is not specifically limited here, preferably:

Figure BDA0001629787690000082
Figure BDA0001629787690000082

其中,

Figure BDA0001629787690000083
φ为辨识框架,s为所述辨识框架中所有支持车牌识别的证据集合。in,
Figure BDA0001629787690000083
φ is the identification frame, and s is the set of all evidence supporting license plate recognition in the identification frame.

下面对本发明实施例提供的一种车牌检测系统进行介绍,下文描述的一种车牌检测系统与上文描述的一种车牌检测方法可以相互参照。A license plate detection system provided by an embodiment of the present invention is introduced below. A license plate detection system described below and a license plate detection method described above can be referred to each other.

参见图3,本发明实施例提供的一种车牌检测系统的结构图,如图3所示,包括:Referring to FIG. 3, a structural diagram of a license plate detection system provided by an embodiment of the present invention, as shown in FIG. 3, includes:

提取模块301,用于获取测试样本,并提取所述测试样本的边缘特征、HOG特征和HSV特征;The extraction module 301 is used to obtain a test sample, and extract the edge feature, HOG feature and HSV feature of the test sample;

第一确定模块302,用于根据所述边缘特征计算所述测试样本与训练集中每个字符的欧式距离,并将所有所述欧氏距离中的最小值对应的字符确定为目标字符;The first determination module 302 is used to calculate the Euclidean distance between the test sample and each character in the training set according to the edge feature, and determine the character corresponding to the minimum value of all the Euclidean distances as the target character;

第二确定模块303,用于通过所述训练集获取车牌类型,利用多分类的逻辑回归算法和所述HOG特征确定目标车牌类型;The second determination module 303 is used to obtain the license plate type through the training set, and determine the target license plate type by using the multi-class logistic regression algorithm and the HOG feature;

第三确定模块304,用于通过所述训练集获取车牌颜色特征,根据所述车牌颜色特征构建SVM分类器,将所述HSV特征输入所述SVM分类器中得到目标车牌颜色特征;The third determination module 304 is used to obtain the license plate color feature through the training set, construct an SVM classifier according to the license plate color feature, and input the HSV feature into the SVM classifier to obtain the target license plate color feature;

检测模块305,用于根据所述目标字符、所述目标车牌类型、所述目标车牌颜色特征确定所述测试样本的车牌检测结果。The detection module 305 is configured to determine the license plate detection result of the test sample according to the target character, the type of the target license plate, and the color feature of the target license plate.

本发明实施例提供的车牌检测系统,提取测试样本的边缘特征、HOG特征和HSV特征,对不同的特征针对性的采取不同的分类方式,以获得测试样本的目标字符、目标车牌类型、目标车牌颜色特征,并确定最终的检测结果。与现有技术中检测单个特征采取单一分类方式的方案相比,通过结合多个特征多种分类方法得到检测结果,多数据的集成提高了在多车道交通方式场景下的多视点和遮挡问题的车牌检测精度。The license plate detection system provided by the embodiment of the present invention extracts edge features, HOG features and HSV features of the test sample, and adopts different classification methods for different features, so as to obtain the target character, target license plate type, target license plate of the test sample. color features and determine the final detection result. Compared with the prior art scheme that detects a single feature and adopts a single classification method, the detection result is obtained by combining multiple features and multiple classification methods, and the integration of multiple data improves the multi-viewpoint and occlusion problems in multi-lane traffic scenarios. License plate detection accuracy.

在上述实施例的基础上,作为优选实施方式,所述第一确定模块302包括:On the basis of the foregoing embodiment, as a preferred implementation manner, the first determining module 302 includes:

归一化单元,用于根据所述边缘特征计算所述测试样本与训练集中每个字符的欧式距离,并将所有所述欧式距离进行归一化处理;A normalization unit, used for calculating the Euclidean distance between the test sample and each character in the training set according to the edge feature, and normalizing all the Euclidean distances;

确定单元,用于计算归一化处理后的欧式距离的第一基本概率分布,并将所有基本概率中的最大值对应的字符确定为所述目标字符。The determining unit is configured to calculate the first basic probability distribution of the Euclidean distance after the normalization process, and determine the character corresponding to the maximum value among all the basic probabilities as the target character.

在上述实施例的基础上,作为优选实施方式,所述第二确定模块303具体为通过所述训练集获取车牌类型,根据所述HOG特征利用多分类的逻辑回归算法,计算车牌类型的第二基本分布概率,并将所有基本概率中的最大值对应的车牌类型确定为所述目标车牌类型的模块。On the basis of the above embodiment, as a preferred embodiment, the second determining module 303 specifically obtains the license plate type through the training set, and uses a multi-class logistic regression algorithm according to the HOG feature to calculate the second The basic distribution probability is determined, and the license plate type corresponding to the maximum value of all the basic probabilities is determined as the module of the target license plate type.

在上述实施例的基础上,作为优选实施方式,第三确定模块304包括:On the basis of the above embodiment, as a preferred implementation manner, the third determination module 304 includes:

构建单元,用于通过所述训练集获取车牌颜色特征,根据所述车牌颜色特征构建SVM分类器;A construction unit for obtaining license plate color features through the training set, and constructing an SVM classifier according to the license plate color features;

计算单元,用于根据所述HSV特征利用所述SVM分类器,计算所述车牌颜色特征的第三基本概率分布,并将所有基本概率中的最大值对应的车牌颜色特征确定为所述目标车牌颜色特征。A computing unit, configured to utilize the SVM classifier according to the HSV feature, calculate the third basic probability distribution of the license plate color feature, and determine the license plate color feature corresponding to the maximum value in all basic probabilities as the target license plate color characteristics.

在上述实施例的基础上,作为优选实施方式,还包括:On the basis of the above embodiment, as a preferred embodiment, it also includes:

计算模块,用于根据所述第一基本概率分布、所述第二基本概率分布和所述第三基本概率分布按预设的融合规则计算所述车牌检测结果的信任度。A calculation module, configured to calculate the trust degree of the license plate detection result according to the first basic probability distribution, the second basic probability distribution and the third basic probability distribution according to a preset fusion rule.

在上述实施例的基础上,作为优选实施方式,所述第一基本概率m1(Ai)分布为:On the basis of the above embodiment, as a preferred embodiment, the distribution of the first basic probability m 1 (A i ) is:

Figure BDA0001629787690000101
Figure BDA0001629787690000101

其中,ni为所述训练集中的第i个字符,di为所述测试样本与所述第i个字符的欧式距离;α为1或2;Wherein, n i is the ith character in the training set, d i is the Euclidean distance between the test sample and the ith character; α is 1 or 2;

所述第二基本概率分布m2(Bi)为:The second basic probability distribution m 2 (B i ) is:

Figure BDA0001629787690000102
Figure BDA0001629787690000102

其中,K为车牌类型总数,k∈(0,K],W为权重组成的矩阵,WT为W的转置,b为所述多分类的逻辑回归算法的偏值,xi为第i个测试样本,yi为第i个测试样本的车牌类型;Among them, K is the total number of license plate types, k∈(0,K], W is the matrix composed of weights, W T is the transpose of W, b is the bias value of the multi-class logistic regression algorithm, and x i is the i-th test samples, y i is the license plate type of the ith test sample;

所述第三基本概率m3(Ci)分布为:The third basic probability m 3 (C i ) distribution is:

Figure BDA0001629787690000103
Figure BDA0001629787690000103

其中,ni为第i个车辆颜色特征,xi为第i个测试样本,yi为第i个车牌颜色特征。Among them, n i is the i-th vehicle color feature, xi is the i-th test sample, and y i is the i-th license plate color feature.

在上述实施例的基础上,作为优选实施方式,所述融合规则为:On the basis of the above embodiment, as a preferred implementation, the fusion rule is:

Figure BDA0001629787690000104
Figure BDA0001629787690000104

其中,

Figure BDA0001629787690000105
φ为辨识框架,s为所述辨识框架中所有支持车牌识别的证据集合。in,
Figure BDA0001629787690000105
φ is the identification frame, and s is the set of all evidence supporting license plate recognition in the identification frame.

本申请还提供了一种车牌检测设备,参见图4,本发明实施例提供的一种车牌检测设备的结构图,如图4所示,包括:The application also provides a license plate detection device. Referring to FIG. 4 , a structural diagram of a license plate detection device provided by an embodiment of the present invention, as shown in FIG. 4 , includes:

存储器401,用于存储计算机程序;memory 401 for storing computer programs;

处理器402,用于执行所述计算机程序时可以实现上述实施例所提供的步骤。当然所述车牌检测设备还可以包括各种网络接口,电源等组件。The processor 402 can implement the steps provided in the above embodiments when executing the computer program. Of course, the license plate detection device may also include various network interfaces, power supplies and other components.

本发明实施例提供的车牌检测设备,提取测试样本的边缘特征、HOG特征和HSV特征,对不同的特征针对性的采取不同的分类方式,以获得测试样本的目标字符、目标车牌类型、目标车牌颜色特征,并确定最终的检测结果。与现有技术中检测单个特征采取单一分类方式的方案相比,提高了车牌检测的精度。由此可见,本发明实施例提供的车牌检测设备,通过结合多个特征多种分类方法得到检测结果,多数据的集成提高了在多车道交通方式场景下的多视点和遮挡问题的车牌检测精度。The license plate detection device provided by the embodiment of the present invention extracts edge features, HOG features and HSV features of the test sample, and adopts different classification methods for different features, so as to obtain the target character, target license plate type, target license plate of the test sample. color features and determine the final detection result. Compared with the solution in the prior art in which a single classification method is adopted to detect a single feature, the accuracy of license plate detection is improved. It can be seen that the license plate detection device provided by the embodiment of the present invention obtains the detection result by combining multiple features and multiple classification methods, and the integration of multiple data improves the license plate detection accuracy of the multi-viewpoint and occlusion problems in the multi-lane traffic mode scene .

本申请还提供了一种计算机可读存储介质,其上存储有计算机程序,所述计算机程序被处理器执行时可以实现上述实施例所提供的步骤。该存储介质可以包括:U盘、移动硬盘、只读存储器(Read-Only Memory,ROM)、随机存取存储器(Random Access Memory,RAM)、磁碟或者光盘等各种可以存储程序代码的介质。The present application also provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the steps provided in the above embodiments can be implemented. The storage medium may include: U disk, removable hard disk, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disk or optical disk and other media that can store program codes.

本说明书中各个实施例采用递进的方式描述,每个实施例重点说明的都是与其他实施例的不同之处,各个实施例之间相同相似部分互相参见即可。The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments, and the same and similar parts between the various embodiments can be referred to each other.

对所公开的实施例的上述说明,使本领域专业技术人员能够实现或使用本发明。对这些实施例的多种修改对本领域的专业技术人员来说将是显而易见的,本文中所定义的一般原理可以在不脱离本发明的精神或范围的情况下,在其它实施例中实现。因此,本发明将不会被限制于本文所示的这些实施例,而是要符合与本文所公开的原理和新颖特点相一致的最宽的范围。The above description of the disclosed embodiments enables any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

说明书中各个实施例采用递进的方式描述,每个实施例重点说明的都是与其他实施例的不同之处,各个实施例之间相同相似部分互相参见即可。对于实施例公开的系统而言,由于其与实施例公开的方法相对应,所以描述的比较简单,相关之处参见方法部分说明即可。应当指出,对于本技术领域的普通技术人员来说,在不脱离本申请原理的前提下,还可以对本申请进行若干改进和修饰,这些改进和修饰也落入本申请权利要求的保护范围内。The various embodiments in the specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments, and the same and similar parts between the various embodiments can be referred to each other. For the system disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant part can be referred to the description of the method. It should be pointed out that for those of ordinary skill in the art, without departing from the principles of the present application, several improvements and modifications can also be made to the present application, and these improvements and modifications also fall within the protection scope of the claims of the present application.

还需要说明的是,在本说明书中,诸如第一和第二等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来,而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。而且,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者设备所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括所述要素的过程、方法、物品或者设备中还存在另外的相同要素。It should also be noted that, in this specification, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply these entities or operations. There is no such actual relationship or sequence between operations. Moreover, the terms "comprising", "comprising" or any other variation thereof are intended to encompass non-exclusive inclusion such that a process, method, article or device comprising a list of elements includes not only those elements, but also includes not explicitly listed or other elements inherent to such a process, method, article or apparatus. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in a process, method, article or apparatus that includes the element.

Claims (9)

1.一种车牌检测方法,其特征在于,包括:1. a license plate detection method, is characterized in that, comprises: 获取测试样本,并提取所述测试样本的边缘特征、HOG特征和HSV特征;Obtain a test sample, and extract the edge feature, HOG feature and HSV feature of the test sample; 根据所述边缘特征计算所述测试样本与训练集中每个字符的欧氏距离,并将所有所述欧氏距离中的最小值对应的字符确定为目标字符;Calculate the Euclidean distance between the test sample and each character in the training set according to the edge feature, and determine the character corresponding to the minimum value of all the Euclidean distances as the target character; 通过所述训练集获取车牌类型,利用多分类的逻辑回归算法和所述HOG特征确定目标车牌类型;Obtain the license plate type through the training set, and use the multi-class logistic regression algorithm and the HOG feature to determine the target license plate type; 通过所述训练集获取车牌颜色特征,根据所述车牌颜色特征构建SVM分类器,将所述HSV特征输入所述SVM分类器中得到目标车牌颜色特征;Obtain the license plate color feature through the training set, construct an SVM classifier according to the license plate color feature, and input the HSV feature into the SVM classifier to obtain the target license plate color feature; 根据所述目标字符、所述目标车牌类型、所述目标车牌颜色特征确定所述测试样本的车牌检测结果;Determine the license plate detection result of the test sample according to the target character, the target license plate type, and the color feature of the target license plate; 其中,根据所述边缘特征计算所述测试样本与训练集中每个字符的欧式距离,并将所有所述欧氏距离中的最小值对应的字符确定为目标字符,包括:Wherein, calculate the Euclidean distance between the test sample and each character in the training set according to the edge feature, and determine the character corresponding to the minimum value of all the Euclidean distances as the target character, including: 根据所述边缘特征计算所述测试样本与训练集中每个字符的欧式距离,并将所有所述欧式距离进行归一化处理;Calculate the Euclidean distance between the test sample and each character in the training set according to the edge feature, and normalize all the Euclidean distances; 计算归一化处理后的欧式距离的第一基本概率分布,并将所有基本概率中的最大值对应的字符确定为所述目标字符;Calculate the first basic probability distribution of the Euclidean distance after the normalization process, and determine the character corresponding to the maximum value among all basic probabilities as the target character; 其中,所述第一基本概率m1(Ai)分布为:Wherein, the distribution of the first basic probability m 1 (A i ) is:
Figure FDA0003369466180000011
Figure FDA0003369466180000011
其中,ni为所述训练集中的第i个字符,p(i)为第i个字符的基本概率,di为所述测试样本与所述第i个字符的欧式距离;α为1或2。Wherein, n i is the ith character in the training set, p(i) is the basic probability of the ith character, d i is the Euclidean distance between the test sample and the ith character; α is 1 or 2.
2.根据权利要求1所述车牌检测方法,其特征在于,利用多分类的逻辑回归算法和所述HOG特征确定目标车牌类型,包括:2. license plate detection method according to claim 1, is characterized in that, utilizes the logistic regression algorithm of multi-classification and described HOG feature to determine target license plate type, comprising: 根据所述HOG特征利用多分类的逻辑回归算法,计算车牌类型的第二基本概率分布,并将所有基本概率中的最大值对应的车牌类型确定为所述目标车牌类型。According to the HOG feature, the multi-class logistic regression algorithm is used to calculate the second basic probability distribution of the license plate type, and the license plate type corresponding to the maximum value among all the basic probabilities is determined as the target license plate type. 3.根据权利要求2所述车牌检测方法,其特征在于,将所述HSV特征输入所述SVM分类器中得到目标车牌颜色特征,包括:3. according to the described license plate detection method of claim 2, it is characterised in that described HSV feature is inputted in the described SVM classifier to obtain target license plate color feature, comprising: 根据所述HSV特征利用所述SVM分类器,计算所述车牌颜色特征的第三基本概率分布,并将所有基本概率中的最大值对应的车牌颜色特征确定为所述目标车牌颜色特征。Using the SVM classifier according to the HSV feature, the third basic probability distribution of the license plate color feature is calculated, and the license plate color feature corresponding to the maximum value among all the basic probabilities is determined as the target license plate color feature. 4.根据权利要求3所述车牌检测方法,其特征在于,还包括:4. license plate detection method according to claim 3, is characterized in that, also comprises: 根据所述第一基本概率分布、所述第二基本概率分布和所述第三基本概率分布按预设的融合规则计算所述车牌检测结果的信任度。The trust degree of the license plate detection result is calculated according to the first basic probability distribution, the second basic probability distribution and the third basic probability distribution according to a preset fusion rule. 5.根据权利要求4所述车牌检测方法,其特征在于,所述第二基本概率分布m2(Bi)为:5. The license plate detection method according to claim 4, wherein the second basic probability distribution m 2 (B i ) is:
Figure FDA0003369466180000021
Figure FDA0003369466180000021
其中,K为车牌类型总数,k∈(0,K],Wk为第k个车牌类型对应的权重组成的矩阵,
Figure FDA0003369466180000025
为Wk的转置,bk为第k个车牌类型对应的所述多分类的逻辑回归算法的偏值,xi为第i个测试样本,yi为第i个测试样本的车牌类型;
Among them, K is the total number of license plate types, k∈(0,K], W k is the matrix composed of the weights corresponding to the k-th license plate type,
Figure FDA0003369466180000025
is the transpose of W k , b k is the bias value of the multi-class logistic regression algorithm corresponding to the k th license plate type, x i is the ith test sample, and y i is the license plate type of the ith test sample;
所述第三基本概率m3(Ci)分布为:The third basic probability m 3 (C i ) distribution is:
Figure FDA0003369466180000022
Figure FDA0003369466180000022
其中,ni为第i个车辆颜色特征,x为测试样本,y为车牌颜色特征,xi为第i个测试样本,yi为第i个车牌颜色特征。Among them, n i is the ith vehicle color feature, x is the test sample, y is the license plate color feature, xi is the ith test sample, and yi is the ith license plate color feature.
6.根据权利要求5所述车牌检测方法,其特征在于,所述融合规则为:6. license plate detection method according to claim 5, is characterized in that, described fusion rule is:
Figure FDA0003369466180000023
Figure FDA0003369466180000023
其中,
Figure FDA0003369466180000024
φ为辨识框架,s为所述辨识框架中所有支持车牌识别的证据集合。
in,
Figure FDA0003369466180000024
φ is the identification frame, and s is the set of all evidence supporting license plate recognition in the identification frame.
7.一种车牌检测系统,其特征在于,包括:7. A license plate detection system, comprising: 提取模块,用于获取测试样本,并提取所述测试样本的边缘特征、HOG特征和HSV特征;an extraction module for acquiring a test sample and extracting edge features, HOG features and HSV features of the test sample; 第一确定模块,用于根据所述边缘特征计算所述测试样本与训练集中每个字符的欧氏距离,并将所有所述欧氏距离中的最小值对应的字符确定为目标字符;The first determination module is used to calculate the Euclidean distance between the test sample and each character in the training set according to the edge feature, and determine the character corresponding to the minimum value of all the Euclidean distances as the target character; 第二确定模块,用于通过所述训练集获取车牌类型,利用多分类的逻辑回归算法和所述HOG特征确定目标车牌类型;The second determination module is used to obtain the license plate type through the training set, and use the multi-class logistic regression algorithm and the HOG feature to determine the target license plate type; 第三确定模块,用于通过所述训练集获取车牌颜色特征,根据所述车牌颜色特征构建SVM分类器,将所述HSV特征输入所述SVM分类器中得到目标车牌颜色特征;The third determination module is used to obtain the license plate color feature through the training set, construct an SVM classifier according to the license plate color feature, and input the HSV feature into the SVM classifier to obtain the target license plate color feature; 检测模块,用于根据所述目标字符、所述目标车牌类型、所述目标车牌颜色特征确定所述测试样本的车牌检测结果;a detection module, configured to determine the license plate detection result of the test sample according to the target character, the type of the target license plate, and the color feature of the target license plate; 其中,所述第一确定模块包括:Wherein, the first determining module includes: 归一化单元,用于根据所述边缘特征计算所述测试样本与训练集中每个字符的欧式距离,并将所有所述欧式距离进行归一化处理;A normalization unit, used for calculating the Euclidean distance between the test sample and each character in the training set according to the edge feature, and normalizing all the Euclidean distances; 确定单元,用于计算归一化处理后的欧式距离的第一基本概率分布,并将所有基本概率中的最大值对应的字符确定为所述目标字符;a determining unit, used for calculating the first basic probability distribution of the Euclidean distance after normalization, and determining the character corresponding to the maximum value in all basic probabilities as the target character; 其中,所述第一基本概率m1(Ai)分布为:Wherein, the distribution of the first basic probability m 1 (A i ) is:
Figure FDA0003369466180000031
Figure FDA0003369466180000031
其中,ni为所述训练集中的第i个字符,p(i)为第i个字符的基本概率,di为所述测试样本与所述第i个字符的欧式距离;α为1或2。Wherein, n i is the ith character in the training set, p(i) is the basic probability of the ith character, d i is the Euclidean distance between the test sample and the ith character; α is 1 or 2.
8.一种车牌检测设备,其特征在于,包括:8. A license plate detection device, comprising: 存储器,用于存储计算机程序;memory for storing computer programs; 处理器,用于执行所述计算机程序时实现如权利要求1至6任一项所述车牌检测方法的步骤。The processor is configured to implement the steps of the license plate detection method according to any one of claims 1 to 6 when executing the computer program. 9.一种计算机可读存储介质,其特征在于,所述计算机可读存储介质上存储有计算机程序,所述计算机程序被处理器执行时实现如权利要求1至6任一项所述车牌检测方法的步骤。9. A computer-readable storage medium, characterized in that, a computer program is stored on the computer-readable storage medium, and when the computer program is executed by the processor, the license plate detection as described in any one of claims 1 to 6 is realized steps of the method.
CN201810338018.0A 2018-04-16 2018-04-16 A license plate detection method, system and device and storage medium Active CN108537223B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810338018.0A CN108537223B (en) 2018-04-16 2018-04-16 A license plate detection method, system and device and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810338018.0A CN108537223B (en) 2018-04-16 2018-04-16 A license plate detection method, system and device and storage medium

Publications (2)

Publication Number Publication Date
CN108537223A CN108537223A (en) 2018-09-14
CN108537223B true CN108537223B (en) 2022-02-15

Family

ID=63481142

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810338018.0A Active CN108537223B (en) 2018-04-16 2018-04-16 A license plate detection method, system and device and storage medium

Country Status (1)

Country Link
CN (1) CN108537223B (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111046891A (en) * 2018-10-11 2020-04-21 杭州海康威视数字技术股份有限公司 Training method of license plate recognition model, and license plate recognition method and device
CN111199225B (en) * 2018-11-20 2023-10-31 浙江宇视科技有限公司 License plate calibration method and device
CN111145365A (en) * 2019-12-17 2020-05-12 北京明略软件系统有限公司 Method, device, computer storage medium and terminal for realizing classification processing
CN111563504B (en) * 2020-07-16 2020-10-30 平安国际智慧城市科技股份有限公司 License plate recognition method and related equipment

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104156704A (en) * 2014-08-04 2014-11-19 胡艳艳 Novel license plate identification method and system
CN105224956A (en) * 2015-10-16 2016-01-06 深圳市捷顺科技实业股份有限公司 A kind of car plate classification based on multi-feature fusion recognition methods and system
CN107590500A (en) * 2017-07-20 2018-01-16 济南中维世纪科技有限公司 A kind of color recognizing for vehicle id method and device based on color projection classification

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102903110B (en) * 2012-09-29 2015-11-25 宁波大学 To the dividing method of image with deep image information
CN104463134B (en) * 2014-12-19 2019-02-12 深圳市捷顺科技实业股份有限公司 A kind of detection method of license plate and system
US9536315B2 (en) * 2015-01-13 2017-01-03 Xerox Corporation Annotation free license plate recognition method and system
CN105260735A (en) * 2015-10-10 2016-01-20 安徽清新互联信息科技有限公司 License number character segmentation method based on typical position
CN106650731B (en) * 2016-12-23 2020-02-21 中山大学 A Robust License Plate and Vehicle Logo Recognition Method

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104156704A (en) * 2014-08-04 2014-11-19 胡艳艳 Novel license plate identification method and system
CN105224956A (en) * 2015-10-16 2016-01-06 深圳市捷顺科技实业股份有限公司 A kind of car plate classification based on multi-feature fusion recognition methods and system
CN107590500A (en) * 2017-07-20 2018-01-16 济南中维世纪科技有限公司 A kind of color recognizing for vehicle id method and device based on color projection classification

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
License Plate Characters Segmentation Using Projection and Template Matching;Deng Hongyao 等;《2009 International Conference on Information Technology and Computer Science》;20090726;第534-537页 *
基于HSV模型和改进AdaBoost算法的车牌检测;王毅 等;《电子科技》;20150228;第28卷(第2期);第107-111页 *

Also Published As

Publication number Publication date
CN108537223A (en) 2018-09-14

Similar Documents

Publication Publication Date Title
CN109740478B (en) Vehicle detection and recognition method, device, computer equipment and readable storage medium
CN109117879B (en) Image classification method, device and system
CN109271991B (en) License plate detection method based on deep learning
CN108537223B (en) A license plate detection method, system and device and storage medium
JP2016134175A (en) Method and system for performing text-to-image queries with wildcards
JP2014232533A (en) System and method for ocr output verification
Molina-Moreno et al. Efficient scale-adaptive license plate detection system
CN104766042A (en) Method and apparatus for and recognizing traffic sign board
CN106570475B (en) A kind of dark-red enameled pottery seal search method
CN111353491A (en) Character direction determining method, device, equipment and storage medium
CN110309810B (en) A Person Re-identification Method Based on Batch Center Similarity
CN103279738A (en) Automatic identification method and system for vehicle logo
He et al. Aggregating local context for accurate scene text detection
Bai et al. Classify vehicles in traffic scene images with deformable part-based models
CN112861871A (en) Infrared target detection method based on target boundary positioning
Le et al. Document retrieval based on logo spotting using key-point matching
Lin et al. Learning contour-fragment-based shape model with and-or tree representation
Nguyen et al. A real time license plate detection system based on boosting learning algorithm
Le et al. Improving logo spotting and matching for document categorization by a post-filter based on homography
CN109993178B (en) Feature data generation and feature matching method and device
CN109670480B (en) Image discrimination method, device, equipment and storage medium
Huu et al. Proposing WPOD-NET combining SVM system for detecting car number plate
CN112001280A (en) Real-time online optimization face recognition system and method
WO2023011606A1 (en) Training method of live body detection network, method and apparatus of live body detectoin
CN114092743B (en) Compliance detection method and device for sensitive picture, storage medium and equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant