CN105718908A - Traffic police detection method and system based on clothes and cap characteristic and gesture detection - Google Patents

Abstract

The invention relates to a traffic police detection method and system based on clothes and cap characteristic and gesture detection. The method comprises the steps of off-line training for classifier construction and online real-time detection of traffic polices and postures of the traffic polices. According to the off-line step, a pedestrian classifier, a police hat classifier and a fluorescent clothe classifier are constructed by extracting pedestrian hog characteristics, police hat characteristics and fluorescent clothes hog characteristics from a large number of acquired sample images respectively. According to the online step, original images are acquired in real time, the pedestrian classifier, the police hat classifier, the fluorescent clothe classifier and various their combinations are applied to judge whether pedestrians simultaneously wearing police hats and fluorescent clothes exist or not in the original images, namely traffic polices. Then, the postures of the traffic polices are judged, and drivers are prompted of correctly understanding of the postures of the traffic polices. The method is broadly divided into two processes of precise matching and fuzzy matching for mutual corroboration, can accurately and quickly detect the traffic polices and the postures of the traffic polices and has an important guiding significance on active driving.

Description

A kind of traffic police's detection method based on clothing feature and attitude detection and system

Technical field

The invention belongs to actively driving field, specifically a kind of traffic police's detection method based on clothing feature and attitude detection and system.

Background technology

Automobile actively driving technology develops like a raging fire in recent years, and each automobile vendor and scientific & technical corporation release the active test drive concept car of oneself one after another.These experiment concept cars instruct it to carry out autonomous driving by technology such as pedestrian detection, vehicle detection, traffic light detection, GPS location and map lookup, path plannings, even unmanned.These laboratory vehicles under the road conditions situation that some are relatively common, can almost completely disengage from manual operation and carry out control and the driving of automobile.But under the traffic scene that some is special, traffic police command vehicle behavior.And traffic police is carried out positive counter-measure but without active by current vehicle of actively driving.

In consideration of it, the present invention proposes a kind of traffic police's detection method combined based on traffic police's clothing feature with attitude detection.By this technology, it is possible to make actively to be driven in when detecting pedestrian, further detection its whether be traffic police, if traffic police then alerts, remind actively to drive switching back into artificial driving model and traffic police's attitude is carried out deciphering etc..

Summary of the invention

For above shortcomings part in prior art, the technical problem to be solved in the present invention is to provide a kind of traffic police of detection and understands traffic police and command the method and system of action.

The present invention is the technical scheme is that a kind of traffic police's detection method based on clothing feature Yu attitude detection for achieving the above object, comprises the following steps:

Vehicle-mounted vision collecting module: by vehicle-mounted vision sensor Real-time Collection original image；

Pedestrian detection module: original image utilizes pedestrian's hog feature extraction algorithm obtain characteristic image_XR；Work as characteristic image_XRIn when having pedestrian, then at characteristic image_XRMiddle labelling pedestrian also transmits pedestrian's coordinate to trunk detection module；

Trunk detection module: to characteristic image_XRIn pedestrian area carry out module segmentation, obtain head zone coordinate and torso area coordinate, and send to clothing detection module and fluorescence waistcoat detection module；

By police's cap, clothing detection module: when detection has alert cap in head zone, then judge that mark sends to combining judge module；

Fluorescence waistcoat detection module: when detection has fluorescence waistcoat in torso area, then will determine that mark sends to combining judge module；

Associating judge module: police's cap is judged mark and judges that mark is weighted summation and obtains credibility, and by with threshold ratio relatively, the testing result obtaining traffic police sends to traffic police's attitude detection module；

Traffic police's attitude detection module: when pedestrian is traffic police, pass through characteristic image_XRIn pedestrian area carry out template matching with the traffic police's pose template preset and obtain traffic police's attitude mark, and send to information solution read through model；

Information solution read through model: by point duty information alert driver corresponding for traffic police's attitude mark.

Described original image is utilized pedestrian's hog feature extraction algorithm obtain characteristic image_XR；If characteristic image_XRIn have pedestrian, then at characteristic image_XRMiddle labelling pedestrian also transmits pedestrian's coordinate and comprises the following steps to trunk detection module:

1) original image is carried out hog feature extraction and obtain characteristic image_XR, particularly as follows:

Hog is characterized as high wide equal block of pixels, and in block of pixels, average mark is slit into four unit pixel block, and the step-length of hog feature is the height of block of pixels；

Each passage of the YUV of original image is carried out hog feature extraction, and the feature obtained by each passage is weighted according to weight and obtains characteristic image_XR；

2) by pedestrian's grader to characteristic image_XRDetect:

$f_k\left(x\right)=\left\{\begin{array}{cc}1& \underset{t=1}{\overset{T}{\Σ}}{\mathrm{\α}}_t{h}_t\left(x\right)>={\mathrm{\β}}_k\\ 0& else\end{array}\right.$

Wherein, x represents the test sample of input, representative feature image_XRIn a hog feature, h_tX () represents the t Weak Classifier, α_tFor weight, f_kX () represents a strong classifier of pedestrian's grader, β_kFor threshold value, T is Weak Classifier number；Pedestrian's grader is the set { f of some strong classifiers_k(x) }, k=1......N；N is strong classifier number；

3) if { f_k(x) } be 1, then this test sample is pedestrian, at characteristic image_XRMiddle labelling pedestrian also transmits pedestrian's coordinate to trunk detection module；Otherwise this test sample is not pedestrian.

Described to characteristic image_XRIn pedestrian area carry out module segmentation, obtain head zone coordinate and torso area coordinate, and send to clothing detection module and fluorescence waistcoat detection module and comprise the following steps:

By characteristic image_XRIn pedestrian area carry out template matching respectively through default head template and trunk template, namely the part matched is head zone and the torso area of pedestrian, and head zone is sent to clothing detection module and fluorescence waistcoat detection module with torso area coordinate.

Described pedestrian detection module also transmits pedestrian's coordinate to assisting detection module, comprises the following steps:

Pedestrian's attitude detection module: by characteristic image_XRIn pedestrian area by preset traffic police's pose template carry out template matching；When attitude similarity is more than threshold value, it is believed that the match is successful, and pedestrian area coordinate is reached clothing feature Fuzzy detection module；

Clothing feature Fuzzy detection module: pedestrian area coordinate is carried out fuzzy matching, obtains traffic police's testing result, and sends to information solution read through model, be used for pointing out driver.

Described fuzzy matching comprises the following steps:

$dist(X,Y)=\underset{p\→\mathrm{\∞}}{\lim }{\left(\underset{i=1}{\overset{n}{\Σ}}\right|x_i-y_i{|}^p)}^{1/p}=max|x_i-y_i|$

Wherein, X represents test sample, i.e. hog feature in pedestrian's area coordinate, Y represents the hog feature of the clothing image of setting, and p represents the exponent number of similarity, and n represents the dimension of hog feature, dist (X, Y) represents the similarity between test sample and the clothing image hog feature of setting, xⁱ、yⁱRepresent the hog feature of the test hog feature of sample i-th dimension, standard clothing image i-th dimension respectively.

A kind of traffic police based on clothing feature Yu attitude detection detects system, including:

Vehicle-mounted vision collecting module: for by vehicle-mounted vision sensor Real-time Collection original image；

Pedestrian detection module: for original image utilizes pedestrian's hog feature extraction algorithm obtain characteristic image_XR；Work as characteristic image_XRIn when having pedestrian, then at characteristic image_XRMiddle labelling pedestrian also transmits pedestrian's coordinate to trunk detection module；

Trunk detection module: for characteristic image_XRIn pedestrian area carry out module segmentation, obtain head zone coordinate and torso area coordinate, and send to clothing detection module and fluorescence waistcoat detection module；

Clothing detection module: for when detection has alert cap in head zone, then police's cap being judged that mark sends to combining judge module；

Fluorescence waistcoat detection module: for when detection has fluorescence waistcoat in torso area, then will determine that mark sends to combining judge module；

Associating judge module: for police's cap judging mark and judging that mark is weighted summation and obtains credibility, and by with threshold ratio relatively, the testing result obtaining traffic police sends to traffic police's attitude detection module；

Traffic police's attitude detection module: for when pedestrian is traffic police, passing through characteristic image_XRIn pedestrian area carry out template matching with the traffic police's pose template preset and obtain traffic police's attitude mark, and send to information solution read through model；

Information solution read through model: for by point duty information alert driver corresponding for traffic police's attitude mark.

Described pedestrian detection module is used for:

1) original image is carried out hog feature extraction and obtain characteristic image_XR, particularly as follows:

Hog is characterized as high wide equal block of pixels, and in block of pixels, average mark is slit into four unit pixel block, and the step-length of hog feature is the height of block of pixels；

Each passage of the YUV of original image is carried out hog feature extraction, and the feature obtained by each passage is weighted according to weight and obtains characteristic image_XR；

2) by pedestrian's grader to characteristic image_XRDetect:

$f_k\left(x\right)=\left\{\begin{array}{cc}1& \underset{t=1}{\overset{T}{\Σ}}{\mathrm{\α}}_t{h}_t\left(x\right)>={\mathrm{\β}}_k\\ 0& else\end{array}\right.$

Wherein, x represents the test sample of input, representative feature image_XRIn a hog feature, h_tX () represents the t Weak Classifier, α_tFor weight, f_kX () represents a strong classifier of pedestrian's grader, β_kFor threshold value, T is Weak Classifier number；Pedestrian's grader is the set { f of some strong classifiers_k(x) }, k=1......N；N is strong classifier number；

3) if { f_k(x) } be 1, then this test sample is pedestrian, at characteristic image_XRMiddle labelling pedestrian also transmits pedestrian's coordinate to trunk detection module；Otherwise this test sample is not pedestrian.

Described trunk detection module: for by characteristic image_XRIn pedestrian area carry out template matching respectively through default head template and trunk template, namely the part matched is head zone and the torso area of pedestrian, and head zone is sent to clothing detection module and fluorescence waistcoat detection module with torso area coordinate.

Described pedestrian detection module also transmits pedestrian's coordinate to assisting detection module, and auxiliary detection module includes:

Pedestrian's attitude detection module: for by characteristic image_XRIn pedestrian area by preset traffic police's pose template carry out template matching；When attitude similarity is more than threshold value, it is believed that the match is successful, and pedestrian area coordinate is reached clothing feature Fuzzy detection module；

Clothing feature Fuzzy detection module: for pedestrian area coordinate is carried out fuzzy matching, obtains traffic police's testing result, and sends to information solution read through model, be used for pointing out driver.

Fuzzy matching in described clothing feature Fuzzy detection module:

$dist(X,Y)=\underset{p\→\mathrm{\∞}}{\lim }{\left(\underset{i=1}{\overset{n}{\Σ}}\right|x_i-y_i{|}^p)}^{1/p}=max|x_i-y_i|$

Wherein, X represents test sample, i.e. hog feature in pedestrian's area coordinate, Y represents the hog feature of the clothing image of setting, and p represents the exponent number of similarity, and n represents the dimension of hog feature, dist (X, Y) represents the similarity between test sample and the clothing image hog feature of setting.

The present invention has the following advantages and beneficial effect:

1. the traffic police within the scope of field of front vision under the help of vehicle-mounted vision sensor, can be detected and to driver with prompting by the present invention, reminds actively to drive switching back into artificial driving model and noticing that traffic police commands action.

2. the present invention combines the accuracy rate adding traffic police's detection and identification and utilizes parallel processing technique to improve detection efficiency according to multiple characteristicses such as the alert cap of traffic police, traffic police's fluorescence clothes.

3. the present invention is when detecting pedestrian, utilizes the hog feature of multichannel weighting to carry out feature extraction, improves the efficiency of hog feature extraction while having taken into account different channel information.

4. the present invention is after detecting pedestrian, on the one hand the attitude of pedestrian is detected and the pedestrian with traffic police's action is carried out fuzzy clothing characteristic matching, carry out accurate clothing detection between on the other hand and then carry out attitude matching, such two aspect parallel processings, corroborating each other, the accuracy not only increasing detection has also taken into account efficiency.

5. the present invention carries out clothing feature detection targetedly according to different body part regions, utilizes the paralleled detection means of different body region to improve the efficiency of characteristic binding detection.

Accompanying drawing explanation

Fig. 1 is the system construction drawing of the present invention；

Fig. 2 is that the traffic police in the inventive method detects identification process figure.

Detailed description of the invention

Below in conjunction with drawings and Examples, the present invention is described in further detail.

A kind of traffic police's detection method based on clothing feature Yu attitude detection, comprises the following steps:

S1: vehicle-mounted vision sensor Real-time Collection original image, performs step S2；

S2: original image utilizes the pedestrian's hog feature extraction algorithm improved obtain characteristic image_XR, utilize pedestrian's grader judging characteristic image_XRIn whether have pedestrian, if there being pedestrian, at characteristic image_XRMiddle labelling pedestrian, performs step S3, S4, S7 simultaneously, if not, carries out next frame detection；

S3: to characteristic image_XRIn the pedestrian area method that utilizes normalization template matching, first the hog characteristic pattern of pedestrian area is normalized to fixed dimension, then carrying out template matching with the hog characteristic pattern of this dimensional standard pedestrian head sample Yu trunk sample, namely the part matched is head zone and torso area；Head zone and torso area is obtained by above-mentioned module segmentation；

Utilize alert cap grader judges whether there is alert cap in upper 1/2 region of head zone, if having, at characteristic image_XRMiddle labelling pedestrian, alert cap, and the credibility according to alert cap carries out weight marking (accounting for the weight of 60% and 40% compared with alert cap weight respectively), namely warns the credibility * 60% of cap；If not alert cap, carry out next frame detection.

S4: to characteristic image_XRIn the pedestrian area method that utilizes normalization template matching, first the hog characteristic pattern of pedestrian area is normalized to fixed dimension, then carrying out template matching with the hog characteristic pattern of this dimensional standard pedestrian head sample Yu trunk sample, namely the part matched is head zone and torso area；Head zone and torso area is obtained by above-mentioned module segmentation；

Utilize fluorescence to take grader in torso area and determine whether that fluorescence takes, if having, at characteristic image_XRMiddle labelling pedestrian, fluorescence take, and the credibility according to fluorescence clothes carries out weight marking (accounting for the weight of 40% and 60% compared with alert cap weight respectively), i.e. the credibility * 40% of fluorescence clothes；If not having fluorescence to take, carry out next frame detection；

S5: judge in step S3, S4 at characteristic image_XRWhether above-mentioned two pedestrian's coordinate of upper labelling is identical, if identical, show to exist in original image same pedestrian and wears alert cap simultaneously, wears fluorescence clothes, is traffic police, and is prompted to driver and notes traffic police, continues executing with step S6；If difference, carry out next frame detection；

S6: to characteristic image_XRWith traffic police's pose method also with normalization template matching, first the hog characteristic pattern of traffic police's pose is normalized to fixed dimension, then template matching is carried out with this dimensional standard traffic police's pose hog characteristic pattern, when attitude similarity reaches more than 90% it is believed that coupling, if coupling, it is prompted to driver's corresponding traffic police pose solution read signal；Otherwise carry out next frame detection；

S7: to characteristic image_XRUtilize traffic police's pose template to mate with traffic police's pose, if coupling, then proceed clothing characteristic similarity and calculate, and judge whether the pedestrian in original image is traffic police according to the similarity threshold set, and be prompted to driver and note traffic police, continue executing with step S8；Otherwise carry out next frame detection；

S8: traffic police's pose corresponding with traffic police's pose of coupling in S7 is understood signal prompt to driver；

Described pedestrian's grader, alert cap grader, fluorescence take grader and are off-line training and obtain, specific as follows:

By video acquisition sensor acquisition pedestrian's sample image, utilize the pedestrian's hog feature extraction algorithm improved to be calculated pedestrian's sample image, obtain pedestrian's hog characteristic image；The hog characteristic image obtained carries out warning the adboost training study of cap, fluorescence clothes and pedestrian respectively, obtains the grader of alert cap, fluorescence clothes, pedestrian respectively；

$f_k\left(x\right)=\left\{\begin{array}{cc}1& \underset{t=1}{\overset{T}{\Σ}}{\mathrm{\α}}_t{h}_t\left(x\right)>={\mathrm{\β}}_k\\ 0& else\end{array}\right.$

Wherein, x represents the test sample of input, i.e. characteristic image_XRIn the hog feature of pedestrian area, (during alert cap grader, test sample is the hog feature in alert cap region；When fluorescence takes grader, test sample is the hog feature that fluorescence takes region), h_tX () represents the t Weak Classifier, α_tFor weight, f_kX () represents a strong classifier of pedestrian's (alert cap, fluorescence clothes) grader, T is Weak Classifier number；β_kThe threshold value met is needed, when overall weight sum is more than β after representing all Weak Classifier weighted sums_kTime, then it is assumed that meet this strong classifier.Pedestrian's grader is the set { f of some strong classifiers_k(x) }, k=1......N；N is strong classifier number；

Alert cap grader, that fluorescence takes grader is similar with above-mentioned pedestrian's grader, is respectively as follows:

{p_k(x) }, k=1......N (N is positive integer)

{q_k(x) }, k=1......N (N is positive integer)

Concrete modular structure information is as it is shown in figure 1, mainly include such as lower module:

Vehicle-mounted vision collecting module.By vehicle-mounted vision sensor Real-time Collection original image；

Pedestrian detection module.For original image utilizes pedestrian's hog feature extraction algorithm obtain characteristic image XR；If characteristic image_XRIn have pedestrian, then labelling pedestrian transmit pedestrian's coordinate to trunk detection module in characteristic image XR；

Trunk detection module.For the pedestrian area in characteristic image XR is carried out module segmentation, obtain head zone coordinate and torso area coordinate, and send to clothing detection module and fluorescence waistcoat detection module；

Clothing detection module.For having detected whether alert cap in head zone；If having, then police's cap is judged that mark sends to combining judge module；

Fluorescence waistcoat detection module.For having detected whether fluorescence waistcoat in torso area；If having, then will determine that mark sends to combining judge module；

Associating judge module.For police's cap being judged mark and judging that mark is weighted summation and obtains credibility, and by with threshold ratio relatively, obtaining the testing result of traffic police.

Traffic police's attitude detection module.For after detecting traffic police, it is judged that its attitude.By characteristic image_XRIn pedestrian area by preset traffic police's pose template carry out template matching；When attitude similarity is more than threshold value, it is believed that the match is successful, and traffic police's pose mark is sent to information solution read through model.

Pedestrian's attitude detection module.Identical with the method for traffic police's attitude detection module.For after detecting pedestrian, it is judged that whether its attitude is that traffic police commands attitude.

Clothing feature Fuzzy detection module.Pedestrian area coordinate being carried out fuzzy matching, obtains traffic police's testing result, namely traffic police's pose identifies and sends to information solution read through model, is used for pointing out driver.

Information solution read through model.For after judging traffic police and detecting its attitude information, the information that its attitude carries out point duty aspect is understood, and sends information to driver.Particularly as follows: judge traffic police's pose mark that traffic police's attitude detection module and clothing feature Fuzzy detection module send respectively, if unanimously, then remind driver；Otherwise, it is weighted judging by the credibility of two traffic police's pose marks, selects traffic police's pose with a high credibility to be designated result, by the point duty information alert driver corresponding to this result.

Wherein, vehicle-mounted vision collecting module, pedestrian detection module, trunk detection module, clothing detection module, associating judge module, traffic police's attitude detection module are served as theme detection, when this main line detects alone, the point duty information alert corresponding to traffic police's pose mark that traffic police's attitude detection module can directly be sent by information solution read through model is to driver.

Wherein, pedestrian's attitude detection module and clothing feature Fuzzy detection module are auxiliary detection, when this subordinate line detects alone, the point duty information alert corresponding to traffic police's pose mark that clothing feature Fuzzy detection module can directly be sent by information solution read through model is to driver.

Improve pedestrian's hog feature extraction algorithm particularly as follows:

Design hog characteristic block depth-width ratio is 1:1,16*16 block of pixels, and four unit pixel block being on average split to form in block are sized to 8*8；The step-length calculating sample hog feature is 8 pixels；

By in tri-passages of YUV, each passage is weighted, according to hog feature extraction algorithm, the hog feature that combined calculation is improved；Wherein Y passage, U passage, V passage account for 20%, 60%, 20% respectively.

For each passage is first obtained change and the differential of gradient direction:

$\▿I_x=I(x+1,y)-I(x,y),\▿I_y=I(x,y)-I(x,y+1);$

Wherein, I (x, y) pixel value of denotation coordination x, y.

Then in x direction and y direction, the above results it is integrated respectively and then constitutes integrogram:

For pixel I (p, the histogrammic integrogram of graded q).Wherein, p, q respectively pixel I (p, abscissa q) and vertical coordinate.

When then calculating the graded sum of inside of each image block (no matter whether overlapping) again, it is possible to directly use equation below table look to calculate:

RecSUM (r)=SUM (x-1, y-1)+SUM (x+w-1, y+h-1)-SUM (x-1, y+h-1)-SUM (x+w-1, y-1)

Here r represents image block, and h and w represents that the Gao Yukuan of image block, RecSUM (r) represent the graded sum in image block respectively.

Traffic police's pose is divided into 8 kinds according to traffic police's gesture motion, and corresponding traffic police's pose solution read signal is stop signal, craspedodrome signal, left turn signal, left-hand bend signal to be transferred, right turn signal, lane change jogging signal, slow down signal, prompting vehicle pulling over observing signal.

Clothing characteristic similarity calculate particularly as follows:

Here similarity measurement adopts Chebyshev's distance (ChebyshevDistance):X and Y represents the hog feature of test sample and standard clothing image respectively, p represents the exponent number of distance, n represents the dimension of feature, and dist (X, Y) represents the similarity degree of test sample and standard clothing image other various templates such as (or) traffic police's pose templates.X_i、y_iRepresent the hog feature of the test hog feature of sample i-th dimension, standard clothing image i-th dimension respectively.

As in figure 2 it is shown, a kind of traffic police's detection method based on clothing feature Yu attitude detection includes following:

The present invention is based on, on pedestrian detection technology basis, learning its feature by the alert cap of traffic police is carried out large sample modeling statistical with fluorescence clothes.Simultaneously, owing to traffic police often has special gesture when directing traffic, so the present invention is when pedestrian being detected, also its attitude is detected, in time its legs joined being detected and have following (stop signal, craspedodrome signal, left turn signal, left-hand bend signal to be transferred, right turn signal, lane change jogging signal, slow down signal, prompting vehicle pulling over observing signal) several gesture attitude, it is believed that it is likely to be traffic police.

Firstly, it is necessary to the pedestrian entered in sensor detection range is detected, the present invention use the hog feature of improvement pedestrian is carried out feature description and detects.The block that described HOG characteristic block module is depth-width ratio (H:W) is 1:1,16*16 pixel size, four unit pixel being on average split to form in block are sized to 8*8, and calculating step-length used during sample HOG feature is 8 pixels.Here by tri-passages of YUV, the hog feature that each path computation obtains is weighted associating, the hog feature being improved, here Y passage, U passage, V passage account for 20%, 60%, 20% respectively, so not only consider the difference of feature in each passage but also reduce the dimension of multichannel combined feature, and then improve the efficiency of hog features training and detection.

For each passage is first obtained change and the differential of gradient direction:

$\▿I_x=I(x+1,y)-I(x,y),\▿I_y=I(x,y)-I(x,y+1);$

Then in x direction and y direction, the above results it is integrated respectively and then constitutes integrogram:

For pixel I (p, the histogrammic integrogram of graded q).

When then calculating the graded sum of inside of each image block (no matter whether overlapping) again, it is possible to directly use equation below table look to calculate:

RecSUM (r)=SUM (x-1, y-1)+SUM (x+w-1, y+h-1)-SUM (x-1, y+h-1)-SUM (x+w-1, y-1)

Here r represents image block, and h and w represents that the Gao Yukuan of image block, RecSUM (r) represent the graded sum in image block respectively.Such table look at calculates and eliminates the substantial amounts of calculating time.

Then pedestrian detection determine be pedestrian after, respectively its clothing feature is identified, its posture feature is mated simultaneously.If clothing feature meets and posture feature also complies with, it is possible to think traffic police.When system identification goes out after traffic police occurs in front, it is necessary to point out to driver, notice that there is traffic police in front；Start detection traffic police's attitude simultaneously, and its attitude information is understood (representing stop signal, craspedodrome signal, left turn signal, left-hand bend signal to be transferred, right turn signal, lane change jogging signal, slow down signal, prompting vehicle pulling over observing signal respectively).

Owing to the medicated cap of traffic police is all white, and the medicated cap of people's police is black, so traffic police or people's police can be distinguished according to colouring information.

First, by the pedestrian's feature in server end off-line learning magnanimity pedestrian's sample, the clothing feature (attention includes the white alert cap of black surround, traffic police's fluorescence clothes etc.) of traffic police's sample in magnanimity pedestrian's sample.

Then the pedestrian's sample in pedestrian's detection of classifier vision sensor detection range of off-line learning is used by vehicle-mounted vision sensor.Without pedestrian being detected, then directly process ends；If be detected that pedestrian, need to judge the head zone of pedestrian and torso area, the method utilizing normalization template matching, first the hog characteristic pattern of pedestrian area is normalized to fixed dimension, then carrying out template matching with the hog characteristic pattern of this dimensional standard pedestrian head sample Yu trunk sample, namely the part matched is head zone and torso area.Thus the pedestrian detected can be carried out clothing feature detection.

To pedestrian's clothing feature detection, it is based on the head of the pedestrian separated in previous step, trunk and extremity image-region, and the alert cap of detection traffic police, fluorescence take information respectively concurrently in the image-region specified.

Here the alert cap of traffic police (white black surround) is mainly used to take as main distinguishing rule with fluorescence.Because that wears alert cap is also likely to be people's police's (people's police are black medicated caps), so adopting the alert cap of traffic police and fluorescence clothes to carry out the clothing detection of traffic police.Note, when the alert cap information of head detection, it is necessary to be divided into up and down in the region, top 1/2 of half in head zone and detect.If having, labelling pedestrian, alert cap in characteristic image XR, and the credibility according to alert cap carries out weight marking (accounting for the weight of 60% and 40% compared with alert cap weight respectively), namely warns the credibility * 60% of cap；If not alert cap, carry out next frame detection.

Module segmentation made above obtains head zone and torso area；Utilize fluorescence to take grader in torso area and determine whether that fluorescence takes, if having, labelling pedestrian, fluorescence clothes in characteristic image XR, and the credibility according to fluorescence clothes carries out weight marking (accounting for the weight of 40% and 60% compared with alert cap weight respectively), i.e. the credibility * 40% of fluorescence clothes；If not having fluorescence to take, carry out next frame detection.Wherein, credibility is set by great many of experiments statistical data.

In time detecting that the alert cap of the existing traffic police of pedestrian has again fluorescence to take, calculating overall credibility (credibility * b of the credibility * a+ fluorescence clothes of alert cap), a, b are weight, and a is 60%, and b is 40%；Credibility when overall > 80% time, it is possible to regarding as is traffic police.At this time, it may be necessary to send information to driver, driver is helped to take appropriate measures.The attitude action of traffic police being detected, can the attitude action that adopt when then seeing and indicate traffic with traffic police match simultaneously.If it does, its action message so will be understood, and point out driver；If do not mated, process ends.

After pedestrian being detected, an other thread starts the movement posture to pedestrian and carries out detecting and mating, and this handling process is parallel processing with clothing feature detection above.

Pedestrian's attitude detection module, method also with normalization template matching, first the hog characteristic pattern of traffic police's pose is normalized to fixed dimension, then template matching is carried out with this size mark standard traffic police's pose hog characteristic pattern, when attitude similarity reaches threshold value more than 90% it is believed that mate) mate, if coupling, it is prompted to driver's corresponding traffic police pose solution read signal；Otherwise carry out next frame detection；

Clothing feature Fuzzy detection module, if be detected that the standard attitude action that uses when directing traffic of attitude action and traffic police match, so again the clothing feature of this pedestrian and the clothing feature of traffic police are carried out fuzzy matching, if matching degree exceedes threshold value 80%, then it is assumed that the pedestrian using traffic police's action is exactly traffic police；Otherwise, it is not considered as traffic police.

Wherein fuzzy matching adopts Chebyshev's distance: $dist(X,Y)=\underset{p\→\mathrm{\∞}}{\lim }{\left(\underset{i=1}{\overset{n}{\Σ}}\right|x_i-y_i{|}^p)}^{1/p}=max|x_i-y_i|,$ X and Y represents the hog feature of test sample and standard clothing image respectively, and p represents the exponent number of distance, and n represents the dimension of feature, and dist (X, Y) represents the similarity degree of test sample and standard clothing image.X_i、y_iRepresent the hog feature of the test hog feature of sample i-th dimension, standard clothing image i-th dimension respectively.

Here with using traffic police's action gesture mark Main Basis as its differentiation, it is complementary with above utilizing clothing feature to carry out accurately detection.Because the movement posture directly utilizing pedestrian carries out detecting carries out clothing fuzzy matching again, to utilize clothing feature accurately to detect high than above-mentioned for its efficiency, but precision is lower.Therefore, two detection lines be about to the accuracy that the high efficiency of pedestrian's attitude detection accurately detects with clothing and combine.

After this thread judges that this pedestrian is traffic police, traffic police can be encountered to driver's prompting equally.Further, the mark commander's action identified before being carried out information deciphering, the traffic instructions information interpreted is sent to driver, points out it to perform corresponding traffic action.

Claims (10)

1. the traffic police's detection method based on clothing feature Yu attitude detection, it is characterised in that comprise the following steps:

Vehicle-mounted vision collecting module: by vehicle-mounted vision sensor Real-time Collection original image；

Pedestrian detection module: original image utilizes pedestrian's hog feature extraction algorithm obtain characteristic image_XR；Work as characteristic image_XRIn when having pedestrian, then at characteristic image_XRMiddle labelling pedestrian also transmits pedestrian's coordinate to trunk detection module；

Trunk detection module: to characteristic image_XRIn pedestrian area carry out module segmentation, obtain head zone coordinate and torso area coordinate, and send to clothing detection module and fluorescence waistcoat detection module；

By police's cap, clothing detection module: when detection has alert cap in head zone, then judge that mark sends to combining judge module；

Fluorescence waistcoat detection module: when detection has fluorescence waistcoat in torso area, then will determine that mark sends to combining judge module；

Associating judge module: police's cap is judged mark and judges that mark is weighted summation and obtains credibility, and by with threshold ratio relatively, the testing result obtaining traffic police sends to traffic police's attitude detection module；

Traffic police's attitude detection module: when pedestrian is traffic police, pass through characteristic image_XRIn pedestrian area carry out template matching with the traffic police's pose template preset and obtain traffic police's attitude mark, and send to information solution read through model；

Information solution read through model: by point duty information alert driver corresponding for traffic police's attitude mark.

2. a kind of traffic police's detection method based on clothing feature Yu attitude detection according to claim 1, it is characterised in that described original image is utilized pedestrian's hog feature extraction algorithm obtain characteristic image_XR；Work as characteristic image_XRIn when having pedestrian, then at characteristic image_XRMiddle labelling pedestrian also transmits pedestrian's coordinate and comprises the following steps to trunk detection module:

1) original image is carried out hog feature extraction and obtain characteristic image_XR, particularly as follows:

Hog is characterized as high wide equal block of pixels, and in block of pixels, average mark is slit into four unit pixel block, and the step-length of hog feature is the height of block of pixels；

Each passage of the YUV of original image is carried out hog feature extraction, and the feature obtained by each passage is weighted according to weight and obtains characteristic image_XR；

2) by pedestrian's grader to characteristic image_XRDetect:

$f_k\left(x\right)=\left\{\begin{array}{cc}1& \underset{t=1}{\overset{T}{\Σ}}{\mathrm{\α}}_t{h}_t\left(x\right)>={\mathrm{\β}}_k\\ 0& else\end{array}\right.$

Wherein, x represents the test sample of input, representative feature image_XRIn a hog feature, h_tX () represents the t Weak Classifier, α_tFor weight, f_kX () represents a strong classifier of pedestrian's grader, β_kFor threshold value, T is Weak Classifier number；Pedestrian's grader is the set { f of some strong classifiers_k(x) }, k=1......N；N is strong classifier number；

3) if { f_k(x) } be 1, then this test sample is pedestrian, at characteristic image_XRMiddle labelling pedestrian also transmits pedestrian's coordinate to trunk detection module；Otherwise this test sample is not pedestrian.

3. a kind of traffic police's detection method based on clothing feature Yu attitude detection according to claim 1, it is characterised in that described to characteristic image_XRIn pedestrian area carry out module segmentation, obtain head zone coordinate and torso area coordinate, and send to clothing detection module and fluorescence waistcoat detection module and comprise the following steps:

By characteristic image_XRIn pedestrian area carry out template matching respectively through default head template and trunk template, namely the part matched is head zone and the torso area of pedestrian, and head zone is sent to clothing detection module and fluorescence waistcoat detection module with torso area coordinate.

4. a kind of traffic police's detection method based on clothing feature Yu attitude detection according to claim 1, it is characterised in that described pedestrian detection module also transmits pedestrian's coordinate to assisting detection module, comprises the following steps:

Pedestrian's attitude detection module: by characteristic image_XRIn pedestrian area by preset traffic police's pose template carry out template matching；When attitude similarity is more than threshold value, it is believed that the match is successful, and pedestrian area coordinate is reached clothing feature Fuzzy detection module；

Clothing feature Fuzzy detection module: pedestrian area coordinate is carried out fuzzy matching, obtains traffic police's testing result, and sends to information solution read through model, be used for pointing out driver.

5. a kind of traffic police's detection method based on clothing feature Yu attitude detection according to claim 1, it is characterised in that described fuzzy matching comprises the following steps:

$dist(X,Y)=\underset{p\→\mathrm{\∞}}{\lim }{\left(\underset{i=1}{\overset{n}{\Σ}}\right|x_i-y_i{|}^p)}^{1/p}=max|x_i-y_i|$

Wherein, X represents test sample, i.e. hog feature in pedestrian's area coordinate, Y represents the hog feature of the clothing image of setting, and p represents the exponent number of similarity, and n represents the dimension of hog feature, dist (X, Y) represents the similarity between test sample and the clothing image hog feature of setting, x_i、y_iRepresent the hog feature of the test hog feature of sample i-th dimension, standard clothing image i-th dimension respectively.

6. one kind is detected system based on the traffic police of clothing feature Yu attitude detection, it is characterised in that including:

Vehicle-mounted vision collecting module: for by vehicle-mounted vision sensor Real-time Collection original image；

Pedestrian detection module: for original image utilizes pedestrian's hog feature extraction algorithm obtain characteristic image_XR；Work as characteristic image_XRIn when having pedestrian, then at characteristic image_XRMiddle labelling pedestrian also transmits pedestrian's coordinate to trunk detection module；

Trunk detection module: for characteristic image_XRIn pedestrian area carry out module segmentation, obtain head zone coordinate and torso area coordinate, and send to clothing detection module and fluorescence waistcoat detection module；

Clothing detection module: for when detection has alert cap in head zone, then police's cap being judged that mark sends to combining judge module；

Fluorescence waistcoat detection module: for when detection has fluorescence waistcoat in torso area, then will determine that mark sends to combining judge module；

Associating judge module: for police's cap judging mark and judging that mark is weighted summation and obtains credibility, and by with threshold ratio relatively, the testing result obtaining traffic police sends to traffic police's attitude detection module；

Traffic police's attitude detection module: for when pedestrian is traffic police, passing through characteristic image_XRIn pedestrian area carry out template matching with the traffic police's pose template preset and obtain traffic police's attitude mark, and send to information solution read through model；

Information solution read through model: for by point duty information alert driver corresponding for traffic police's attitude mark.

7. a kind of traffic police based on clothing feature Yu attitude detection according to claim 1 detects system, it is characterised in that described pedestrian detection module is used for:

1) original image is carried out hog feature extraction and obtain characteristic image_XR, particularly as follows:

Hog is characterized as high wide equal block of pixels, and in block of pixels, average mark is slit into four unit pixel block, and the step-length of hog feature is the height of block of pixels；

Each passage of the YUV of original image is carried out hog feature extraction, and the feature obtained by each passage is weighted according to weight and obtains characteristic image_XR；

2) by pedestrian's grader to characteristic image_XRDetect:

$f_k\left(x\right)=\left\{\begin{array}{cc}1& \underset{t=1}{\overset{T}{\Σ}}{\mathrm{\α}}_t{h}_t\left(x\right)>={\mathrm{\β}}_k\\ 0& else\end{array}\right.$

Wherein, x represents the test sample of input, representative feature image_XRIn a hog feature, h_tX () represents the t Weak Classifier, α_tFor weight, f_kX () represents a strong classifier of pedestrian's grader, β_kFor threshold value, T is Weak Classifier number；Pedestrian's grader is the set { f of some strong classifiers_k(x) }, k=1......N；N is strong classifier number；

3) if { f_k(x) } be 1, then this test sample is pedestrian, at characteristic image_XRMiddle labelling pedestrian also transmits pedestrian's coordinate to trunk detection module；Otherwise this test sample is not pedestrian.

8. a kind of traffic police based on clothing feature Yu attitude detection according to claim 1 detects system, it is characterised in that described trunk detection module:

For by characteristic image_XRIn pedestrian area carry out template matching respectively through default head template and trunk template, namely the part matched is head zone and the torso area of pedestrian, and head zone is sent to clothing detection module and fluorescence waistcoat detection module with torso area coordinate.

9. a kind of traffic police based on clothing feature Yu attitude detection according to claim 1 detects system, it is characterised in that described pedestrian detection module also transmits pedestrian's coordinate to assisting detection module, and auxiliary detection module includes:

Pedestrian's attitude detection module: for by characteristic image_XRIn pedestrian area by preset traffic police's pose template carry out template matching；When attitude similarity is more than threshold value, it is believed that the match is successful, and pedestrian area coordinate is reached clothing feature Fuzzy detection module；

Clothing feature Fuzzy detection module: for pedestrian area coordinate is carried out fuzzy matching, obtains traffic police's testing result, and sends to information solution read through model, be used for pointing out driver.

10. a kind of traffic police based on clothing feature Yu attitude detection according to claim 1 detects system, it is characterised in that the fuzzy matching in described clothing feature Fuzzy detection module:

$dist(X,Y)=\underset{p\→\mathrm{\∞}}{\lim }{\left(\underset{i=1}{\overset{n}{\Σ}}\right|x_i-y_i{|}^p)}^{1/p}=max|x_i-y_i|$

Wherein, X represents test sample, i.e. hog feature in pedestrian's area coordinate, Y represents the hog feature of the clothing image of setting, and p represents the exponent number of similarity, and n represents the dimension of hog feature, dist (X, Y) represents the similarity between test sample and the clothing image hog feature of setting.