CN106335432A - Smart rearview mirror with driving assistant system, control system and processing method - Google Patents
Smart rearview mirror with driving assistant system, control system and processing method Download PDFInfo
- Publication number
- CN106335432A CN106335432A CN201610752472.1A CN201610752472A CN106335432A CN 106335432 A CN106335432 A CN 106335432A CN 201610752472 A CN201610752472 A CN 201610752472A CN 106335432 A CN106335432 A CN 106335432A
- Authority
- CN
- China
- Prior art keywords
- information
- driver
- driving
- back vision
- mirror
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
- B60R1/02—Rear-view mirror arrangements
- B60R1/04—Rear-view mirror arrangements mounted inside vehicle
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
- B60R1/12—Mirror assemblies combined with other articles, e.g. clocks
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
- B60R1/12—Mirror assemblies combined with other articles, e.g. clocks
- B60R2001/1215—Mirror assemblies combined with other articles, e.g. clocks with information displays
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Mechanical Engineering (AREA)
- Traffic Control Systems (AREA)
- Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)
Abstract
The invention belongs to the technical field of Internet of Things. The invention provides a smart rearview mirror with a driving assistant system, a control system and a processing method. The smart rearview mirror can judge whether a driver is in fatigue driving or not according to a vehicle operation condition, a driving condition and a face expression, and gives a voice warning when the driver is in fatigue driving, so that the driving safety is improved, and the driver can use the smart rearview mirror conveniently. The control system can send a rescue message of the smart rearview mirror to a rescue server, so that a rescue department or related personnel can be conveniently dispatched for rescuing in real time.
Description
Technical field
The present invention relates to internet of things field is and in particular to having the intelligent back vision mirror of driving aid system, controlling system
System and processing method.
Background technology
With the popularization of the swift and violent growth of automobile quantity, mobile network, it is the various applications that driver drives provides convenient
It is widely spread, the security incident thus brought also grows with each passing day, simultaneously because the situation of traffic congestion, anger road disease is increasingly prominent
Go out, fatigue driving, irrational driving situation increase in a large number, when having data display driving, meet traffic using mobile phone and fatigue driving
It is unexpected that probability be 5 times of normal driving, and 2015 year traffic portion year statistics display that above-mentioned reason accounts for the big absolutely of vehicle accident
Ratio.
Driving fatigue, refers to that driver, after continuous for a long time driving, produces the imbalance of physiological function and psychological function, and
In the phenomenon that driving efficiency decline objectively occurs.Driver's poor sleeping quality or deficiency, long-duration driving vehicle, easily occur
Fatigue.Driving fatigue influences whether all sides such as attention, sensation, consciousness, thinking, judgement, will, decision and motion of driver
Face.Continue after fatigue to drive vehicle, sleepy drowsiness, myasthenia of limbs can be felt, absent minded, judgement declines, or even
Absentminded occurs or moment memory disappears, action occurs and delays or too early, it is dangerous that operation pauses or the correction time is improper etc.
, easily there is road traffic accident in factor.Add widely using with mobile phone, driver often uses in driving procedure
Mobile phone, for example: see wechat, play music, setting navigation etc., this is accomplished by driver's operating handset in person, and the regarding of driver
Line also can turn to and check mobile phone screen, so may result in driver attention and do not concentrate, be susceptible to traffic accident, and secondary car
Misfortune.
Therefore, needing badly provides a kind of intelligent back vision mirror with driving aid system, can be according to vehicle condition, vehicle row
Sail situation, car owner's situation judges driver's whether fatigue driving, improves traffic safety, its system can be remembered when accident occurs simultaneously
The traveling state of vehicle of record, vehicle location, accident video are automatic, very first time Chu Da relevant departments are it is ensured that timely rescue.
Content of the invention
For defect of the prior art, the present invention provides a kind of intelligent back vision mirror with driving aid system, control
System and processing method, can judge driver's whether fatigue driving according to vehicle condition, traveling state of vehicle, car owner's situation,
Improve traffic safety, low cost, facilitate driver to use.
In a first aspect, there is the intelligent back vision mirror of driving aid system, including body of backsight mirror, the front of body of backsight mirror
It is provided with LCDs.
Preferably, described body of backsight mirror includes information database, and the back side of body of backsight mirror is provided with front photographic head, front
Photographic head is used for shooting video or the image of vehicle front, and the video of shooting or image are stored in information database；Also
Including being arranged in driving cabin just to the fatigue driving module at driver's face location, fatigue driving module is included just to driving
The photographic head of member face；
Body of backsight mirror includes data read module and main processing block；Data read module is used for reading in-car
The data of obd system；Main processing block obtains the facial expression information of driver by the photographic head positioned at driver's direct bearing,
And analyze this facial expression information and obtain tired information, and carry out pre- with reference to adas algorithm, the data of obd system and tired information
Alert；Described intelligent back vision mirror is powered by the supply module of in-car obd system；
Also include arranging gravity sensor in the car, main processing block is additionally operable to obtain the weight that gravity sensor detects
Power acceleration, and judge whether the acceleration of gravity detecting exceedes default acceleration of gravity threshold value, if it does, the information of acquisition
Video in t ± a time in data base or image simultaneously upload, and t is current time, and a is default hit-treatment time threshold；
It is additionally provided with voice output module, collection mike in described body of backsight mirror and eliminate mike, two mikes
For being acquired to same voice signal simultaneously；Main processing block is additionally operable to the voice signal eliminating mike collection is entered
Row analysis is obtaining noise information, and generates the elimination sound wave contrary with this noise information, and this elimination sound wave is added to adopts
In the voice signal that collection mike collects, the voice signal that collection mike is collected enters Row noise and eliminates；
Described intelligent back vision mirror is additionally operable to loading application programs, is additionally provided with sound identification module, voice in body of backsight mirror
Identification module is used for receiving the speech audio order of driver, and controls application program execution corresponding according to speech audio order
Operation；
Also there is in body of backsight mirror voice help-asking function, main processing block is used for receiving voice help-asking voice command, and
Carry out early warning after receiving voice help-asking voice command；
Also include the rear photographic head being arranged on rear view of vehicle, rear photographic head is used for during normal driving shooting image after car, also
For shooting reverse image when moveing backward.
Second aspect, based on the control system of intelligent back vision mirror, including rescue service device, and above-mentioned intelligent back vision
Mirror；After rescue service device receives video or the image of the upload of intelligent back vision mirror, it is additionally operable to obtain the current location information of vehicle
And owner information, and it is sent to rescue department or related personnel to by video, image, location information and owner information.
Preferably, also include police server, in police server, be provided with monitoring objective storehouse, monitoring objective stock contains prison
The photographic intelligence of control target, including monitoring license plate number photographic intelligence and monitoring personnel mug shot information；Police server is used for
Obtain the video information that in intelligent back vision mirror, front photographic head shoots, and collection license plate number information and people's face from this video information
Portion's feature, and being contrasted with photographic intelligence in monitoring objective storehouse, when detecting the presence of and photographic intelligence phase in monitoring objective storehouse
When identical license plate number information or face features, send alarm signal to related personnel or the police.
The third aspect, the processing method according to the above-mentioned control system based on intelligent back vision mirror opens it is characterised in that working as
During dynamic fatigue driving detection, main processing block execution following steps:
A1) read the data of in-car obd system；
A2) obtain the facial expression information of driver, and analyze this facial expression image and obtain tired information；Wherein face to face
When one of situations below situation occurs in portion's expression information, judge driver tired driving, carry out early warning:
A21) driver head is in the state of bowing, and driver's head after the default tired time of bowing
Portion is still in the state of bowing；
A22) driver upper eyelid and palpebra inferior be smaller than default eyelid spacing；
A23) the closure frequency of driver's eyes is more than default closure frequency threshold；
A24) closing time of driver's eyes is more than default closing time threshold value；
A25) driver's eyes are in fatigue state；
A3) when one of situations below situation occurs in facial expression information, judge driver's dangerous driving, carry out
Early warning:
A31) driver eye-gaze's angle deviating dead ahead；
A32) same driver's driving time exceedes default driving time threshold value；
A33) stock rail is calculated by adas algorithm and skew occurs, and vehicle is obtained by obd system and do not open
Steering indicating light；
A34) relative velocity of obd system detectio to vehicle and front vehicles is more than default relative velocity threshold value, and car
With front vehicles be smaller than default safe spacing threshold value；
When starting collision rescue detection, main processing block execution following steps:
B1) real-time detection acceleration of gravity；When acceleration of gravity is detected and exceeding default acceleration of gravity threshold value, control
Voice output module prompts processed are the need of rescue；If in the default rescue response time, driver replys not needing to rescue
When, this flow process terminates；If in the default rescue response time, driver replys needing to rescue, or default rescue reaction
When not receiving driver's reply after time arrival, execution step b2；
B2) main processing block obtains the video in t ± a time in information database or image, location information and car owner's letter
Breath, and it is uploaded to rescue service device or mobile terminal.
Preferably, in described step a2, after main processing block obtains the image that photographic head shoots, by contour extraction method
Extract facial contour and eyelid profile, obtain facial contour information and eyelid profile information, then remove facial contour information and
Redundancy edge in eyelid profile information, carries out edge repair, obtains described fatigue information.
Preferably, in described step a21, when in tired information there is one of situations below situation in facial contour,
Judge that driver head is in the state of bowing；
A211) ratio of facial contour camber and width is less than 1；
A212) facial contour accounts for image area ratio and is less than 1/2.
Preferably, in described step a25, when in tired information there is one of situations below situation in eyelid profile,
Judge that driver's eyes are in fatigue state；
A311) ratio of eyelid profile camber and width is less than 1:2；
A311) the eyelid contour area of two eyes is different.
Preferably, when starting common rescue, main processing block obtains the detection data of obd system, when detection data goes out
When existing fault message or failure code, fault message or failure code are sent to car owner by main processing block, and carry to driver
For neighbouring automobile services Business Information and navigation way.
Preferably, described intelligent back vision mirror passes through network interface card and communication of mobile terminal, and network interface card is by the power supply mould of in-car obd system
Block is powered；When vehicle is in dead ship condition, network interface card is used for receiving the data from mobile terminal, when the mobile terminal receiving
Data be default wake-up data when, network interface card wake up main processing block, the main processing block after wake-up be additionally operable to receive shoot
Control command, and after receiving shooting control command, control front photographic head, rear photographic head and photographic head to start, and upload bat
The video taken the photograph or picture.
As shown from the above technical solution, what the present invention provided has intelligent back vision mirror, the control system of driving aid system
And processing method, this intelligent back vision mirror, whether driver can be judged according to vehicle condition, traveling state of vehicle, car owner's situation
Fatigue driving, and carry out phonetic warning when fatigue driving in driver, improve traffic safety, facilitate driver to use.Should
The rescue information of intelligent back vision mirror can be sent to rescue service device by control system, facilitate rescue department or related personnel to carry out
Scheduling, carries out rescue.The processing method of this control system, can judge driver's whether fatigue driving according to human face expression,
And carry out early warning when fatigue driving in driver, improve traffic safety, facilitate driver to use.
Brief description
In order to be illustrated more clearly that the specific embodiment of the invention or technical scheme of the prior art, below will be to concrete
In embodiment or description of the prior art, the accompanying drawing of required use is briefly described.In all of the figs, similar element
Or partly typically identified by similar reference.In accompanying drawing, each element or part might not be drawn according to actual ratio.
Fig. 1 shows the block diagram of the control system based on intelligent back vision mirror providing in the present embodiment.
Fig. 2 shows fatigue driving in the processing method of the control system based on intelligent back vision mirror providing in the present embodiment
The flow chart of detection.
Fig. 3 shows collision rescue in the processing method of the control system based on intelligent back vision mirror providing in the present embodiment
Flow chart.
Fig. 4 show in the present embodiment provide based in intelligent back vision mirror detection monitoring objective flow chart.
Fig. 5 shows voice help in the processing method of the control system based on intelligent back vision mirror providing in the present embodiment
Flow chart.
Fig. 6 shows the structural representation of the intelligent back vision mirror providing in the present embodiment.
In Fig. 6,1- casing of rearview mirror, 2- links up with, 3- rubber ring.
Specific embodiment
Below in conjunction with accompanying drawing, the embodiment of technical solution of the present invention is described in detail.Following examples are only used for
Clearly technical scheme is described, is therefore intended only as example, and the protection of the present invention can not be limited with this
Scope.
Due to when driving, driver can pass through the driving situation of backsight sem observation rear car, drives a vehicle including rear car fast
Spacing of degree and rear car etc..Therefore driver checks for convenience, ensures normal driving, the present invention will have being capable of root simultaneously
After being integrated according to the driving aid system that vehicle condition, traveling state of vehicle, car owner's situation judge driver's whether fatigue driving
On visor.
Embodiment:
There is the intelligent back vision mirror of driving aid system, including body of backsight mirror, the front of body of backsight mirror is provided with liquid crystal
Display screen.
Information database is also included in body of backsight mirror；The back side of described body of backsight mirror is provided with front photographic head, proactive picture
Head is for shooting video or the image of vehicle front, and the video of shooting or image are stored in information database；Also include
It is arranged in driving cabin just to the fatigue driving module at driver's face location, fatigue driving module is included just to driver's face
The photographic head in portion；
Body of backsight mirror includes data read module and main processing block；Data read module is used for reading in-car
The data of obd system；Main processing block obtains the facial expression information of driver by the photographic head positioned at driver's direct bearing,
And analyze this facial expression information and obtain tired information, and combine adas algorithm, the steering indicating light of obd system, mileage and tired
Labor information carries out early warning；Described intelligent back vision mirror is powered by the supply module of in-car obd system.
Obd system (vehicle diagnosing system is referred to as) has the 16pin standard data interface diagnosing seat luggage in unified car, tool
Standby unified various car type identical failure codes and function of supplying power, vehicle diagnosing system is connected with vehicle electrically controlling unit (ecu),
Ecu possesses monitoring and analyzes the fault function related to electronic device, and when the information of breaking down and correlative code, ecu passes through car
Diagnostic system standard data interface carries out data transmission.Data read module can be connected with the standard data interface of obd system,
Read the data of obd system.Adas algorithm is mainly used in identifying whether the Crane Rail of vehicle occurs offseting, first to proactive picture
Head is demarcated, and before control, photographic head shoots the image of vehicle front, carries out smoothing denoising to the image shooting, and to its edge
Detected, obtain vehicle and the distance between yellow line or white line in track, and be defined as straight Crane Rail threshold value.Proactive picture
The image of head captured in real-time vehicle front, when real-time vehicle to the distance between yellow line or white line and straight Crane Rail threshold value
Difference is more than during offset threshold it is believed that skew in stock rail.This rearview mirror does not need in addition to arrange sensor detection structure,
Reduce the development cost of intelligent back vision mirror.
Main processing block can be with the video of the facial expression of photographic head acquisition driver or image.When being embodied as, main place
Reason module, in order to improve the recognition effect of image, is provided with graphics processing unit, for removing the various noises of image, and according to taking the photograph
As the parameter in image after the position adjustments denoising of head, extract the area-of-interest of image, and carry out rim detection.So can
Strengthen the useful information of image, suppression interference.This intelligent back vision mirror, can be according to vehicle condition, traveling state of vehicle, Che Zhuzhuan
Condition judges driver's whether fatigue driving, and carries out early warning when fatigue driving in driver, improves traffic safety, conveniently drives
The person of sailing uses.
Intelligent back vision mirror in the present embodiment also provides collision rescue function.Also include arranging gravity sensor in the car
(g-sensor module), main processing block is additionally operable to obtain the acceleration of gravity that in-car gravity sensor detects, and judges to examine
Whether the acceleration of gravity surveyed exceedes default acceleration of gravity threshold value, if it does, obtaining t ± a time in information database
Interior video or image simultaneously upload, and t is current time, and a is default hit-treatment time threshold.
When a vehicle is in a collision, the acceleration of gravity that gravity sensor detects is larger.Acceleration of gravity threshold value is used for
Judge the threshold line whether vehicle collides as according to acceleration of gravity, when acceleration of gravity exceedes acceleration of gravity threshold
Value, it is believed that vehicle there occurs collision, now obtains the video that in a period of time before and after colliding, photographic head photographs or image information,
Subsequently impact severity or accident responsibility are judged for convenient.A is preferably 5 seconds -10 seconds, and a arranges too big, will result in
The data volume that intelligent back vision mirror uploads is larger, will extend the time of upload it is impossible to reach more preferable real-time.
It is additionally provided with voice output module, collection mike in described body of backsight mirror and eliminate mike, two mikes
For being acquired to same voice signal simultaneously；Main processing block is additionally operable to the voice signal eliminating mike collection is entered
Row analysis is obtaining noise information, and generates the elimination sound wave contrary with this noise information, and this elimination sound wave is added to adopts
In the voice signal that collection mike collects, the voice signal that collection mike is collected enters Row noise and eliminates.
Intelligent back vision mirror in the present embodiment, is removed in the voice signal of collection using diamylose reducing noise of voice control method
Noise.The eliminate sound wave contrary with this noise information is added in the voice signal collecting, is eliminated using principle of cancellation and make an uproar
Sound is so that vehicle can recognition of speech signals exactly in the big driving conditions of complicated or noise.When being embodied as, due to
The limited storage space of setting in intelligent back vision mirror, it is very limited to which results in the vocabulary quantity being stored in intelligent back vision mirror,
So for the precision improving speech recognition, intelligent back vision mirror can also be by the language of the transmitting voice signal of collection to Cloud Server
Sound storehouse (memory space of Cloud Server disclosure satisfy that the demand storing a large amount of vocabulary quantities) is compared in real time it is ensured that Voice command
Accuracy.
Described intelligent back vision mirror is additionally operable to loading application programs, is additionally provided with sound identification module, voice in body of backsight mirror
Identification module is used for receiving the speech audio order of driver, and controls application program execution corresponding according to speech audio order
Operation, controls each application program launching or closing.Wechat, player, navigation etc. for example can be loaded in intelligent back vision mirror
Application program, when driver wants to play music, driver sends voice commands such as " broadcasting music ", and intelligent back vision mirror just can
Start player plays music, and so on, intelligent back vision mirror can also identify other voice commands, and correspondingly controlled loading
Application program execution in intelligent back vision mirror is corresponding to be operated.Intelligent back vision mirror can in locally created sound bank, or
Obtain the sound bank of far-end by wireless network.So driver, can be by Voice command rearview mirror in driving procedure
Application program launching it is not necessary to driver's manual operation is it is ensured that traffic safety.
In body of backsight mirror, also there is voice help-asking function, as shown in figure 5, main processing block is used for receiving voice help-asking sound
Frequency is ordered, and carries out early warning after receiving voice help-asking voice command.Set up local voice storehouse in intelligent back vision mirror, be stored with
A plurality of voice help order, when main processing block receives voice help-asking voice command, is contrasted with local voice storehouse, when
When searching out identical voice help voice command in local voice storehouse, main processing block obtains and just driver face is taken the photograph
The image information shooting as head and front photographic head, the location information of vehicle location information and car owner, and be sent to designated mobile phone or
Server, execution is reported to the police and is operated.Because present net is about increasingly popularized with car, in order to ensure the safety of passenger, rider
Member can send voice help-asking order and reported to the police when perceiving danger, and the method does not need in-car setting to report to the police again
Button, and the passenger no matter being sitting on which position can send an SOS in time.；Also include being arranged on rear view of vehicle
Photographic head afterwards, rear photographic head is used for shooting image after car during normal driving, is additionally operable to during reversing shoot reverse image.
Based on the control system of intelligent back vision mirror, as shown in figure 1, including rescue service device, and above-mentioned intelligent back vision
Mirror；After rescue service device receives video or the image of the upload of intelligent back vision mirror, it is additionally operable to obtain the current location information of vehicle
And owner information, and it is sent to rescue department or related personnel to by video, image, location information and owner information.Rescue clothes
Business device receives video or the image of upload, and after location information and owner information, consistency operation personnel can sentence according to video situation
Disconnected accident conditions, and be synchronized to traffic control platform and carry out scheduling in breakdown state process according to location information, owner information, and to headend equipment
Carry out voice accident report, for reminding relevant departments to be rescued in time.This control system being capable of rescuing intelligent back vision mirror
The information of helping is sent to rescue service device, facilitates rescue department or related personnel to be scheduling, and carries out rescue.
When being embodied as, this system also increases remote-controller function, is provided with 433 wireless receiving moulds in intelligent back vision mirror
Block, this intelligent back vision mirror can also realize control function by receiving remote controller signal.Intelligent back vision mirror is additionally provided with peripheral expansion
Circuit, including the peripheral circuit of tf card, fatigue driving module and touch display screen.Intelligent back vision mirror is additionally provided with loudspeaker and work(
Electric discharge road, power amplifier can increase the power of play signal so that the audio frequency play becomes apparent from.It is additionally provided with fm transmitting mould
Block, wifi and bluetooth module, for communicating with external device.
The control system based on intelligent back vision mirror of the present embodiment also coordinates the police to scan for work to monitoring objective.Also
Including police server, in police server, it is provided with monitoring objective storehouse, monitoring objective stock contains the photographic intelligence of monitoring objective,
Including monitoring license plate number photographic intelligence and monitoring personnel mug shot information；Before police server is used for obtaining in intelligent back vision mirror
The video information that photographic head shoots, and gather license plate number information and people from this video information using the personal identification method of 1:n
Face facial characteristics, and contrasted with photographic intelligence in monitoring objective storehouse, believe with photo in monitoring objective storehouse when detecting the presence of
When the identical license plate number information of manner of breathing or face features, send alarm signal to related personnel or the police.In the present embodiment
Alignment system preferably with external gps positioner, this is due to when the photographic head in rearview mirror uses or application program makes
Used time, easily occur during built-in gps positioner positioning offseting.Its processing method is as shown in Figure 4.
The feature of 1:n identification is dynamic and non-cooperation.So-called dynamically namely identify is not photo, is not figure
Picture, but the dynamic video stream being gathered by photographic head.Non- cooperation refers to that identification object without the position perceiving photographic head and is joined
Conjunction completes to identify work, whole identification process is very convenient, and people will not be allowed to repel.Monitoring objective can be the car plate of hit-and-run
Number, license plate number violating the regulations, the convict that arrests etc..Police server is supported from the video that intelligent back vision mirror uploads, according to monitoring
Object library automatic data collection moves car plate, mobile personnel facial characteristics, and by way of Global treatment, using signal and noise
Statistical model, the mode of background subtraction method carry out eliminating picture noise.When detecting the presence of and photographic intelligence in monitoring objective storehouse
When the license plate number information matching or face features, send alarm signal to related personnel or the police, point out related personnel
Processed.Storehouse warehouse-in built by the photo that relevant departments can voluntarily upload monitoring objective, and achievable single photo models and multiple
The function of photo batch modeling.
The processing method of the control system based on intelligent back vision mirror, as shown in Fig. 2 when starting fatigue driving detection, main
Processing module execution following steps:
A1 steering indicating light, the milimeter number data of in-car obd system) are read；
A2) obtain the facial expression information of driver, and analyze this facial expression image and obtain tired information；Wherein face to face
When one of situations below situation occurs in portion's expression information, judge driver tired driving, carry out early warning:
A21) driver head is in the state of bowing, and after the default tired time of bowing driver head still in
Bow state；Now assert that driver is in the state of feeling sleepy of nodding, the tired time of bowing be difficult to set oversize, within preferably 3 seconds, low
The head tired time is oversize, will reduce the accuracy of detection of main process task.It is not easy to too short, not so when driver will being bowed action
It is mistaken for fatigue driving.
A22) driver upper eyelid and palpebra inferior be smaller than default eyelid spacing；By detecting upper eyelid and lower eye
The spacing of eyelid is judging whether driver's eyes are in fast closure state.
A23) the closure frequency of driver's eyes is more than default closure frequency threshold；Closure frequency higher it is believed that drive
Member's eyes are more tired.
A24) closing time of driver's eyes is more than default closing time threshold value；Closing time longer it is believed that drive
Member's eyes are more tired.
A25) driver's eyes are in fatigue state.
A3) when one of situations below situation occurs in facial expression information, judge driver's dangerous driving, carry out
Early warning:
A31) driver eye-gaze's angle deviating dead ahead；Regard as driver's energy not concentrate.
A32) same driver's driving time exceedes default driving time threshold value；General driving time threshold value preferably 4
Within hour.
A33) stock rail is calculated by adas algorithm and skew occurs, and vehicle is obtained by obd system and do not open
Steering indicating light；Now think vehicle execution cornering operation.
A34) relative velocity of obd system detectio to vehicle and front vehicles is more than default relative velocity threshold value, and car
With front vehicles be smaller than default safe spacing threshold value；
When being embodied as, the facial characteristics that can record in advance under driver's waking state build storehouse, so convenient can be by
The current facial characteristics of driver and the facial characteristics under driver's waking state in storehouse are contrasted.The method can be according to people
Face expression judges driver's whether fatigue driving, and carries out early warning when fatigue driving in driver, improves traffic safety,
Driver is facilitated to use.
The method to carry out the early warning of fatigue driving with reference to the wheelpath of the current facial characteristics of driver and vehicle,
Fatigue driving detection is more accurate.The use body optimizing adas by obd data with reference to fatigue driving algorithm of this method innovation
Test, effectively solve the accuracy of adas report.
The method, as shown in figure 3, when starting collision rescue detection, main processing block execution following steps:
B1) real-time detection acceleration of gravity；When acceleration of gravity is detected and exceeding default acceleration of gravity threshold value, control
Voice output module prompts processed are the need of rescue；As default rescue the response time in driver reply do not need rescue when,
This flow process terminates；As in the default rescue response time, driver's reply needs to rescue, or the default rescue response time
When not receiving driver's reply after arrival, execution step b2；
B2) main processing block obtains the video in t ± a time in information database or image, location information and car owner's letter
Breath, and it is uploaded to rescue service device or mobile terminal.Rescue service device or mobile terminal is facilitated to notify related personnel to carry out in time
Rescue.
The present embodiment is also directed to fatigue driving and proposes following detection method: in described step a2, main processing block obtains
After the image that direct bearing photographic head shoots, facial contour and eyelid profile are extracted by contour extraction method, obtains facial contour
Information and eyelid profile information, then remove the redundancy edge in facial contour information and eyelid profile information, carry out edge and repair
Mend, obtain described fatigue information.Contour extraction method can be to carry out edge extracting using edge detection operator, and edge is carried out
Repair the effect playing denoising filtration.
In described step a21, when in tired information, facial contour has one of situations below situation, judge to drive
Member's head is in the state of bowing；
A211) ratio of facial contour camber and width is less than 1；
A212) facial contour accounts for image area ratio and is less than 1/2.During due to bowing, the profile of the whole head of driver is more
Plus be partial to circle or the oblateness of horizontally set, so when being bowed according to above-mentioned two condition criterion, can judge exactly
Go out driver and be in the state of bowing, and be not in judge into the actions such as amesiality for driver, torticollis by accident situation about bowing,
It is more accurate to judge.
In described step a25, when in tired information, eyelid profile has one of situations below situation, judge to drive
Member's eyes are in fatigue state；
A311) ratio of eyelid profile camber and width is less than 1:2；Illustrate that driver's eyes are in the shape closed soon
State.
A311) the eyelid contour area of two eyes is different, illustrate driver's eyes small one and large one.
When starting common rescue, main processing block obtains the detection data of obd system, when detection data breaks down letter
When breath or failure code, fault message or failure code are sent to car owner by main processing block, and provide neighbouring to driver
Automobile services Business Information and navigation way are so that driver can arrive neighbouring automobile services Business Information in time is tieed up
Repair, or the automobile services businessman near contact is rescued.
When stopping, because vehicle diagnostic module possesses function of supplying power, in order to realize more preferable power saving effect, described intelligence
The main processing block of rearview mirror is usually in park mode so that main processing block is in low-power consumption standby shape when stopping
State.Now described intelligent back vision mirror passes through network interface card and communication of mobile terminal, and network interface card is powered by the supply module of in-car obd system；
When vehicle is in dead ship condition, network interface card is used for receiving the data from mobile terminal, when the data of the mobile terminal receiving
During for default wake-up data, network interface card wakes up main processing block, and the main processing block after wake-up is additionally operable to receive shoot and controls life
Order, and after receiving shooting control command, photographic head and the photographic head startup just to driver face before control, and upload bat
The video taken the photograph or picture.The main processing block waking up can control photographic head to be captured according to the transmission instruction of part, convenient
Human pilot understood vehicle location state in real time by image before driving.For example: when stopping, if running into vehicle
When being hit, main processing block can be waken up by network interface card, main processing block controls photographic head to start to shoot, and by regarding of photographing
Frequency or picture are uploaded to specified mobile terminal or server, are so obtained in that the image information at scene, facilitate car owner to safeguard certainly
Oneself interests.
Intelligent back vision mirror disclosed by the invention can be developed on Android system, including integrated diamylose voice de-noising, 4g
The whole network leads to, vehicle diagnosis and supply module, camera module, fatigue driving module, wireless remote control module, gps module, g-
Sensor module, bluetooth module, wifi module, tf card storage module, display panel module；This intelligent back vision mirror support td-lte,
Fdd-lte, td-scdma, wcdma, cdma, gsm in the super Multi net voting standard of interior 7 mould 18 frequency, breakthrough vehicle diagnostics skill
Art, diamylose language control technology, based on photographic head adas algorithm, the technology of identification based on photographic head, the whole network lead to 4g technology, cloud service
Device is incorporated into one, achievable vehicle trouble analysis, driving behavior record, vehicle driving safety early warning, car owner's fatigue driving report
Alert, driving recording, end equipment pushes voice forward for voice help-asking, voice broadcast, rear end, and Voice command, wireless remote control control leads
Boat, music, phone, capture pictures, video and transmitting-receiving wechat, qq and other application, and can be according to Guoan, public security, fortune pipe business
Need, support that background commands front end photographic head carries out specific car plate, face snap, uploads location information, video information, regards in real time
Frequently, achievable fixing camera and dollying head intersect networking, locate soon for social security and traffic scheduling, vehicle accident.
Intelligent back vision mirror in the present embodiment can adopt following structure design, as shown in fig. 6, including casing of rearview mirror 1,
The front of casing of rearview mirror 1 is provided with LCDs, and the back side of casing of rearview mirror 1 is provided with photographic head；Casing of rearview mirror 1 can lead to
Cross attachment structure to be detachably connected on room mirror, and the back side of casing of rearview mirror 1 is connected to the minute surface of room mirror
On, and whole minute surface covering room mirror.
When LCDs do not use, it is in blank screen pattern, general rear-vision mirror face can be served as and use.After this intelligence
When visor uses, by casing of rearview mirror in the way of its back side is connected on the minute surface of room mirror, cover room mirror
The mode of minute surface be arranged on room mirror, replace existing room mirror, intelligent back vision mirror is directly installed in existing car
It is not necessary to increase installation equipment in the car it is not necessary to change in-vehicle device structure, low cost in inside rear-view mirror.
Described casing of rearview mirror is connected to power supply on the supply module of in-car obd system by connecting line.Described liquid crystal
The rectangle structure of display screen generally horizontally set.Its shapes and sizes is similar with existing in-car display screen size, so not
Impact driver checks the driving situation of rear car by room mirror.
The Detachable connection structure such as VELCRO, Magnet can be adopted between intelligent back vision mirror and room mirror, but be
Raising bonding strength, the intelligent back vision mirror of the present embodiment adopts following attachment structure: described attachment structure includes at least one
The hook that group is arranged on casing of rearview mirror is right, and every group of hook is separately positioned on the extension of casing of rearview mirror top and bottom to inclusion
Hook 2, the spacing between two hooks 2 is more than the width of room mirror；Attachment structure also includes quantity with hook to group number phase
With rubber ring 3, each rubber ring 3 by way of being detachably set on every group of hook centering two hook with hook to even
Connect.During use, the casing of rearview mirror back side is attached on the minute surface of room mirror, and makes two hooks point in every group of hook
Not Wei Yu room mirror top and bottom, then by cushion rubber set from the back side of room mirror be set in every group hook two
Individual hook is upper so that intelligent back vision mirror is tied up in the car on rearview mirror.
The hook of every group of hook is separately positioned on casing of rearview mirror top and bottom, and the spacing of two hooks is more than in-car
The width of rearview mirror, when casing of rearview mirror is attached on room mirror such guarantee, two hooks are located at in-car backsight
The top and bottom of mirror, are then tied up casing of rearview mirror in the car on rearview mirror with cushion rubber set.
Two hooks 2 of described every group of hook centering are on same vertical direction.Described hook to for two groups, and along
The length direction of casing of rearview mirror is uniformly distributed.When this ensure that intelligent back vision mirror is installed, energy uniform stressed is it is not easy to fall
Fall.
Described every group hook centering each hook end be directed away from this hook to another hook direction curved
Curved one-tenth suspension part.So facilitate rubber ring from two hooks that the back side of room mirror is set in every group of hook, by intelligence
Can tie up in the car on rearview mirror rearview mirror.
Described rubber ring 3 is that generally side is annular, and rubber ring is provided with two respectively with rubber ring, at least one two ends
The strengthening segment that long side connects.Increased the intensity of rubber ring, rubber ring is not allowed yielding.
The back side of described casing of rearview mirror is provided with multiple air vents, and air vent is used for playing the effect of radiating.After described
The back side of mirror housings is provided with pad, and pad is used for being connected between the casing of rearview mirror back side and the minute surface of room mirror,
Prevent the casing of rearview mirror back side from contacting with the minute surface direct friction of room mirror.
Flow chart in accompanying drawing and block diagram show the system of multiple embodiments according to the present invention, method and computer journey
The architectural framework in the cards of sequence product, function and operation.At this point, each square frame in flow chart or block diagram can generation
A part for one module of table, program segment or code, a part for described module, program segment or code comprises one or more use
Executable instruction in the logic function realizing regulation.It should also be noted that at some as in the realization replaced, being marked in square frame
The function of note can also be to occur different from the order being marked in accompanying drawing.For example, two continuous square frames can essentially base
Originally it is performed in parallel, they can also execute sometimes in the opposite order, this is depending on involved function.It is also noted that
It is, the combination of each square frame in block diagram and/or flow chart and the square frame in block diagram and/or flow chart, can be with executing rule
The special hardware based system of fixed function or action, or can be with the group of specialized hardware and computer instruction realizing
Close and to realize.
It should be understood that disclosed system, apparatus and method in several embodiments provided herein, permissible
Realize by another way.Device embodiment described above is only schematically, for example, the division of described unit,
It is only a kind of division of logic function, actual can have other dividing mode when realizing, and for example, multiple units or assembly can
To combine or to be desirably integrated into another system, or some features can be ignored, or does not execute.Another, shown or beg for
By coupling each other or direct-coupling or communication connection can be by some communication interfaces, device or unit indirect
Coupling or communication connection, can be electrical, mechanical or other forms.
Finally it is noted that various embodiments above, only in order to technical scheme to be described, is not intended to limit；To the greatest extent
Pipe has been described in detail to the present invention with reference to foregoing embodiments, it will be understood by those within the art that: its according to
So the technical scheme described in foregoing embodiments can be modified, or wherein some or all of technical characteristic is entered
Row equivalent；And these modifications or replacement, do not make the essence of appropriate technical solution depart from various embodiments of the present invention technology
The scope of scheme, it all should be covered in the middle of the claim of the present invention and the scope of description.
Claims (10)
1. there is the intelligent back vision mirror of driving aid system it is characterised in that including body of backsight mirror, the front of body of backsight mirror
It is provided with LCDs.
2. according to claim 1 have driving aid system intelligent back vision mirror it is characterised in that described rearview mirror this
Body includes information database, and the back side of body of backsight mirror is provided with front photographic head, and front photographic head is used for shooting regarding of vehicle front
Frequency or image, and the video of shooting or image are stored in information database；Also include being arranged in driving cabin just to driving
Fatigue driving module at member's face location, fatigue driving module includes the photographic head just to driver face；
Body of backsight mirror includes data read module and main processing block；Data read module is used for reading in-car obd system
The data of system；Main processing block obtains the facial expression information of driver by the photographic head positioned at driver's direct bearing, and point
Analyse this facial expression information and obtain tired information, and carry out early warning with reference to adas algorithm, the data of obd system and tired information；
Described intelligent back vision mirror is powered by the supply module of in-car obd system；
Also include arranging gravity sensor in the car, main processing block is additionally operable to obtain the gravity that detects of gravity sensor and adds
Speed, and judge whether the acceleration of gravity detecting exceedes default acceleration of gravity threshold value, if it does, obtaining information data
Video in t ± a time in storehouse or image simultaneously upload, and t is current time, and a is default hit-treatment time threshold；
It is additionally provided with voice output module, collection mike in described body of backsight mirror and eliminates mike, two mikes are used for
Same voice signal is acquired simultaneously；Main processing block is additionally operable to the voice signal eliminating mike collection is carried out point
Analysis is obtaining noise information, and generates the elimination sound wave contrary with this noise information, and this elimination sound wave is added to collection wheat
In gram voice signal that wind collects, the voice signal that collection mike is collected enters Row noise and eliminates；
Described intelligent back vision mirror is additionally operable to loading application programs, is additionally provided with sound identification module, speech recognition in body of backsight mirror
Module is used for receiving the speech audio order of driver, and controls the corresponding behaviour of application program execution according to speech audio order
Make；
Also there is in body of backsight mirror voice help-asking function, main processing block is used for receiving voice help-asking voice command, and is connecing
Carry out early warning after receiving voice help-asking voice command；
Also include the rear photographic head being arranged on rear view of vehicle, rear photographic head is used for shooting image after car during normal driving, is additionally operable to
Reverse image is shot during reversing.
3. the control system based on intelligent back vision mirror is it is characterised in that include rescue service device, and described in claim 2
Intelligent back vision mirror；After rescue service device receives video or the image of the upload of intelligent back vision mirror, it is additionally operable to acquisition vehicle current
Location information and owner information, and it is sent to rescue department or relevant people to by video, image, location information and owner information
Member.
4. the control system based on intelligent back vision mirror according to claim 3 is it is characterised in that also include police service
Device, is provided with monitoring objective storehouse in police server, monitoring objective stock contains the photographic intelligence of monitoring objective, including monitoring car plate
Number photographic intelligence and monitoring personnel mug shot information；Police server is used for obtaining what front photographic head in intelligent back vision mirror shot
Video information, and collection license plate number information and face features from this video information, and believe with photo in monitoring objective storehouse
Breath is contrasted, when detecting the presence of the license plate number information matching with photographic intelligence in monitoring objective storehouse or face features
When, send alarm signal to related personnel or the police.
5. the processing method of the control system based on intelligent back vision mirror according to claim 3 starts it is characterised in that working as
During fatigue driving detection, main processing block execution following steps:
A1) read the data of in-car obd system；
A2) obtain the facial expression information of driver, and analyze this facial expression image and obtain tired information；Wherein when facial table
When one of situations below situation occurs in feelings information, judge driver tired driving, carry out early warning:
A21) driver head is in the state of bowing, and after the default tired time of bowing driver head still in bowing
State；
A22) driver upper eyelid and palpebra inferior be smaller than default eyelid spacing；
A23) the closure frequency of driver's eyes is more than default closure frequency threshold；
A24) closing time of driver's eyes is more than default closing time threshold value；
A25) driver's eyes are in fatigue state；
A3) when one of situations below situation occurs in facial expression information, judge driver's dangerous driving, carry out pre-
Alert:
A31) driver eye-gaze's angle deviating dead ahead；
A32) same driver's driving time exceedes default driving time threshold value；
A33) stock rail is calculated by adas algorithm and skew occurs, and vehicle is obtained by obd system and do not open steering
Lamp；
A34) relative velocity of obd system detectio to vehicle and front vehicles is more than default relative velocity threshold value, and vehicle with
Front vehicles be smaller than default safe spacing threshold value；
When starting collision rescue detection, main processing block execution following steps:
B1) real-time detection acceleration of gravity；When acceleration of gravity is detected and exceeding default acceleration of gravity threshold value, control language
Sound output module is pointed out the need of rescue；If driver replys and does not need rescue in the default rescue response time, should
Flow process terminates；If in the default rescue response time, driver replys need to rescue, or the default rescue response time
When not receiving driver's reply after arrival, execution step b2；
B2) main processing block obtains the video in t ± a time in information database or image, location information and owner information, and
It is uploaded to rescue service device or mobile terminal.
6. the processing method of the control system based on intelligent back vision mirror according to claim 5 is it is characterised in that described step
In rapid a2, after main processing block obtains the image just photographic head of driver face being shot, extracted by contour extraction method
Facial contour and eyelid profile, obtain facial contour information and eyelid profile information, then remove facial contour information and eyelid
Redundancy edge in profile information, carries out edge repair, obtains described fatigue information.
7. the processing method of the control system based on intelligent back vision mirror according to claim 6 is it is characterised in that described step
In rapid a21, when facial contour has one of situations below situation in tired information, judge that driver head is in and bow
State；
A211) ratio of facial contour camber and width is less than 1；
A212) facial contour accounts for image area ratio and is less than 1/2.
8. the processing method of the control system based on intelligent back vision mirror according to claim 6 is it is characterised in that described step
In rapid a25, when eyelid profile has one of situations below situation in tired information, judge that driver's eyes are in fatigue
State；
A311) ratio of eyelid profile camber and width is less than 1:2；
A311) the eyelid contour area of two eyes is different.
9. the processing method of the control system based on intelligent back vision mirror according to claim 5 starts it is characterised in that working as
Common main processing block obtains the detection data of obd system when rescuing, when detection data breaks down information or failure code
When, fault message or failure code are sent to car owner by main processing block, and provide neighbouring automobile services businessman to driver
Information and navigation way.
10. the processing method of the control system based on intelligent back vision mirror according to claim 5 is it is characterised in that described
Intelligent back vision mirror passes through network interface card and communication of mobile terminal, and network interface card is powered by the supply module of in-car obd system；Stop when vehicle is in
During car state, network interface card is used for receiving the data from mobile terminal, when the data of the mobile terminal receiving is default wake-up
During data, network interface card wakes up main processing block, and the main processing block after wake-up is additionally operable to receive and shoots control command, and is receiving
After shooting control command, control front photographic head, rear photographic head and just the photographic head of driver face is started, and upload and photograph
Video or picture.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610752472.1A CN106335432B (en) | 2016-08-29 | 2016-08-29 | Intelligent back vision mirror, control system and processing method with driving auxiliary system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610752472.1A CN106335432B (en) | 2016-08-29 | 2016-08-29 | Intelligent back vision mirror, control system and processing method with driving auxiliary system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106335432A true CN106335432A (en) | 2017-01-18 |
| CN106335432B CN106335432B (en) | 2018-11-06 |
Family
ID=57822541
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610752472.1A Active CN106335432B (en) | 2016-08-29 | 2016-08-29 | Intelligent back vision mirror, control system and processing method with driving auxiliary system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106335432B (en) |
Cited By (31)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107161157A (en) * | 2017-05-04 | 2017-09-15 | 北京奇虎科技有限公司 | Vehicle intelligent equipment and safe early warning method, server and system based on it |
| CN107393302A (en) * | 2017-07-28 | 2017-11-24 | 中国电信股份有限公司广东号百信息服务分公司 | Intelligent back vision mirror method for early warning and system |
| CN107748884A (en) * | 2017-11-30 | 2018-03-02 | 天津所托瑞安汽车科技有限公司 | A kind of multi-functional vehicle active safety hardware processing platform and operation method |
| CN107820163A (en) * | 2017-01-25 | 2018-03-20 | 问众智能信息科技（北京）有限公司 | A kind of speech playing method and device of vehicle intelligent back vision mirror |
| CN107826035A (en) * | 2017-11-01 | 2018-03-23 | 安徽安凯汽车股份有限公司 | A kind of car anti-fatigue-driving source of early warning and its application method |
| CN107933434A (en) * | 2017-11-17 | 2018-04-20 | 出门问问信息科技有限公司 | Intelligent back vision mirror quiets down method of adjustment, equipment and the storage medium of pattern |
| CN108053669A (en) * | 2018-01-15 | 2018-05-18 | 陈世辉 | A kind of intelligent vehicle-carried manager |
| CN108189763A (en) * | 2018-01-17 | 2018-06-22 | 北京万得嘉瑞汽车技术有限公司 | A kind of analysis method of driver's driving behavior and special intelligent vehicular rear mirror |
| CN108423002A (en) * | 2018-02-07 | 2018-08-21 | 深圳市芝麻开门电子科技有限公司 | A kind of method and system of safe driving monitoring |
| CN108449571A (en) * | 2018-01-30 | 2018-08-24 | 深圳市元征软件开发有限公司 | A kind of car monitoring method and equipment |
| CN108454620A (en) * | 2018-04-10 | 2018-08-28 | 西华大学 | A kind of pre- anticollision of automobile and autonomous rescue system |
| CN109050396A (en) * | 2018-07-16 | 2018-12-21 | 浙江合众新能源汽车有限公司 | A kind of vehicle intelligent robot |
| CN109246090A (en) * | 2018-08-22 | 2019-01-18 | 北京九五智驾信息技术股份有限公司 | Data processing equipment, intelligent back vision mirror and data processing system |
| CN109249860A (en) * | 2018-09-30 | 2019-01-22 | 华勤通讯技术有限公司 | Vehicle-mounted vision-aided system and vehicle |
| CN109466449A (en) * | 2018-11-21 | 2019-03-15 | 北汽福田汽车股份有限公司 | Display control method, system and the vehicle of vehicle |
| CN109606376A (en) * | 2018-11-22 | 2019-04-12 | 海南易乐物联科技有限公司 | A kind of safe driving Activity recognition system based on vehicle intelligent terminal |
| CN109984762A (en) * | 2019-04-01 | 2019-07-09 | 广东乐芯智能科技有限公司 | A kind of fatigue driving judgment method based on wearable device |
| CN110053555A (en) * | 2019-04-15 | 2019-07-26 | 深圳市英泰斯达智能技术有限公司 | A kind of safe driving of vehicle auxiliary system and automobile |
| CN110087026A (en) * | 2019-03-26 | 2019-08-02 | 上海物为信息科技有限公司 | A kind of vehicle double screen multi-cam monitoring system |
| CN110217187A (en) * | 2019-05-22 | 2019-09-10 | 未来（北京）黑科技有限公司 | Vehicle collision processing method and processing device, HUD equipment and storage medium |
| CN110730406A (en) * | 2019-09-27 | 2020-01-24 | 深圳智者行天下科技有限公司 | Method for outputting two paths of independent sound sources based on Android system |
| CN110816410A (en) * | 2018-08-10 | 2020-02-21 | 本田技研工业株式会社 | Vehicle system |
| CN111016846A (en) * | 2019-12-31 | 2020-04-17 | 深圳市思博慧数据科技有限公司 | Safe driving active prevention management method and system |
| CN111210814A (en) * | 2018-11-06 | 2020-05-29 | 本田技研工业株式会社 | Control device, agent device, and computer-readable storage medium |
| CN111325869A (en) * | 2018-12-13 | 2020-06-23 | 厦门雅迅网络股份有限公司 | Vehicle fatigue driving accurate judgment method, terminal device and storage medium |
| CN112365669A (en) * | 2020-10-10 | 2021-02-12 | 北京索斯克科技开发有限公司 | Dual-band far infrared fusion-superposition imaging and fire early warning method and system |
| CN112406766A (en) * | 2020-03-11 | 2021-02-26 | 江南大学 | Intelligent vehicle-mounted early warning and help seeking system based on embedded technology |
| CN112550153A (en) * | 2021-01-27 | 2021-03-26 | 深圳京喜信息技术有限公司 | Long-distance bus rearview mirror based on face recognition |
| CN114212093A (en) * | 2021-12-08 | 2022-03-22 | 浙江大学 | Safe driving monitoring method and system and storable medium |
| CN114291038A (en) * | 2021-11-25 | 2022-04-08 | 合众新能源汽车有限公司 | Automatic heating method and device for rearview mirror |
| CN115503608A (en) * | 2022-10-24 | 2022-12-23 | 本田汽车用品(广东)有限公司 | Streaming media rearview mirror, live-action navigation system and navigation method |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102310771A (en) * | 2011-05-26 | 2012-01-11 | 臧安迪 | Motor vehicle safety control method and system based on driver face identification |
| CN202624069U (en) * | 2012-06-29 | 2012-12-26 | 北京兴科迪科技有限公司 | Automobile inner rear-view mirror with fatigue driving warning system |
| CN202703278U (en) * | 2012-05-25 | 2013-01-30 | 李国杰 | Automobile control system for preventing fatigue driving |
| CN202939770U (en) * | 2012-10-09 | 2013-05-15 | 浙江吉利汽车研究院有限公司杭州分公司 | Driver bad driving behavior correction device |
| CN203338529U (en) * | 2013-05-09 | 2013-12-11 | 杨锦涛 | Fatigue driving warning device based on camera recognition |
| CN203651621U (en) * | 2013-12-31 | 2014-06-18 | 北京兴科迪科技有限公司 | Inner rearview mirror with fatigue driving prompting device and vehicle with the inner rearview mirror |
| CN104494601A (en) * | 2014-12-18 | 2015-04-08 | 清华大学苏州汽车研究院（吴江） | Driving behavior analysis and driving assistance system based on OBD |
| CN104590130A (en) * | 2015-01-06 | 2015-05-06 | 上海交通大学 | Rearview mirror self-adaptive adjustment method based on image identification |
| CN204452225U (en) * | 2015-01-29 | 2015-07-08 | 深圳市京华信息技术有限公司 | A kind of MPV (Multi-Purpose Vehicle) networking room mirror |
| CN204719530U (en) * | 2015-04-24 | 2015-10-21 | 杭州字节信息技术有限公司 | A kind of integrated OBD car working application system |
-
2016
- 2016-08-29 CN CN201610752472.1A patent/CN106335432B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102310771A (en) * | 2011-05-26 | 2012-01-11 | 臧安迪 | Motor vehicle safety control method and system based on driver face identification |
| CN202703278U (en) * | 2012-05-25 | 2013-01-30 | 李国杰 | Automobile control system for preventing fatigue driving |
| CN202624069U (en) * | 2012-06-29 | 2012-12-26 | 北京兴科迪科技有限公司 | Automobile inner rear-view mirror with fatigue driving warning system |
| CN202939770U (en) * | 2012-10-09 | 2013-05-15 | 浙江吉利汽车研究院有限公司杭州分公司 | Driver bad driving behavior correction device |
| CN203338529U (en) * | 2013-05-09 | 2013-12-11 | 杨锦涛 | Fatigue driving warning device based on camera recognition |
| CN203651621U (en) * | 2013-12-31 | 2014-06-18 | 北京兴科迪科技有限公司 | Inner rearview mirror with fatigue driving prompting device and vehicle with the inner rearview mirror |
| CN104494601A (en) * | 2014-12-18 | 2015-04-08 | 清华大学苏州汽车研究院（吴江） | Driving behavior analysis and driving assistance system based on OBD |
| CN104590130A (en) * | 2015-01-06 | 2015-05-06 | 上海交通大学 | Rearview mirror self-adaptive adjustment method based on image identification |
| CN204452225U (en) * | 2015-01-29 | 2015-07-08 | 深圳市京华信息技术有限公司 | A kind of MPV (Multi-Purpose Vehicle) networking room mirror |
| CN204719530U (en) * | 2015-04-24 | 2015-10-21 | 杭州字节信息技术有限公司 | A kind of integrated OBD car working application system |
Cited By (38)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107820163A (en) * | 2017-01-25 | 2018-03-20 | 问众智能信息科技（北京）有限公司 | A kind of speech playing method and device of vehicle intelligent back vision mirror |
| CN107161157B (en) * | 2017-05-04 | 2019-06-18 | 北京奇虎科技有限公司 | Vehicle intelligent equipment and safe early warning method, server and system based on it |
| CN107161157A (en) * | 2017-05-04 | 2017-09-15 | 北京奇虎科技有限公司 | Vehicle intelligent equipment and safe early warning method, server and system based on it |
| CN107393302A (en) * | 2017-07-28 | 2017-11-24 | 中国电信股份有限公司广东号百信息服务分公司 | Intelligent back vision mirror method for early warning and system |
| CN107826035A (en) * | 2017-11-01 | 2018-03-23 | 安徽安凯汽车股份有限公司 | A kind of car anti-fatigue-driving source of early warning and its application method |
| CN107933434A (en) * | 2017-11-17 | 2018-04-20 | 出门问问信息科技有限公司 | Intelligent back vision mirror quiets down method of adjustment, equipment and the storage medium of pattern |
| CN107748884A (en) * | 2017-11-30 | 2018-03-02 | 天津所托瑞安汽车科技有限公司 | A kind of multi-functional vehicle active safety hardware processing platform and operation method |
| CN108053669A (en) * | 2018-01-15 | 2018-05-18 | 陈世辉 | A kind of intelligent vehicle-carried manager |
| CN108189763A (en) * | 2018-01-17 | 2018-06-22 | 北京万得嘉瑞汽车技术有限公司 | A kind of analysis method of driver's driving behavior and special intelligent vehicular rear mirror |
| CN108449571A (en) * | 2018-01-30 | 2018-08-24 | 深圳市元征软件开发有限公司 | A kind of car monitoring method and equipment |
| CN108423002A (en) * | 2018-02-07 | 2018-08-21 | 深圳市芝麻开门电子科技有限公司 | A kind of method and system of safe driving monitoring |
| CN108454620A (en) * | 2018-04-10 | 2018-08-28 | 西华大学 | A kind of pre- anticollision of automobile and autonomous rescue system |
| CN108454620B (en) * | 2018-04-10 | 2023-06-30 | 西华大学 | Automobile pre-collision-prevention and autonomous rescue system |
| CN109050396A (en) * | 2018-07-16 | 2018-12-21 | 浙江合众新能源汽车有限公司 | A kind of vehicle intelligent robot |
| CN110816410A (en) * | 2018-08-10 | 2020-02-21 | 本田技研工业株式会社 | Vehicle system |
| CN109246090A (en) * | 2018-08-22 | 2019-01-18 | 北京九五智驾信息技术股份有限公司 | Data processing equipment, intelligent back vision mirror and data processing system |
| CN109249860A (en) * | 2018-09-30 | 2019-01-22 | 华勤通讯技术有限公司 | Vehicle-mounted vision-aided system and vehicle |
| CN111210814B (en) * | 2018-11-06 | 2023-11-10 | 本田技研工业株式会社 | Control device, agent device, and computer-readable storage medium |
| CN111210814A (en) * | 2018-11-06 | 2020-05-29 | 本田技研工业株式会社 | Control device, agent device, and computer-readable storage medium |
| CN109466449A (en) * | 2018-11-21 | 2019-03-15 | 北汽福田汽车股份有限公司 | Display control method, system and the vehicle of vehicle |
| CN109606376A (en) * | 2018-11-22 | 2019-04-12 | 海南易乐物联科技有限公司 | A kind of safe driving Activity recognition system based on vehicle intelligent terminal |
| CN111325869A (en) * | 2018-12-13 | 2020-06-23 | 厦门雅迅网络股份有限公司 | Vehicle fatigue driving accurate judgment method, terminal device and storage medium |
| CN110087026A (en) * | 2019-03-26 | 2019-08-02 | 上海物为信息科技有限公司 | A kind of vehicle double screen multi-cam monitoring system |
| CN109984762A (en) * | 2019-04-01 | 2019-07-09 | 广东乐芯智能科技有限公司 | A kind of fatigue driving judgment method based on wearable device |
| CN109984762B (en) * | 2019-04-01 | 2021-12-17 | 乐清市鑫众摩配有限公司 | Fatigue driving judgment method based on wearable equipment |
| CN110053555A (en) * | 2019-04-15 | 2019-07-26 | 深圳市英泰斯达智能技术有限公司 | A kind of safe driving of vehicle auxiliary system and automobile |
| CN110217187A (en) * | 2019-05-22 | 2019-09-10 | 未来（北京）黑科技有限公司 | Vehicle collision processing method and processing device, HUD equipment and storage medium |
| CN110730406A (en) * | 2019-09-27 | 2020-01-24 | 深圳智者行天下科技有限公司 | Method for outputting two paths of independent sound sources based on Android system |
| CN111016846A (en) * | 2019-12-31 | 2020-04-17 | 深圳市思博慧数据科技有限公司 | Safe driving active prevention management method and system |
| CN112406766A (en) * | 2020-03-11 | 2021-02-26 | 江南大学 | Intelligent vehicle-mounted early warning and help seeking system based on embedded technology |
| CN112365669A (en) * | 2020-10-10 | 2021-02-12 | 北京索斯克科技开发有限公司 | Dual-band far infrared fusion-superposition imaging and fire early warning method and system |
| CN112550153A (en) * | 2021-01-27 | 2021-03-26 | 深圳京喜信息技术有限公司 | Long-distance bus rearview mirror based on face recognition |
| CN112550153B (en) * | 2021-01-27 | 2022-05-13 | 北京宏诚伟信人力资源管理服务有限公司 | Long-distance bus rearview mirror based on face recognition |
| CN114291038A (en) * | 2021-11-25 | 2022-04-08 | 合众新能源汽车有限公司 | Automatic heating method and device for rearview mirror |
| CN114291038B (en) * | 2021-11-25 | 2024-01-02 | 合众新能源汽车股份有限公司 | Automatic heating method and device for rearview mirror |
| CN114212093A (en) * | 2021-12-08 | 2022-03-22 | 浙江大学 | Safe driving monitoring method and system and storable medium |
| CN114212093B (en) * | 2021-12-08 | 2024-03-12 | 浙江大学 | Safe driving monitoring method, system and storable medium |
| CN115503608A (en) * | 2022-10-24 | 2022-12-23 | 本田汽车用品(广东)有限公司 | Streaming media rearview mirror, live-action navigation system and navigation method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106335432B (en) | 2018-11-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106335432B (en) | Intelligent back vision mirror, control system and processing method with driving auxiliary system | |
| US10908677B2 (en) | Vehicle system for providing driver feedback in response to an occupant's emotion | |
| EP3067827B1 (en) | Driver distraction detection system | |
| US11034360B2 (en) | Method and apparatus that address motion sickness | |
| JP2021060986A (en) | System and method for authenticating occupant of vehicle | |
| CN109690609A (en) | Passenger's auxiliary device, method and program | |
| CN102881116A (en) | System and method for pre-warning of fatigue driving | |
| CN102752458A (en) | Driver fatigue detection mobile phone and unit | |
| CN101599207A (en) | A kind of fatigue driving detection device and automobile | |
| US20180229654A1 (en) | Sensing application use while driving | |
| CN111547063A (en) | Intelligent vehicle-mounted emotion interaction device for fatigue detection | |
| CN208126407U (en) | Anti-fatigue-driving system based on software-hardware synergism image procossing | |
| CN109801475A (en) | Method for detecting fatigue driving, device and computer readable storage medium | |
| CN103198618A (en) | Mobile phone capable of preventing fatigue driving and warning method | |
| CN106157537A (en) | Anti-fatigue-driving system | |
| CN106564429A (en) | Fatigue driving determination device and method | |
| CN107585026A (en) | A kind of anti-fatigue-driving system | |
| CN106361308A (en) | Method and system for detecting abnormal state | |
| CN112947740A (en) | Human-computer interaction method based on motion analysis and vehicle-mounted device | |
| CN109866774B (en) | Driver fatigue state monitoring system and method based on face detection and identity verification | |
| CN110065439A (en) | A kind of car interactive system | |
| CN107933461A (en) | In-car identification fusing device and method based on single camera | |
| CN105989328A (en) | Method and device for detecting use of handheld device by person | |
| CN109770922B (en) | Embedded fatigue detection system and method | |
| CN111292493A (en) | Vibration reminding method, device, electronic equipment and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |