KR20170035035A - Apparatus and method for preventing drowsy driving - Google Patents

Abstract

The present invention relates to an apparatus and a method for preventing drowsy driving, which use video data obtained by photographing a driver of a vehicle by a camera and use driving information of a current vehicle to analyze the information to doubly determine whether the driver drives while drowsy to warn the driver or perform braking when needed depending on a determination result. A camera unit photographs a driver of a vehicle by a camera to generate video data. A receiving unit receives vehicle driving information generated by the vehicle from a vehicle driving recording device. An information analysis unit analyzes video data generated by the camera unit and the vehicle driving information received by the receiving unit. A control unit determines whether the driver of the vehicle drives while drowsy depending on a result analyzed by the information analysis unit. A warning sound output unit outputs a warning sound depending on a result determined by the control unit to output the warning sound through a speaker.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a drowsiness driving device,

The present invention relates to an apparatus and method for preventing drowsiness, and more particularly, to an apparatus and method for preventing drowsiness of a driver, And an alarming action is performed according to the result, or a braking device is driven as needed.

The key to automotive technology is to make the driver or passenger comfortable and safe. However, automobile accidents are increasing due to an increase in the speed of the automobile, an increase in the driving distance and the running time, and an increase in the number of vehicles. Such automobile accidents not only increase the social cost but also have a serious effect on the driver individual. Therefore, studies for preventing traffic accidents caused by automobiles are actively conducted. In particular, studies on automobile performance to prevent damage from a traffic accident and to prevent it from occurring have been actively pursued more actively than any other fields. Such related research is directly related to the profit of the automobile maker, It is because it is getting.

The safety device of an automobile includes an airbag for cushioning a shock transmitted to a driver or a passenger in the event of a car crash, or a driver or passenger's body being seated on a seat to collide with another structure And seat belts to reduce the occurrence of secondary accidents. The automobile is designed as a shock absorbing structure so that the impact of the impact is not transmitted to the inside of the automobile. The shock absorbing bumper on the front and rear of the automobile, and the outer steel plate that keeps the shape of the vehicle play the role. In addition, the steering apparatus for determining the traveling direction of the automobile also responds to the running speed of the automobile, so that it is difficult to operate the automobile in the high speed operation, thereby preventing rollover due to sudden turning or the like at high speed operation. In order to prevent the lane departure due to the rotation of the vehicle occurring at the time, when the driver manipulates the brakes, it is operated sequentially in several stages. This sequential operation can stop the car quickly and accurately, thus preventing secondary accidents due to collision and lane departure. In addition, cameras are installed in various places in the car to provide information on the blind spot of the driver's view, thereby enabling safer operation. As such, various facilities and technologies are being applied to help the driver to drive safely in the automobile.

On the other hand, intelligent road service, various safe driving auxiliary facilities and information providing system installed on the road, efficient traffic signal system, various driving information provided to the driver at the time of driving the vehicle, Etc. can not be seen if the driver does not use it appropriately or does not operate it properly for some reason. In particular, if the driver is sleeping, he / she is more dangerous than drunk driving. Since he or she operates without any driver 's awareness about the danger, the ability to cope with the accident risk is significantly lowered,

Korean Patent No. 10-0283321 (registered on Dec. 12, 2000) discloses a drowsiness driving prevention device, which includes a sensing unit for sensing a driver's eye movement and a pulse, an input unit for sensing the sensing unit, A control unit for outputting a control signal when the driver is determined to be drowsy, and a driver driven according to a control signal of the control unit to brake the vehicle. According to the disclosed technology, it is possible to reduce the driving speed of the vehicle while ventilating the surroundings of the driver, thereby reducing the risk of accident of the vehicle which may be caused by drowsiness driving.

Korean Unexamined Patent Publication No. 10-2005-0015771 (published on Feb. 21, 2005) discloses a method for preventing drowsiness in order to improve braking performance by operating a braking device in advance in case of an emergency, System and method therefor. According to the disclosed technology, there is provided a digital camera comprising: a digital camera installed in a vehicle to detect a change in an external environment and detect a degree of change of an external lane; A deceleration sensor installed in the vehicle for detecting deceleration; A voice recognition sensor installed in the vehicle for mapping the relationship between the high frequency voice band of the driver in the vehicle and the deceleration; A brake device installed in the vehicle and equipped with a pedal simulator for separating pedal information of the driver of the vehicle and brake hydraulic pressure; The emergency situation of the vehicle is comprehensively mapped using the information and deceleration information received from various sensors and digital cameras installed in the vehicle. In emergency situations, the braking force is increased regardless of the pedal pressure, An ECU for increasing the braking distance by increasing the degree of braking; And an alarm device for alerting the driver when the ECU judges that the vehicle is in the drowsy driving mode.

The conventional drowsiness driving prevention device as described above judges the drowsy driving operation of the vehicle driver by using the moving picture data of the driver of the vehicle with the camera so that it is possible to prevent the driver from turning the head or flashing the eyes There is a disadvantage in that it is inferior in efficiency because the driver often misjudges driving as drowsiness. Therefore, there is a problem in preventing a driver accident caused by drowsiness driving in advance.

Korean Patent No. 10-0283321 Korean Patent Publication No. 10-2005-0015771

An object of the present invention is to solve the disadvantages and drawbacks described above, and it is an object of the present invention to provide an information processing apparatus and a method of using the moving image data of a driver of a vehicle, And an object of the present invention is to provide a drowsiness driving prevention device and a dormant driving prevention device which are implemented so as to judge a drowsy driving of a driver and perform a warning action according to a result thereof or to drive a braking device as needed.

According to an aspect of the present invention, there is provided a vehicle navigation system comprising: a camera unit for photographing a driver of a vehicle through a camera to generate moving image data; A receiver for receiving vehicle driving information generated in the vehicle from the vehicle driving recorder; An information analyzing unit for analyzing the moving image data generated by the camera unit and the vehicle driving information received by the receiving unit; A controller for determining whether or not the driver of the vehicle is drowsy according to a result of the analysis performed by the information analysis unit; And a warning sound output unit for generating a warning sound according to a result of the determination by the control unit and outputting the alarm sound through a speaker.

In one embodiment, the drowsiness driving prevention device stores preset reference moving image data of a driver corresponding to the drowsiness driving in advance and stores the vehicle driving information generated at the drowsiness driving of the driver in a reference And a memory unit which is previously stored with the driving information.

In one embodiment, the memory unit stores the number of times of blinking of the reference eye of the driver of the vehicle at the time of sleeping driving of the vehicle driver, and the reference number of times the head of the driver is set in advance.

In one embodiment, the memory unit may store a reference time for eye winding and a reference distance for eye position change corresponding to the sleeping operation of the vehicle driver in advance.

In one embodiment, the receiving unit receives the ECU data from the OBD that controls the vehicle inside the vehicle through the OBD interface, and transfers the received ECU data to the information analyzing unit.

In one embodiment, the receiving unit receives the vehicle driving information directly through a check sensor that directly checks and controls the vehicle driving related devices.

In one embodiment, the information analyzing unit analyzes the moving picture data generated by the camera unit and the vehicle driving information received by the receiving unit, and analyzes the moving picture data and analyzed driving information, And transmits it to the control unit.

In one embodiment, when the moving picture data corresponding to the eyes of the driver of the vehicle can not be identified with respect to the moving picture data generated by the camera unit, the information analyzing unit may correct the moving picture data through the video signal processing module or the infrared module .

In one embodiment, the information analyzing unit further includes an infrared LED and an infrared filter for monitoring the shape of the eye even when the driver wears sunglasses. The information analyzer may further include an infrared LED and an infrared filter, And analyzing whether or not the face recognition of the driver of the vehicle is possible.

In one embodiment, the information analyzing unit is characterized by counting the number of blinks of the driver's eyes for a specific time, or counting the number of times the driver's head is caught during a specific time, and notifying the controller of the number of counts .

In one embodiment, the image signal processing module includes at least one or more of a BLC module, an HLC module, a WALDC module, a CI or DM module, and an ACCE module.

In one embodiment, the information analyzing unit detects motion picture data corresponding to the face region of the vehicle driver with respect to motion picture data generated by the camera unit, Eye movement and magnitude or degree of eye position change in the detected eye area moving image data after detecting the corresponding moving image data, and notifies the control section of the checked eye winding and the degree of change in size or eye position .

In one embodiment, the information analyzing unit determines whether the face area moving image data is not recognized more than the preset time, or whether the face area moving image data is recognized again within a preset time even if the face area of the vehicle driver is recognized And provides the analysis result to the control unit.

In one embodiment, the information analyzing unit generates and stores vehicle driving information through ECU data received from the receiving unit.

In one embodiment, the information analyzing unit receives the OBD data via the vehicle information interface or receives the data directly received through the check sensor, and generates the vehicle driving information for determining whether or not the driver of the vehicle is drowsy .

In one embodiment, the control unit receives the analysis result of the moving image data recorded by the information analysis unit, and when it is determined that the driver of the vehicle is in the drowsy driving mode, And the alarm sound control unit generates a warning sound control signal by using the analysis result of the vehicle driving information to determine whether or not the driver is drowsy, and transmits the alarm sound control signal to the warning sound output unit.

In one embodiment, the control unit receives the analysis moving image data and the analysis driving information from the information analysis unit, reads the reference moving image data and the reference driving information from the memory, compares the analyzed moving image data with the reference moving image data, After judging whether or not the driver is driving the drowsy road, the driving operation information is compared with the reference analysis driving information together with the result of the first determination, and the driver is judged whether or not the driver is driving drowsy.

In one embodiment, the control unit receives the number of blinks of the driver of the vehicle for a specific period of time or the number of times the driver of the vehicle driver's head for a certain period of time has passed, from the information analysis unit, It is determined whether or not the sleeping operation is performed.

In one embodiment, the control unit receives the eye winding and the degree of change in size or eye position checked by the information analysis unit, and determines that the face area is recognized from the moving image data recorded by the information analysis unit , It is determined that the driver of the vehicle is in the drowsy driving state when the driver's eyes are wrapped over the preset reference time or when the positional change of the driver's eyes repeatedly moves beyond the preset reference distance.

In one embodiment, even if the information analyzing unit determines that the vehicle driver is not driving the sleeping vehicle as a result of analyzing the moving image data recorded by the vehicle driver, the control unit may determine that the direction of the vehicle A condition in which there is no change for a certain period of time, a condition in which the distance between the side of the vehicle and the adjacent lane becomes narrower than a certain distance, a condition in which the vehicle is irregularly and urgently moved in the rightward and leftward direction more than a certain number of times, A condition that the number of times of movement is more than a specific number of times, a condition that a distance between the preceding vehicle and a preceding vehicle is equal to or less than a specific distance, and a condition in which a user's reaction time to maintain a safety distance from the preceding vehicle is at least a specific time An alert action control signal for causing the alert action to be performed is generated Characterized in that the group output warning sound output unit.

In one embodiment, the control unit determines that the driver of the vehicle is driving in the sleep state based on the result of the analysis of the moving image data recorded by the information analysis unit by the information processing unit, and if the driver is determined to be driving, the accelerator pedal, And does not output the warning action control signal to the warning sound outputting section when the indicator lamp is operated.

In one embodiment, the drowsiness driving prevention device further includes a braking device unit for braking the vehicle slowly in stages according to a result of the determination by the control unit to reduce the speed of the vehicle.

According to another aspect of the present invention, there is provided a means for solving the above-mentioned problems, comprising the steps of: photographing a driver of a vehicle through a camera unit and generating moving image data; Receiving the vehicle driving information generated in the vehicle from the vehicle driving recorder; Analyzing the moving picture data generated by the information analyzing unit and the vehicle driving information received by the receiving unit; Determining whether the driver of the vehicle is drowsy according to a result of the analysis performed by the information analysis unit; And generating a warning sound according to a result of the warning sound outputting part determined by the controller, and outputting the alarm sound through the speaker.

As the effect of the present invention, the motion data of the driver of the vehicle is taken by the camera and analyzed using the driving information of the current vehicle to double-determine the driver's drowsy driving, It is possible to more accurately determine the drowsiness operation of the vehicle driver in spite of the error inducing action of the vehicle driver, and it is possible to prevent the drowsiness of the driver of the vehicle by drowsiness driving It can prevent traffic accidents in advance.

According to the present invention, the first judgment and the second analysis can be performed economically to judge the driver's drowsy operation by implementing a low-cost apparatus. Accordingly, a general driver, a professional driver (for example, a taxi, a bus, A driver of a truck, etc.) is prevented from drowsing driving more dangerous than drunk driving. In addition, according to the present invention, by adding an innovative analysis algorithm that complements the constraints and exceptional cases, the number of malfunctions in the actual field is remarkably reduced, and commercialization superior to the prior art can be achieved.

1 is a view for explaining a drowsiness driving prevention device according to an embodiment of the present invention.
2 is a view for explaining the connection of the OBD interface of the receiver shown in FIG.
3 is a view for explaining a drowsiness driving prevention method according to an embodiment of the present invention.
FIG. 4 is a view for explaining the moving picture data analysis step in FIG.
FIG. 5 is a diagram for explaining the moving picture data analysis step in FIG.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily carry out the present invention. However, the description of the present invention is merely an example for structural or functional explanation, and the scope of the present invention should not be construed as being limited by the embodiments described in the text. That is, the embodiments are to be construed as being variously embodied and having various forms, so that the scope of the present invention should be understood to include equivalents capable of realizing technical ideas. Also, the purpose or effect of the present invention should not be construed as limiting the scope of the present invention, since it does not mean that a specific embodiment should include all or only such effect.

The meaning of the terms described in the present invention should be understood as follows.

The terms "first "," second ", and the like are intended to distinguish one element from another, and the scope of the right should not be limited by these terms. For example, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component. It is to be understood that when an element is referred to as being "connected" to another element, it may be directly connected to the other element, but there may be other elements in between. On the other hand, when an element is referred to as being "directly connected" to another element, it should be understood that there are no other elements in between. On the other hand, other expressions that describe the relationship between components, such as "between" and "between" or "neighboring to" and "directly adjacent to" should be interpreted as well.

It should be understood that the singular " include "or" have "are to be construed as including a stated feature, number, step, operation, component, It is to be understood that the combination is intended to specify that it does not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or combinations thereof.

All terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs, unless otherwise defined. Commonly used predefined terms should be interpreted to be consistent with the meanings in the context of the related art and can not be interpreted as having ideal or overly formal meaning unless explicitly defined in the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An apparatus and method for preventing drowsiness according to an embodiment of the present invention will now be described in detail with reference to the drawings.

FIG. 1 is a view for explaining an apparatus for preventing drowsiness according to an embodiment of the present invention, and FIG. 2 is a view for explaining connection of an OBD interface of a receiving unit shown in FIG.

1 and 2, the drowsiness driving prevention device 100 includes a camera unit 110, a receiving unit 120, an information analysis unit 130, a control unit 140, a memory unit 150, (160).

The camera unit 110 photographs (or records) a vehicle driver through a camera, converts (or generates) the photographed moving image into moving image data, and transmits the converted moving image data to the information analyzing unit 130 give.

The receiving unit 120 is a vehicle information interface for receiving vehicle driving information, and communicates with OBD (On-Board Diagnostics) in the vehicle by communicating with the OBD And transmits the received vehicle driving information to the information analysis unit 130.

In one embodiment, the receiving unit 120 receives ECU (Engine Control Unit) data from OBD-II (OBD-II) that controls the vehicle inside the vehicle through the OBD interface, To the information analysis unit 130.

2, the receiving unit 120 receives ECU data communicated through a vehicle driving recorder in the vehicle, or receives a control signal from a check sensor (not shown) for directly checking and controlling the vehicle- It is possible to directly receive vehicle driving information through a check sensor.

The information analyzing unit 130 analyzes the moving image data transmitted from the camera unit 110 and the vehicle driving information transmitted from the receiving unit 120 and transmits the analysis result to the control unit 140.

In one embodiment, the information analyzing unit 130 analyzes the moving image data transmitted from the camera unit 110 and the vehicle driving information transmitted from the receiving unit 120, (Or generates) analysis moving picture data and analyzed driving information to the control unit 140. The control unit 140 may be configured to generate the analysis moving picture data and the analysis driving information.

In one embodiment, the information analysis unit 130 determines whether the moving picture data transmitted from the camera unit 110 is a nighttime time range at which the moving picture of the vehicle driver is photographed, (Image Signal Processing) (ISP) in order to enable analysis with higher accuracy even when the vehicle driver can not identify the moving image data corresponding to the eyes of the driver by operating the vehicle with the sunglasses worn. Module or an infrared ray (IR) module, and can correct the moving picture data transmitted from the camera unit 110 through the corresponding video signal processing module or the infrared module.

In one embodiment, the information analyzing unit 130 may additionally include an infrared LED and an infrared filter to monitor the shape of the eye even when the driver wears sunglasses, thereby improving the recognition accuracy of the moving image data, Accordingly, it is possible to analyze the blinking of the driver's eyes or the possibility of recognizing the face of the driver of the vehicle using the video data corrected through the infrared LED and the infrared filter, and provide the analysis result to the controller 140. At this time, the information analysis unit 130 counts the number of blinks of the driver of the vehicle for a specific time, counts the number of times that the driver of the vehicle driver's head is caught for a specific time (or the number of times the face is recognized) To the control unit 140. [0050] Here, the image signal processing module includes a BLC (Back Light Compensation) module, a HLC (High Light Compensation) module, a WALDC (Wide Angle Lens Distortion Correction) module, a CI (Or DM (De-mosaicking)) module, and an ACCE (Adoptive Color Contrast Enhancement) module.

In one embodiment, the information analyzing unit 130 detects moving image data corresponding to the face region of the vehicle driver with respect to the moving image data transmitted from the camera unit 110, and then extracts, from the detected face region moving image data, After detecting the moving image data corresponding to the eye area of the driver of the vehicle, the eye winding and the magnitude or degree of eye position change are checked in the detected eye area moving image data, (140). At this time, when detecting the face region moving image data, the information analysis unit 130 determines whether the face region can not be recognized more than the previously set time or if the face region of the vehicle driver is recognized, And provide the analysis result to the control unit 140. FIG. For example, if the driver of the vehicle is driving down the head and sleeping, or if he / she does not concentrate on the driving and performs other actions, the face region can not be recognized for a predetermined time or longer. The information analyzing unit 130 may determine that the face region is not recognized within a predetermined period of time even if the face region is recognized while moving the subject while driving the subject. Can be analyzed.

In one embodiment, the information analyzing unit 130 can generate and store vehicle driving information through the ECU data transmitted from the receiving unit 120.

In one embodiment, the information analysis unit 130 receives the OBD data via the vehicle information interface or directly receives data received through the check sensor from the receiving unit 120, and determines whether or not the driver of the vehicle is drowsy (That is, vehicle driving information).

The control unit 140 determines whether or not the driver of the vehicle is drowsy according to the analysis result transmitted from the information analysis unit 130 as the drowsiness driving judgment and the warning sound output control module (or includes the braking control module) And transmits the determination result to the warning sound output unit 160.

In one embodiment, the controller 140 receives the analysis result of the moving image data recording the vehicle driver from the information analysis unit 130, and when it is determined that the driver of the vehicle is primarily in the drowsy driving mode, The alarm sound output unit 160 may generate the alarm sound control signal only during the running of the vehicle (i.e., when it is judged that the vehicle is in the drowsy state), using the analysis result of the vehicle driving information transmitted from the alarm information output unit 130.

In one embodiment, the control unit 140 receives the analysis moving image data and the analysis driving information from the information analysis unit 130 and reads the reference moving image data and the reference driving information previously set in the memory unit 150, The analyzed moving image data is compared with the read reference moving image data to determine whether or not drowsy operation has been performed. Then, the analyzed driving information is compared with the reference analysis running information that has been read, together with the result of the primary determination, It is possible to judge whether or not the driver is driving drowsy.

In one embodiment, the control unit 140 receives from the information analysis unit 130 the number of blinks of the driver of the vehicle for a specific time or the number of times the driver of the vehicle driver has waited for a specific time, It is possible to judge whether or not the drowsy operation is performed by comparing with the read reference number of times.

In one embodiment, the control unit 140 receives the eye winding and the magnitude or degree of eye position change checked by the information analysis unit 130, and extracts, from the video data recorded by the information analysis unit 130, It is determined that the driver of the vehicle is driving in the sleep state when the driver's eyes are wrapped over the preset reference time or when the positional change of the driver's eyes repeatedly moves beyond the previously set reference distance .

In one embodiment, even if the information analyzing unit 130 determines that the vehicle driver is not driving the sleeping vehicle as a result of analyzing the moving image data obtained by recording the vehicle driver by the information analyzing unit 130, A condition in which the direction of the vehicle does not change for a predetermined period of time, a condition in which the distance between the side surface of the vehicle and the adjacent lane narrows below a specific distance, a condition in which the vehicle is irregularly moved in the left- A condition that the number of times the vehicle has passed the predetermined number of times or more, a number of times that the vehicle has moved across the adjacent lane is more than a specific number of times, a condition that the distance from the preceding vehicle is less than a specific distance, In the case where at least two conditions are satisfied in a condition such as the specific time or more, The warning control signal can be generated and output to the alarm sound output unit 160.

In one embodiment, the control unit 140 determines that the vehicle driver is driving the sleeping vehicle based on the result of analysis of the moving image data recorded by the information analysis unit 130, The warning action control signal may not be output to the warning sound output unit 160 when the brake pedal or the turn signal lamp is operated.

The memory unit 150 stores the programs and data required by the information analysis unit 130 and the control unit 140. In order to enable the driver of the vehicle to determine whether or not the driver is drowsy, And stores the vehicle driving information generated at the time of the driver's sleeping operation in advance as the reference driving information corresponding to the drowsy driving.

In one embodiment, the memory unit 150 may store the number of reference blinks of the vehicle driver at the time of sleeping driving of the vehicle driver, and the number of times the head of the driver is determined to be preset.

In one embodiment, the memory unit 150 may store the reference time for eye winding and the reference distance for eye position change corresponding to the sleeping operation of the vehicle driver in advance.

The alarm sound output unit 160 generates a warning sound according to the determination result (or the alarm sound control signal) transmitted from the controller 140, and outputs the alarm sound through the speaker.

The drowsiness driving prevention device 100 having the above-described configuration can be fixedly installed in the vehicle and can execute the drowsiness driving prevention module. In other words, the drowsiness prevention device 100 having the above-described configuration is mounted inside the vehicle. For example, the drowsiness prevention device 100 can be mounted in front of the driver with the upper end of the windshield of the vehicle, It is possible to mount it in any place where efficiency is increased.

The drowsiness-driving prevention device 100 having the above-described configuration may further include a braking device unit 170. Here, the braking device unit 170 brakes the vehicle in a stepwise manner in accordance with a determination result transmitted from the control unit 140, thereby reducing the speed of the vehicle. At this time, the control unit 140 may transmit the drowsiness operation determination result to the braking device unit 170.

The drowsiness prevention device 100 having the above-described configuration analyzes moving image data obtained by photographing a driver of a vehicle by a camera in the information analysis unit 130 using current driving information of the vehicle, The driver's sleeping operation can be judged more accurately regardless of the error inducing action of the driver by determining the driver's drowsy driving in accordance with the result of the judgment, Therefore, it is possible to prevent traffic accident of the driver of the vehicle by drowsiness driving in advance. In other words, the drowsiness driving prevention device 100 having the above-described configuration determines the drowsiness driving of the driver primarily by using the moving image data of the driver of the vehicle taken by the camera, Secondarily, the driver's sleeping operation is determined by analyzing the current driving information of the vehicle, and the result of the secondary analysis is added to the primary determination result to double check the driver's drowsiness. Outputting a measure, and driving the braking device as required.

The drowsiness prevention device 100 having the above-described configuration can determine the drowsiness of the driver economically by implementing the low-cost device in the primary judgment and the secondary analysis. Accordingly, the general driver and the long- It is possible to prevent occupational drivers (e.g., drivers of taxis, buses, trucks, etc.) from drowsing driving more dangerous than drunk driving. In addition, the drowsiness prevention device 100 having the above-described configuration can reduce the number of malfunctions in the actual field significantly by adding an innovative analysis algorithm that complements the limitations and exceptional cases, Thereby making commercialization superior to the conventional technology.

3 is a view for explaining a drowsiness driving prevention method according to an embodiment of the present invention.

Referring to FIG. 3, in the camera unit 110 fixed to the windshield of the vehicle, a vehicle driver is recorded (or photographed) through a camera, and the recorded moving image is generated (or converted) And transmits the generated moving image data to the information analysis unit 130 (S310).

In the above-described step S310, the receiving unit 120 transmitting the moving image data and communicating with the OBD inside the vehicle receives the driving information of the vehicle generated in the vehicle from the OBD, (Step S320).

The information analyzing unit 130 analyzes the moving picture data transmitted from the camera unit 110 and the vehicle driving information transmitted from the receiving unit 120 and outputs the analysis result To the control unit 140 (S330).

In the above-described step S330, the information analyzing unit 130 analyzes the video data recorded by the vehicle driver so that the video data may be analyzed even when the shooting time is at night, or when the vehicle driver wears sunglasses or the like. The module can be applied to correct the video data recorded by the vehicle driver. At this time, the information analyzing unit 130 analyzes the eye size and blinking degree of the vehicle driver for a specific time using the video data recorded and corrected by the vehicle driver, determines whether the face recognition of the vehicle driver, Can be analyzed.

If the analysis result of the moving image data and the vehicle driving information is transmitted in the above-described step S330, the control unit 140 determines whether or not the driver of the vehicle is drowsy according to the analysis result transmitted from the information analysis unit 130 (Or a warning control signal) to the warning sound output unit 160 (or the braking unit 170) (S340).

In step S340, the control unit 140 firstly determines whether or not the driver of the vehicle is drowsy by using the result of analyzing the moving image data recorded and corrected by the vehicle driver in step S330 described above. Then, Information on the result of the analysis in the above-described step S330 may be further referred to the result of the first determination to determine whether the vehicle driver is in the last drowsy operation.

In the above-described step S340, when it is determined that the vehicle driver is driving the sleeping vehicle as a result of the primary determination, the control unit 140 outputs the warning action only while the vehicle is traveling at a constant speed or more using the vehicle driving information .

The alarm sound output unit 160 outputs a warning sound in response to the determination result (or the warning control signal) transmitted from the control unit 140. In response to the determination result (or the warning control signal) And the braking device unit 170 brakes the vehicle in a stepwise manner on the basis of the determination result (or the warning control signal) transmitted from the control unit 140 to gradually increase the speed of the vehicle (Step S350). At this time, as a warning measure, for example, it is possible to drive a speaker, a siren, a buzzer, a warning lamp, a vibration backrest, a braking device, etc., and if the driver does not return to normal, Then, when it returns to the normal state, the warning level is initialized. Then, the process returns to the above-described step S330 and the operation of analyzing and determining the moving picture data and the vehicle driving information can be repeated indefinitely.

FIG. 4 is a view for explaining the moving picture data analysis step in FIG.

4, when the camera unit 110 generates moving image data of a video image of a driver of the vehicle, the information analyzer 130 analyzes the moving image data of the vehicle driver 110, And receives the moving picture data (step S410).

When the moving image data is received in the above-described step S410, the information analyzing unit 130 can analyze the moving image data received in step S410 even if the photographing operation is at night or when the vehicle driver wears sunglasses or the like The ISP module and the IR module are applied to correct the moving picture data received in step S410 (step S420). For example, in order to facilitate image monitoring even in a dark environment at night or when a driver wears sunglasses, the information analysis unit 130 corrects the raw moving image data through the image correction function, By analyzing the data, the detection rate can be dramatically increased.

After the moving image data is corrected in step S420, the information analyzing unit 130 analyzes the moving image data corrected in step S420 (step S430).

FIG. 5 is a diagram for explaining the moving picture data analysis step in FIG.

Referring to FIG. 5, the information analyzing unit 130 detects the face region from the moving image data corrected in the above-described step S420, detects the eye region in the detected face region, And the pattern of change in size and / or eye position is checked.

In the information analysis unit 130, when recognizing the face area to detect the face area, the recognition and non-recognition are repeated within a preset time even if the face area is not recognized for a predetermined period of time or the face area of the vehicle driver is recognized , It can be determined that the vehicle driver is driving the drowsy. That is, in the information analysis unit 130, even if the face area of the vehicle driver is recognized, if the driver nods the face and repeats recognition and recognition, or fails to recognize the face recognition within a predetermined time, the information analysis unit 130 determines that the vehicle driver is driving the drowsy .

The information analyzing unit 130 additionally verifies the driving information of the vehicle in a second complementary manner even if it is determined that the vehicle driver is driving the sleeping vehicle as a result of analyzing the moving image data recorded by the vehicle driver, can do. For example, in the case where the accelerator pedal, the brake pedal, the direction indication, or the like is operated during operation while the driver of the vehicle determines that the vehicle driver is driving the drowsy as a result of analyzing the video data of the vehicle driver, May not output a warning action.

As another example, the information analyzing unit 130 may analyze the moving image data recorded on the vehicle driver so that the direction of the vehicle changes for a predetermined period of time without operation of the turn signal lamp, even if it is determined that the vehicle driver is not sleeping The condition that the distance between the side of the vehicle and the adjacent lane is less than a specific distance, the condition that the number of times the vehicle is irregularly or suddenly moved to the left and right roads is more than a specific number, the condition that the number of times the vehicle repeatedly moves across the adjacent lane is more than a certain number, A warning measure can be outputted when at least two conditions are satisfied among conditions in which the distance from the preceding vehicle is equal to or less than a specific distance and the reaction time of the user for maintaining the safety distance from the preceding vehicle is equal to or longer than a specific time.

As described above, the embodiment of the present invention is not limited to the above-described apparatus and / or method, but may be implemented by a program for realizing a function corresponding to the configuration of the embodiment of the present invention and a recording medium on which the program is recorded And the present invention can be easily implemented by those skilled in the art from the description of the embodiments described above. While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, It belongs to the scope of right.

100: Sleepy driving prevention device
110:
120: Receiver
130: Information Analysis Department
140:
150:
160: Warning sound output section
170:

Claims (5)

A camera unit for photographing a driver of a vehicle through a camera to generate moving image data;
A receiver for receiving vehicle driving information generated in the vehicle from the vehicle driving recorder;
An information analyzing unit for analyzing the moving image data generated by the camera unit and the vehicle driving information received by the receiving unit;
A controller for determining whether or not the driver of the vehicle is drowsy according to a result of the analysis performed by the information analysis unit; And
And a warning sound output unit for generating a warning sound according to a result of the determination by the control unit and outputting the alarm sound through a speaker.
The method according to claim 1,
Further includes a memory unit in which the reference moving image data of the driver corresponding to the drowsy driving is set and stored in advance and the vehicle driving information generated at the time of driving the drowsy driver of the vehicle driver is set in advance as the reference driving information corresponding to the dormancy driving Wherein the drowsiness driving prevention device comprises:
The information processing apparatus according to claim 1,
After moving picture data corresponding to the face region of the vehicle driver is detected with respect to the moving picture data generated by the camera unit, moving picture data corresponding to the eye region of the vehicle driver is detected from the detected face region moving picture data, Wherein the control unit checks the degree of eye winding and the degree of change in size or eye position in the eye region moving image data, and notifies the control unit of the checked eye winding and the degree of change in size or eye position.
The apparatus of claim 1,
The analysis moving picture data and the analysis driving information are received from the information analysis unit, and the reference moving picture data and the reference driving information are read out from the memory unit, and the analysis moving picture data and the reference moving picture data are compared with each other, And comparing the analyzed driving information with the reference analytical driving information together with the determined result to determine whether or not to operate the drowsy driving device.
A step of photographing a driver of a vehicle through a camera unit and generating moving image data;
Receiving the vehicle driving information generated in the vehicle from the vehicle driving recorder;
Analyzing the moving picture data generated by the information analyzing unit and the vehicle driving information received by the receiving unit;
Determining whether the driver of the vehicle is drowsy according to a result of the analysis performed by the information analysis unit; And
And generating a warning sound according to a result of the alarm sound output by the controller, and outputting the alarm sound through the speaker.

Images