CN1937763A - Sleepy sensing device for mobile communication terminal and its sleepy driving sensing method - Google Patents
Sleepy sensing device for mobile communication terminal and its sleepy driving sensing method Download PDFInfo
- Publication number
- CN1937763A CN1937763A CN 200510094471 CN200510094471A CN1937763A CN 1937763 A CN1937763 A CN 1937763A CN 200510094471 CN200510094471 CN 200510094471 CN 200510094471 A CN200510094471 A CN 200510094471A CN 1937763 A CN1937763 A CN 1937763A
- Authority
- CN
- China
- Prior art keywords
- driver
- sleepy
- mentioned
- stage
- mobile communication
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Emergency Alarm Devices (AREA)
- Traffic Control Systems (AREA)
Abstract
The invention relates to a tiredness sensing and relative tiredness drive sensing method of mobile communication terminal. It includes: pick-up camera part for supervising driver's body, head and eyes and inspecting their actions; signal output terminal connected to the pick-up camera; signal processing part for receiving the data signals of driver's normal state and current state output by the pick-up camera; data memory part connected with the output eng of the signal processing part and memorizing driver's normal state data and current state data; control part for controlling alarm signal to driver's tiredness by using the normal state data and current state data; alarm signal output part for alarming driver through sounding when the control judges driver is in tiredness state.
Description
Technical field
The present invention relates to the sleepy sensing device and the sleepy driving cognitive method thereof of mobile communication terminal machine, especially about the input image, use the sleepy sensing device and the sleepy driving cognitive method thereof of the mobile communication terminal machine of cognitive techniqueses such as posture, face, eyes.
Background technology
Recently, in mobile communication terminal machine, the product of most advanced and sophisticated functions such as color monitor, mass storage, many and twang, digital camera, wireless network platform has appearred adopting.That is,, support the multimedia function of mobile communication terminal machine to present the trend of continuous enhancing along with the development of mobile telecommunication service.
Appended the radio mobile communication terminal of multimedia function as camera function, its purposes becomes more extensive, and more and more is subjected to people's attention and attractes attention.
(patent No.: 20-1997-0036862) this system is about the anti-locking apparatus of the sleepy driving of vehicle to the anti-locking apparatus of the sleepy driving of vehicle that occurs recently, if open automatic switch, processor is controlled CCD (Charge Coupled Device: control part charge coupled device) on one side by mouthpiece, one side driven CCD video camera, or the portrait data of taking in order to ensure the reception ccd video camera store initial portrait data in the memory into as the standard model, and take with the next one, the portrait data that transmit by line memory compare in comparing section, when driver's posture changes uneasy state into by initial shakedown, or because the serious action of sleepy appearance when changing, give a warning, to guarantee safety traffic.
But, utilizing above-mentioned service system, the user is provided with the system that is made of processor and ccd video camera module by the mouthpiece with alarm device is installed in addition on vehicle, its expense costliness, and difficulty is installed.Has in handling simple function the shortcoming that need construct complication system.When driving said system, need a kind of more efficient and easy method.By this method, the radio mobile communication terminal with camera function can be on vehicle be set easily, exports, do not need to append other device by alarm signal and the basic output device such as the loud speaker that are built in terminating machine.And, if can move the radio mobile communication terminal of application programs such as camera function and recreation, can download this program, move easy.
Summary of the invention
The present invention is in order to address the above problem, and its objective is provides a kind of vehicle with the anti-locking system of sleepy driving, utilized the radio mobile communication terminal of camera function built-in.
To achieve these goals, the sleepy sensing device of mobile communication terminal machine of the present invention is made of following components: monitor driver's health or privileged sites such as head and eyes, the video camera portion that its activity is detected; Be connected the signal output part of above-mentioned video camera, receive the driver's normal condition of above-mentioned video camera output and the signal processing part of present status data; Be connected with the output of above-mentioned signal processing part, store above-mentioned driver's the normal condition data and the data store of present status data; Utilize above-mentioned normal condition data and present status data, detect driver's sleepy state, the control part of control warning signal; When above-mentioned control part is judged the sleepy driving of driver, by audible warning sound driver's warning signal efferent.
Use the sleepy driving cognitive method of mobile communication terminal machine to comprise following several stages: a) stage of memory of driving person's normal condition image; B) stage of the present driver's of storage status image; C) utilize driver's normal condition image of above-mentioned storage and present driver status image information, judge driver's stage of sleepy driving whether; And d) when judged result in the above-mentioned stage c) be driver during just in sleepy driving, give the alarm, and repeat the stage of above-mentioned stage b).
Use the feature of the sleepy driving cognitive method of mobile communication terminal machine to be: to judge in the above-mentioned stage c) that whether the driver is that the method for sleepy driving also comprises: the method for judgement number of winks; Judge the method for face and steering wheel position; Judge movable method above the waist.
The sleepy driving cognitive method of the sleepy sensing device of the application of the invention mobile communication terminal machine and use mobile communication terminal machine, driver with radio mobile communication terminal at any time, can be provided with the sleepy warning system of vehicle Anywhere easily, therefore, can reduce because the danger that numerous traffic accidents that sleepy driving causes take place.
Description of drawings
Fig. 1 is the formation block diagram of an embodiment of the sleepy sensing device of mobile communication terminal machine of the present invention.
Fig. 2 is the precedence diagram of an embodiment of the present invention's sleepy driving cognitive method of using mobile communication terminal machine.
Fig. 3 is another of the present invention's sleepy driving cognitive method of using mobile communication terminal machine
The precedence diagram of embodiment.
Fig. 4 is the schematic diagram that the mobile communication terminal machine that will be among the present invention be suitable for is suspended on the appearance on the vehicle.
Accompanying drawing major part symbol description
101: video camera portion 102: signal processing part
103: data store 104: control part
105: warning signal efferent 105a: audio output unit
105b: alarm efferent
Embodiment
Sleepy sensing device and sleepy driving cognitive method thereof to mobile communication terminal machine of the present invention is elaborated below with reference to accompanying drawings.In the following description, concrete specific items such as formation element will be described in detail.For for the ease of understanding item and this specific item that whole invention provides, within the scope of the invention, can carry out specific distortion or change, this is to grasp the self-explantory fact of relevant knowledge person in the correlative technology field.
Fig. 1 is the formation block diagram of an embodiment of the sleepy sensing device of mobile communication terminal machine of the present invention.
In the above-described embodiments, the sleepy sensing device of mobile communication terminal machine is made of following components: video camera portion 101, signal processing part 102, data store 103, control part 104 and warning signal efferent 105.
The foregoing description roughly shown the comparative observation driver state, judge the whether device of sleepy driving of driver.
With reference to Fig. 1, above-mentioned video camera portion 101 preferred ccd video camera or CMOS (complementary metal oxide semiconductors (CMOS)) video cameras that are installed on the mobile communication terminal machine that use.Above-mentioned video camera is preferably according to different sleepy driving cognitive methods, respectively the distance of driver's eyes, face and steering wheel, active state above the waist made a video recording.
After the driver's of the above-mentioned video camera of above-mentioned signal processing part 102 receptions portion output the view data, generate driver's the normal condition image and the data of present status image.
Above-mentioned data store 103 storage normal condition view data and present status view data.Above-mentioned normal condition view data is after the initial stage driver travels, and up to sleepy image before, up to finishing driving, stores in above-mentioned data store; Above-mentioned present status view data is the driver's of present input a view data, during the regular hour, brings in constant renewal in present status view data and storage.The complete image that the image that receives is stored 2 frames at least, preferably per second can receive more than 30 frames.
Above-mentioned control part 104 compares the normal condition image and the present status image of storage, whether sleepy driving of perception user.User's sleepy driving cognitive method has multiple.For instance, one of them is exactly the 96-44152 patent, and it has shown and utilize video camera to take the driver that in the image of taking, perception driver's state nictation when eyelid is motionless, judges that the driver is in the technology of sleepy state.And, detect user's the head and the distance of bridge, when distance is more and more nearer,, judge that the driver is in sleepy driving condition if continue the regular hour.That is, utilize the whether sleepy driving of activity perception driver of the image, face, the upper part of the body etc. of above-mentioned reception.Judge that key element is that drivers' such as nictation the upper part of the body of posture, the eyes of upper part of the body posture, face by the driver continues to tilt to a side, perhaps entire face close to the steering wheel direction, usually move up and down, eyes do not blink when closing for a long time, can judge that the driver is in sleepy driving condition.
Above-mentioned warning signal efferent 105 comprises audio output unit 105a and alarm efferent 105b.If judge that in above-mentioned control part the driver is in sleepy driving,, the driver is cheered up by sound equipment output warning signal.Best output sound of above-mentioned warning signal or output alarm signal, the basic output device loud speaker of use mobile communication terminal machine guarantees that the driver can hear the alarm of ringing really.
To achieve these goals, the present invention preferably also comprises charging dual-purpose mobile communication terminal machine vehicle hanging apparatus.With reference to Fig. 4, because when vehicle moves, the mobile communication terminal machine that possesses video camera should be fixed up, can monitor driver position above the waist, charging dual-purpose mobile communication terminal machine vehicle hanging apparatus is set, owing to when system acting, need a large amount of power consumption, so preferably use can be charged simultaneously.
Fig. 2 is the precedence diagram of an embodiment of the present invention's sleepy driving cognitive method of using mobile communication terminal machine.
Stage S201 is the process of memory of driving person's normal condition image.
Memory of driving person is at the starting vehicle or through behind the special time, the normal condition image before sleepy.Above-mentioned normal condition image preferably uses common memory to store.
Stage S202 is the process of memory of driving person's present status image.Behind memory of driving person's the normal condition image, through the regular hour, memory of driving person's present status image.Above-mentioned present status image preferably uses common memory to store.Whether sleepy normal condition image of storing in above-mentioned stage S201 and the present status image of storing in this stage become perception driver comparison other in the next stage.
Whether sleepy stage S203 be perception driver process to S205.
Whether sleepy stage S203 be state perception nictation the process of utilizing the driver.Above-mentioned utilization state nictation, it is a variety of to judge whether that sleepy method has, if a kind of method that all may finish according to related work personnel's level can be taked any one.
Stage S204 is the position of comparison face and steering wheel, the process whether perception is sleepy.
If driver's face and steering wheel keep specific distance, during certain hour, continue this state, can judge that the driver is in sleepy state.
Above-mentioned stage S205 is comparison activity above the waist, the process whether perception is sleepy.
If driver's the upper part of the body is to lopsidedness, and during certain hour, continue this state, can judge that the driver is in sleepy state.
Above-mentioned stage S206 is the process that gives the alarm.
In any one stage from above-mentioned stage S203 to stage S205, if the perception driver is in sleepy state, system can give the alarm or sound, wakes the driver.
Fig. 3 is another of the present invention's sleepy driving cognitive method of using mobile communication terminal machine
The precedence diagram of embodiment.
Other process is all identical, and different is when judging that the driver is in sleepy driving condition, when giving the alarm, number of times to be counted.Utilize the number of times of the above-mentioned counting of control part perception, the number of times of counting is many more, and the sound of alarm is just big more.
By above-mentioned description, the related work personnel can carry out various change and modification fully in the scope that does not depart from the technology of the present invention thought.
Therefore, technical scope of the present invention is not limited to the content on the specification, must determine its technical scope according to interest field.
Claims (3)
1, a kind of sleepy sensing device of mobile communication terminal machine is characterized in that, comprising:
Monitor driver's health or privileged sites such as head and eyes, the video camera portion that its activity is detected;
Be connected the signal output part of above-mentioned video camera, receive signal processing part the data of driver's normal condition of above-mentioned video camera output and present status;
Be connected with the output of above-mentioned signal processing part, store above-mentioned driver's the normal condition data and the data store of present status data;
Utilize above-mentioned normal condition data and present status data, detect driver's sleepy state, the control part of control warning signal;
When above-mentioned control part is judged the sleepy driving of driver, by audible warning sound driver's warning signal efferent.
2, a kind of sleepy driving cognitive method that uses mobile communication terminal machine is characterized in that, comprising:
A) stage of memory of driving person's normal condition image;
B) stage of the present driver's of storage status image;
C) utilize the driver's of above-mentioned storage normal condition image and present driver's status image information, judge driver's stage of sleepy driving whether; And
D) when judged result in the above-mentioned stage c) be driver during just in sleepy driving, give the alarm, and repeat the stage of above-mentioned stage b).
3, the sleepy driving cognitive method of use mobile communication terminal machine as claimed in claim 2 is characterized in that:
Judge in the above-mentioned stage c) that whether the driver is that the method for sleepy driving also comprises: the method for judging number of winks; Judge the method for the position of face and steering wheel; Judge movable method above the waist.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 200510094471 CN1937763A (en) | 2005-09-19 | 2005-09-19 | Sleepy sensing device for mobile communication terminal and its sleepy driving sensing method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 200510094471 CN1937763A (en) | 2005-09-19 | 2005-09-19 | Sleepy sensing device for mobile communication terminal and its sleepy driving sensing method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN1937763A true CN1937763A (en) | 2007-03-28 |
Family
ID=37954984
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 200510094471 Pending CN1937763A (en) | 2005-09-19 | 2005-09-19 | Sleepy sensing device for mobile communication terminal and its sleepy driving sensing method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN1937763A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102874259A (en) * | 2012-06-15 | 2013-01-16 | 浙江吉利汽车研究院有限公司杭州分公司 | Automobile driver emotion monitoring and automobile control system |
| CN102069710B (en) * | 2009-11-24 | 2014-03-26 | 鸿富锦精密工业（深圳）有限公司 | Device and method for monitoring driving |
| CN103863187A (en) * | 2012-12-12 | 2014-06-18 | 通用汽车环球科技运作有限责任公司 | Driver alerts |
| TWI478836B (en) * | 2009-12-02 | 2015-04-01 | Hon Hai Prec Ind Co Ltd | Monitor device and method for monitoring driving |
| CN103863187B (en) * | 2012-12-12 | 2016-11-30 | 通用汽车环球科技运作有限责任公司 | Driver alert's device |
| CN110199318A (en) * | 2017-03-14 | 2019-09-03 | 欧姆龙株式会社 | Driver status estimating device and driver status estimate method |
-
2005
- 2005-09-19 CN CN 200510094471 patent/CN1937763A/en active Pending
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102069710B (en) * | 2009-11-24 | 2014-03-26 | 鸿富锦精密工业（深圳）有限公司 | Device and method for monitoring driving |
| TWI478836B (en) * | 2009-12-02 | 2015-04-01 | Hon Hai Prec Ind Co Ltd | Monitor device and method for monitoring driving |
| CN102874259A (en) * | 2012-06-15 | 2013-01-16 | 浙江吉利汽车研究院有限公司杭州分公司 | Automobile driver emotion monitoring and automobile control system |
| CN102874259B (en) * | 2012-06-15 | 2015-12-09 | 浙江吉利汽车研究院有限公司杭州分公司 | A kind of automobile driver mood monitors and vehicle control system |
| CN103863187A (en) * | 2012-12-12 | 2014-06-18 | 通用汽车环球科技运作有限责任公司 | Driver alerts |
| CN103863187B (en) * | 2012-12-12 | 2016-11-30 | 通用汽车环球科技运作有限责任公司 | Driver alert's device |
| CN110199318A (en) * | 2017-03-14 | 2019-09-03 | 欧姆龙株式会社 | Driver status estimating device and driver status estimate method |
| CN110199318B (en) * | 2017-03-14 | 2023-03-07 | 欧姆龙株式会社 | Driver state estimation device and driver state estimation method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109792577B (en) | Information processing apparatus, information processing method, and computer-readable storage medium | |
| CN104008664B (en) | Road condition information acquisition method and relevant apparatus | |
| CN104503671B (en) | The driving control method and device of electronic Self-Balancing vehicle | |
| US20160224827A1 (en) | Camera in vehicle reports identity of driver | |
| CN109710080A (en) | A kind of screen control and sound control method and electronic equipment | |
| CN106168854A (en) | The based reminding method of sight protectio and device | |
| CN104799641B (en) | Safe and intelligent is rested the head on | |
| US10345854B2 (en) | Head mounted display | |
| CN107818694A (en) | alarm processing method, device and terminal | |
| CN105374145A (en) | Intelligent terminal alarm method and intelligent terminal alarm device | |
| CN105974918B (en) | Balance car control method, device and balance car | |
| CN108227933A (en) | The control method and device of glasses | |
| CN105882528A (en) | Road condition sharing method and device of balance car and balance car | |
| CN104332037B (en) | method and device for alarm detection | |
| CN106097650A (en) | The alarm method of terminal, device and terminal | |
| CN110001566A (en) | Interior life entity guard method, device and computer readable storage medium | |
| CN106060296A (en) | Terminal control method, device and system | |
| CN108769369A (en) | A kind of method for early warning and mobile terminal | |
| KR102111755B1 (en) | Image-processing Apparatus for Car and Method of Controlling The Same | |
| CN106408682A (en) | A prompting method and a promoting device | |
| KR102051136B1 (en) | Artificial intelligence dashboard robot base on cloud server for recognizing states of a user | |
| CN108920047A (en) | A kind of control method of application program, terminal and computer readable storage medium | |
| CN105931313A (en) | Recording method and device of automobile data recorder | |
| CN1937763A (en) | Sleepy sensing device for mobile communication terminal and its sleepy driving sensing method | |
| CN105721834B (en) | Control the method and device that balance car is stopped |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |