JP6852045B2 - Electronics, control methods and programs - Google Patents

Description

The present invention relates to electronic devices, control methods and programs that perform predetermined notifications.

A means for detecting the physical condition of the driver of a vehicle has been considered for the purpose of preventing drowsy driving. As a means for detecting the physical condition of the driver of this vehicle, there is a means based on the pulse rate of the driver and the electrocardiographic potential between both hands (see, for example, Patent Document 1).

Japanese Unexamined Patent Publication No. 7-228171

By the way, in order to detect the driver's heart rate, etc., it is necessary to have the driver wear the detection device, which may interfere with the driver or make the setting complicated, and may not be preferred by the driver. There is.
An object of the present invention is to provide an electronic device, a control method, and a program capable of detecting a driver's carelessness and achieving safe driving without disturbing the driver and making settings complicated. To do.

The electronic device according to the present invention is included in the image data based on the image data transmitted from the first camera unit, the second camera unit, and the first camera unit in order to solve the above-mentioned problems. A determination unit that determines whether or not the user is awake, and a traveling state determination unit that determines whether or not the user is in a traveling state based on the image data transmitted from the second camera unit. When the notification unit and the determination unit determine that the user is not awake and the traveling state determination unit determines that the user is in the traveling state, control that controls the notification unit to perform a predetermined notification. It is a configuration including a part.

The electronic device may be provided with an acceleration sensor, and the traveling state determination unit may be configured to determine whether or not the vehicle is in a traveling state by taking into consideration the acceleration value acquired by the acceleration sensor.

In the electronic device, the determination unit determines whether or not the size of the user's face included in the image data is suitable for determining whether or not the user's face is awake, and determines that the size is not suitable. In some cases, the size of the user's face may be adjusted to an appropriate size.

In the electronic device, the determination unit determines whether or not the image data includes the user's face, and the control unit determines that the image data does not include the user's face. In this case, the notification unit may be controlled so as to perform a predetermined notification.

In the electronic device, the determination unit determines whether or not the user is in a preliminary state in which the user is not awake, and the control unit determines that the user is in the preliminary state by the determination unit. In this case, the notification unit may be controlled so as to perform a predetermined notification.

In the electronic device, the control unit may be configured to contact a preset contact when the determination unit determines that the user is not awake or the user is in the preliminary state. ..

In the electronic device, when the determination unit determines that the user is not awake or the user is in the preliminary state, the control unit searches for a predetermined location and guides the user to the predetermined location. It may be configured.

In the control method according to the present invention, in order to solve the above-mentioned problems, it is determined whether or not the user included in the image data is awake based on the image data transmitted from the first camera unit. The user is not awakened by the awakening state determination step, the running state determination step of determining whether or not the vehicle is in the traveling state based on the image data transmitted from the second camera unit, and the awakening state determination step. When it is determined that the vehicle is in a traveling state by the traveling state determination step, the configuration includes a control step of controlling the notification unit so as to perform a predetermined notification.

In the program according to the present invention, in order to solve the above-mentioned problems, whether or not the user included in the image data is awakened based on the image data transmitted from the first camera unit to the computer. The user is awakened by the awakening state determination step of determining the awakening state, the running state determination step of determining whether or not the vehicle is in the traveling state based on the image data transmitted from the second camera unit, and the awakening state determination step. When it is determined that the vehicle is not in the traveling state and the traveling state is determined to be in the traveling state, the control step of controlling the notification unit to perform a predetermined notification is executed.

According to the present invention, safe driving can be achieved.

It is a block diagram which shows the structure of an electronic device. It is a figure which shows the appearance of an electronic device.

In the present embodiment, the electronic device 1 will be described as, for example, a smartphone, but the present invention is not limited to this. Further, in the present embodiment, the electronic device 1 exerts a function of providing directions by an installed navigation application, but is not limited to this, and various functions (telephone communication) are exhibited by various installed applications. Function, map display function, etc.)

The electronic device 1 starts a navigation application in response to a predetermined operation by the user, and starts route guidance to the destination based on the set destination information or the like. Further, the electronic device 1 has a function of calling attention (hereinafter, referred to as an alarm function) according to the awakening state of the user.

The user attaches the electronic device 1 to a position (for example, on the dashboard) where the map information displayed on the display 18 can be easily seen when he / she gets in the car. The user drives to the destination while referring to the map information and the like displayed on the display 18.

Here, the electronic device 1 according to the present embodiment has a configuration for detecting the carelessness of the user and aiming for safe driving without disturbing the user and without complicating the setting. The configuration and operation of the electronic device 1 will be described in detail below.

As shown in FIG. 1, the electronic device 1 includes a first camera unit 11, a second camera unit 12, a determination unit 13, a traveling state determination unit 14, a notification unit 15, and a control unit 16.

The first camera unit 11 and the second camera unit 12 start shooting when the alarm function is turned on in response to a user operation.
The first camera unit 11 is, for example, an in-camera, and is arranged on one side of the electronic device 1 as shown in FIG. 2A. As shown in FIG. 2B, the second camera unit 12 is arranged on the other side of the electronic device 1. The one side of the electronic device 1 is the side on which the display 18 and various operation buttons 19 are arranged, and means the front side on which the user operates. The one side of the electronic device 1 is the side on which the battery or the like is mounted, and means the back side.

Further, as described above, the electronic device 1 is installed in the vehicle so that the display 18 faces the user side. Therefore, the image data taken by the first camera unit 11 arranged on the same surface as the display 18 includes the face of the driver (user).
Further, the image data taken by the second camera unit 12 arranged on the back surface side of the display 18 includes a landscape in the traveling direction of the vehicle.
The first camera unit 11 transmits the captured image data to the determination unit 13.
The second camera unit 12 transmits the captured image data to the traveling state determination unit 14.

The determination unit 13 determines whether or not the user included in the image data is awake based on the image data transmitted from the first camera unit 11. The determination unit 13 analyzes the image data, and the driver's characteristic operation for knowing the drowsy driving, such as the movement of the user's face or eyes, or whether the eyes are open or closed. It may be configured to capture and determine whether or not the user is awake based on the duration of this characteristic operation.

Based on the image data transmitted from the traveling state determination unit 14 and the second camera unit 12, it is determined whether or not the vehicle is in the traveling state. The traveling state determination unit 14 may be configured to analyze the image data, compare the image data of several frames, and determine that the traveling state is in the traveling state when there is a change, or the traveling state determination unit 14 may be included in the image data of several frames. It may be configured to determine that the vehicle is in a traveling state based on changes in objects indicating the road (for example, a center line, a traffic light, etc.).

The notification unit 15 is composed of a speaker, a vibrator, a light emitting element, and the like, and has a function of notifying the outside.
When the determination unit 13 determines that the user is not awake and the traveling state determination unit 14 determines that the user is in the traveling state, the control unit 16 controls the notification unit 15 so as to perform a predetermined notification. .. The predetermined notification is an alarm output, an audio data output and / or a vibrator output, and the like. The voice data is, for example, data having the content such as "It is dangerous. Please get up."

With this configuration, the electronic device 1 gives a predetermined notification when the user is riding in a car and is not awake (sleeping state), so that safe driving can be achieved. Can be done.
Further, since the electronic device 1 recognizes the face of the driver (user) based on the image data taken by the first camera unit 11, it can be determined that the electronic device 1 is looking away without looking straight ahead. it can. The electronic device 1 may be configured to give a predetermined notification when it is determined that the electronic device 1 is looking away.

As shown in FIG. 1, the electronic device 1 may further include an acceleration sensor 17.
In the case of such a configuration, the traveling state determination unit 14 determines whether or not the traveling state is in the traveling state in consideration of the acceleration value acquired by the acceleration sensor 17.

For example, when the car is in a traffic jam, even if the image data taken by the second camera unit 12 is analyzed, there is little change and there is a possibility that it is erroneously determined that the vehicle is not in a running state.
Therefore, the electronic device 1 can correctly determine the traveling state by adding the acceleration value acquired by the acceleration sensor 17.

The running state determination unit 14 stores the pattern of the acceleration value indicating the running state in advance in a storage unit (not shown), and compares the pattern of the acceleration value acquired by the acceleration sensor 17 with the running state. It may be configured to determine whether or not.

Further, when the navigation application is activated and the alarm function is ON, the determination unit 13 makes the user's face included in the image data captured by the first camera unit 11 the optimum size. It may be configured to be adjusted. The adjustment may be a digital zoom or an optical zoom. When adjusting by the optical zoom, the determination unit 13 drives the lens of the first camera unit 11 to change the focal length. The lens of the first camera unit 11 may be driven by the control unit 16 instead of the determination unit 13.

According to such a configuration, since the electronic device 1 adjusts the user's face to the optimum size, it can be reliably determined whether or not the user is not awake (sleeping state), and safe driving can be achieved. ..

Further, the determination unit 13 may be configured to determine whether or not the image data includes the user's face. When the determination unit 13 determines that the image data does not include the user's face, the control unit 16 controls the notification unit 15 so as to perform a predetermined notification. The predetermined notification is different from the notification output in the non-awakening state, and is an alarm output, an audio data output and / or a vibrator output, and the like. The audio data is, for example, data having contents such as "Please adjust the position so that your face can be seen on the camera."

According to such a configuration, the electronic device 1 urges the user to adjust the orientation of the first camera unit 11 by a predetermined notification, so that it is possible to ensure that the user is not awake (sleeping state). It can be judged and safe driving can be achieved.

Further, the determination unit 13 may be configured to determine whether or not it is in a preliminary state of dozing due to yawning or the like. When the determination unit 13 determines that the user is in a preliminary state of falling asleep and the running state determination unit 14 determines that the user is in a running state, the control unit 16 is notified so as to perform a predetermined notification. 15 is controlled. The predetermined notification may be the same as or different from the notification output in the unawakened state, such as alarm output, voice data output and / or vibrator output. The audio data is, for example, data having contents such as "It is dangerous. Please get up." Or "Why don't you take a rest?"
According to such a configuration, the electronic device 1 gives a predetermined notification in a preliminary state of not awakening (sleeping state), so that safer driving can be achieved.

Further, when the control unit 16 detects an unawakened state (sleeping state) or a preliminary state thereof, the control unit 16 uses a communication function to use a preset contact information (telephone number or e-mail). It may be configured to contact the address, etc.). The control unit 16 may be executed after confirmation by the user (for example, tapping the display, etc.) or automatically when contacting a preset contact.
According to such a configuration, the electronic device 1 contacts a preset contact in a preliminary state of not awakening (sleeping state). Therefore, for example, a call back from the contact is made. By receiving it, it is possible to get out of the dozing state and its preliminary state, and to drive safely.

Further, when the control unit 16 detects an unawakened state (sleeping state) or a preliminary state thereof, the control unit 16 obtains the current location from GPS information, and finds the current location, the nearest parking area, a rest spot, or the like). It may be configured to search for and guide to the predetermined place. The predetermined location may be preferentially searched for a location that the user is likely to like, based on the past behavior history of the user stored in the electronic device 1.
According to such a configuration, the electronic device 1 guides the user to the nearest parking area or the like in a preliminary state of not being awake (sleeping state). Therefore, by following the guidance, sufficient rest is provided. It is possible to take a safe driving.

Further, in this embodiment, the configuration and operation of the electronic device for safe driving have been mainly described, but the present invention is not limited to this, and each component is provided, and the method and program for safe driving are configured. You may.

Further, the program for realizing the function of the electronic device may be recorded on a computer-readable recording medium, and the program recorded on the recording medium may be read by the computer system and executed.

The term "computer system" as used herein includes hardware such as an OS and peripheral devices. Further, the "computer-readable recording medium" refers to a portable medium such as a flexible disk, a magneto-optical disk, a ROM, or a CD-ROM, or a storage device such as a hard disk built in a computer system.

Furthermore, a "computer-readable recording medium" is a communication line that transmits a program via a network such as the Internet or a communication line such as a telephone line, and dynamically holds the program for a short period of time. It may also include a program that holds a program for a certain period of time, such as a volatile memory inside a computer system that serves as a server or a client in that case. Further, the above-mentioned program may be a program for realizing a part of the above-mentioned functions, and may be a program for realizing the above-mentioned functions in combination with a program already recorded in the computer system. ..

1 Electronic device 11 1st camera unit 12 2nd camera unit 13 Judgment unit 14 Running state judgment unit 15 Notification unit 16 Control unit 17 Accelerometer

Claims (7)

An electronic device that can be attached to a vehicle and is independent of the electrical components of the vehicle.
1st camera part and
Based on the image data transmitted from the first camera unit, a determination unit that determines whether or not the user included in the image data is looking away, and a determination unit.
A traveling state determination unit that determines whether or not the vehicle is in a traveling state,
Notification unit and
When the determination unit determines that the user is looking away and the traveling state determination unit determines that the user is in a traveling state, a control unit that controls the notification unit to perform a predetermined notification is provided. Prepare ,
The determination unit determines whether or not the user included in the image data is yawning based on the image data transmitted from the first camera unit.
When the determination unit determines that the user is yawning and the traveling state determination unit determines that the user is in a traveling state, the control unit causes the notification unit to perform a predetermined notification. Control,
Electronics. A second camera unit that captures the traveling direction of the vehicle is further provided.
The electronic device according to claim 1, wherein the traveling state determination unit determines whether or not the vehicle is in a traveling state based on image data transmitted from the second camera unit. A second camera unit that captures the traveling direction of the vehicle and
With an accelerometer,
The electronic according to claim 1, wherein the traveling state determination unit determines whether or not the vehicle is in a traveling state based on the image data transmitted from the second camera unit or the acceleration value acquired by the acceleration sensor. machine. The electronic device according to claim 1, wherein the determination unit adjusts the user's face included in the image data so as to have an optimum size. The determination unit determines whether or not the image data includes the user's face, and determines whether or not the image data includes the user's face.
The electronic device according to claim 1, wherein the control unit controls the notification unit so as to perform a predetermined notification when the determination unit determines that the image data does not include the user's face. It is a control method executed by an electronic device including a first camera unit and a notification unit independently of the electrical components provided in the vehicle, which can be attached to the vehicle.
With the electronic device
Based on the image data transmitted from the first camera unit, the first determination step of determining whether or not the user included in the image data is looking away, and
A running state determination process for determining whether or not the vehicle is in a running state, and
When it is determined by the first determination step that the user is looking away and the vehicle is determined to be in the traveling state by the traveling state determination process, the notification unit is controlled so as to perform a predetermined notification. The first control process to be performed and
A second determination step of determining whether or not the user included in the image data is yawning based on the image data transmitted from the first camera unit.
When it is determined by the second determination step that the user is yawning and the traveling state determination step determines that the vehicle is in a traveling state, the notification unit is set to perform a predetermined notification. A control method including a second control step for controlling. A program for causing a computer to function as each part of the electronic device according to any one of claims 1 to 5.

Images