JP2018136849A - Arousal maintaining device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an arousal maintaining device which hardly causes a driver to feel annoyed.SOLUTION: An arousal maintaining device 1 comprises a stimulation execution unit, a velocity acquisition unit, and a control unit. The stimulation execution unit executes a stimulation process for changing a display position of a visual stimulus in a left-right direction within a driver's forward vision using a display device displaying the visual stimulus. The speed acquisition unit acquires a speed of the vehicle. The control unit executes stimulation processing when following conditions J1 and J2 are satisfied. J1: A time period during which a speed acquired by the speed acquisition unit continuously exceeds a preset threshold speed is longer than a preset reference time period. J 2: An elapsed time period since a last execution of stimulation processing by the stimulation execution unit is longer than a preset interval time period.SELECTED DRAWING: Figure 2

Description

  The present disclosure relates to a wakefulness maintenance device.

  It is known that saccadic eye movements appear when a person is awake. Patent Document 1 discloses a wakefulness maintenance device that induces saccade eye movements by sequentially or alternately outputting visual stimuli from two or more locations that are separated to the left and right in front of a person.

Japanese Patent Laid-Open No. 2006-134077

  In a situation where there are many targets such as pedestrians around the vehicle (hereinafter referred to as a crowded situation), the driver cannot afford to see it even if a display for guiding saccade eye movement is performed. Further, in a crowded situation, the driver feels annoyed when the display for guiding the saccade eye movement is performed. The present disclosure provides a wakefulness maintenance device that makes it difficult for a driver to feel annoyance.

  One aspect of the present disclosure is a wakefulness maintaining device that maintains wakefulness of a driver of a vehicle, and using a display device that displays visual stimuli, the display position of the visual stimuli in the front view of the driver in the left-right direction A stimulus execution unit that executes a stimulus process to be changed, a speed acquisition unit that acquires the speed of the vehicle, and a control unit that controls execution of the stimulus process by the stimulus execution unit, the control unit comprising: When the conditions J1 and J2 are satisfied, the wakefulness maintaining device executes the stimulation process by the stimulation execution unit.

J1: The time during which the speed acquired by the speed acquisition unit continuously exceeds a preset threshold speed is longer than a preset reference time.
J2: The elapsed time from the previous execution of the stimulation process by the stimulation execution unit is longer than a preset interval time.

  The wakefulness maintaining device that is one aspect of the present disclosure executes the stimulation process when the conditions J1 and J2 are satisfied. When the conditions J1 and J2 are satisfied, there is a low possibility that the surroundings of the vehicle are congested. Therefore, the wakefulness maintaining device that is one aspect of the present disclosure can execute the stimulation process when it is unlikely that the surroundings of the vehicle are congested. As a result, it can be suppressed that the driver feels bothered by the execution of the stimulation process.

  Another aspect of the present disclosure is a wakefulness maintaining device that maintains wakefulness of a driver of a vehicle, and using a display device that displays a visual stimulus, the display position of the visual stimulus is set in a left-right direction within the front field of view of the driver. A stimulus execution unit that executes a stimulus process to be changed in step, a control unit that executes the stimulus process by the stimulus execution unit every interval time, a maneuver state inference unit that infers the degree of maneuver state of the driver, A wakefulness maintaining apparatus comprising: a time setting unit that sets the interval time to be shorter as the level of the ill-sensed state estimated by the ill-defined state estimation unit is higher.

  The wakefulness maintenance device which is another aspect of the present disclosure sets the interval time to be shorter as the degree of the driver's vague state is higher. As a result, the stimulation process can be executed more frequently as the degree of the driver's mood state is higher. As a result, the driver can be awakened more than when the interval time is constant.

1 is a block diagram illustrating a configuration of a wakefulness maintaining device 1. 3 is a block diagram illustrating a functional configuration of the wakefulness maintaining device 1. FIG. It is a flowchart showing the process which the awakening maintenance apparatus 1 performs. It is explanatory drawing showing a stimulation process. It is a flowchart showing the process which the awakening maintenance apparatus 1 performs. 2 is a block diagram illustrating a configuration of a wakefulness maintaining device 101. FIG. 2 is a block diagram illustrating a functional configuration of a wakefulness maintaining device 101. FIG. It is a flowchart showing the process which the awakening maintenance apparatus 101 performs.

An embodiment of the present disclosure will be described with reference to the drawings.
<First Embodiment>
1. Configuration of Awakening Maintenance Device 1 The configuration of the awakening maintenance device 1 will be described with reference to FIGS. The awakening maintenance device 1 is an in-vehicle device mounted on a vehicle. Below, the vehicle carrying the awakening maintenance apparatus 1 is set as the own vehicle. As shown in FIG. 1, the wakefulness maintaining device 1 is configured around a known microcomputer having a CPU 3 and a semiconductor memory (hereinafter referred to as a memory 5) such as a RAM, a ROM, and a flash memory. Various functions of the wakefulness maintaining device 1 are realized by the CPU 3 executing a program stored in a non-transitional tangible recording medium. In this example, the memory 5 corresponds to a non-transitional tangible recording medium that stores a program. Also, by executing this program, a method corresponding to the program is executed. The number of microcomputers constituting the wakefulness maintaining apparatus 1 may be one or plural.

  As shown in FIG. 2, the wakefulness maintaining device 1 includes a stimulus execution unit 7, a speed acquisition unit 9, a control unit 11, and a casual state estimation unit as a functional configuration realized by the CPU 3 executing a program. 13, a time setting unit 15, a display content acquisition unit 17, and a traffic jam determination unit 19. The technique for realizing these elements constituting the wakefulness maintaining apparatus 1 is not limited to software, and some or all of the elements may be realized using one or a plurality of hardware. For example, when the above function is realized by an electronic circuit that is hardware, the electronic circuit may be realized by a digital circuit including a large number of logic circuits, an analog circuit, or a combination thereof.

  As shown in FIG. 1, the host vehicle includes a map information storage unit 21, a speed sensor 23, a driver camera 25, a vehicle exterior sensor group 27, a communication device 29, an air conditioner 31, and a display device 33 in addition to the awakening maintenance device 1. Prepare.

  The map information storage unit 21 stores map information. The speed sensor 23 detects the speed of the host vehicle. The driver camera 25 photographs the driver of the own vehicle. The angle of view of the driver camera 25 includes the face of the driver. The driver camera 25 can capture a moving image.

  The vehicle exterior sensor group 27 includes a plurality of sensors. Examples of the sensor include an outside camera and a laser radar. The vehicle exterior sensor group 27 can detect a target outside the vehicle. Examples of the target include pedestrians, other vehicles, and features.

  The communication device 29 can perform road-to-vehicle communication and vehicle-to-vehicle communication. The air conditioner 31 is provided in the passenger compartment of the host vehicle and can blow cold air. The display device 33 is a head-up display (hereinafter referred to as HUD). The display device 33 can display a visual stimulus in the driver's front field of view. The visual stimulus means a display object that can be visually distinguished from its surroundings. The visual stimulus may be, for example, a display object with higher brightness than the surrounding area, a display object having a color different from the surrounding area, or an area surrounded by a contour line. Or a combination thereof. Further, the visual stimulus may be a graphic having a certain area, a point, a line segment, or a combination thereof.

2. Processing Performed by the Awakening Maintenance Device 1 The processing that the awakening maintenance device 1 repeatedly executes every predetermined time will be described with reference to FIGS. In step 1 of FIG. 3, the speed acquisition unit 9 acquires the speed V of the host vehicle using the speed sensor 23.

  In step 2, the control unit 11 determines whether or not the speed V acquired in step 1 exceeds 40 km / h. 40 km / h corresponds to a preset threshold speed. The threshold speed value may be a value other than 40 km / h. When the speed V exceeds 40 km / h, the process proceeds to Step 2, and when the speed V is 40 km / h or less, the process proceeds to Step 10.

  In step 3, first, the control unit 11 calculates a time during which the speed V continuously exceeds 40 km / h (hereinafter referred to as a continuous running time). For example, if the speed V is 40 km / h or less before the time t in the past, the speed V exceeds 40 km / h at the time t, and the state where the speed V exceeds 40 km / h has continued to the present time, continuous running The time is the time from time t to the present time.

  Next, the control unit 11 determines whether or not the continuous running time is longer than 3 minutes. 3 minutes corresponds to a preset reference time. The value of the reference time may be a value other than 3 minutes. If the continuous running time is longer than 3 minutes, the process proceeds to step 4, and if the continuous running time is 3 minutes or less, the process ends. Making an affirmative determination in step 3 corresponds to satisfying the condition J1.

  In step 4, the casual state estimation unit 13 first captures the driver's face using the driver camera 25 and acquires a moving image. Next, the random state estimation unit 13 acquires the driver's eye closure rate using the acquired moving image. The closed eye rate is the ratio of time during which the eyes are closed. The closed eye rate is also called PERCLOS. The closed eye rate is an index representing the level of the state of disambiguation. The higher the closed eye rate, the higher the degree of ambiguity. The loose state means a state in which the driver's attention is distracted. The more distracting the driver's attention is, the higher the level of distraction.

  In step 5, the vague state estimation unit 13 determines whether or not the closed eye rate acquired in step 4 is 8% or less. 8% is a preset upper limit value. The upper limit value may be a value other than 8%. When the closed eye rate is 8% or less, the process proceeds to step 6, and when the closed eye rate exceeds 8%, the process proceeds to step 9.

  In step 6, the time setting unit 15 sets an interval time based on the closed eye rate acquired in step 4. The time setting unit 15 sets the interval time shorter as the closed eye rate is higher. For example, when the closed eye rate is 1% or less, the interval time can be set to 3 minutes. In addition, when the eye closure rate is more than 1% and 3% or less, the interval time can be set to 2 minutes. Further, when the eye closure rate exceeds 3% and is 8% or less, the interval time can be set to 1 minute.

  In step 7, the control unit 11 determines whether or not the elapsed time is longer than the interval time set in step 6. The elapsed time means the time from the previous execution of the stimulus processing executed in step 8 described later to the current time. The previous stimulus process means the newest stimulus process among the stimulus processes executed in the past. If the elapsed time is longer than the set time, the process proceeds to step 8. If the elapsed time is equal to or shorter than the set time, the process ends. Making an affirmative determination in step 7 corresponds to satisfying the condition J2.

  In step 8, the stimulus execution unit 7 executes the stimulus process once. The stimulus process is a process of displaying visual stimuli alternately on the first display position 35 and the second display position 37 shown in FIG. The first display position 35 and the second display position 37 are in the front view of the driver 39. The first display position 35 is on the right side when viewed from the driver 39, and the second display position 37 is on the left side when viewed from the driver 39. That is, the first display position 35 and the second display position 37 are different in the left-right direction. When the display position of the visual stimulus changes alternately between the first display position 35 and the second display position 37, the display position of the visual stimulus changes in the left-right direction.

  The stimulus processing corresponds to saccade stimulus that induces saccade eye movement. The saccade eye movement is an eye movement specific to awakening. If the saccade eye movement is induced by the stimulus processing, the driver can be awakened.

  In one stimulus process, for example, the display of the visual stimulus at the first display position 35 and the display of the visual stimulus at the second display position 37 can each be performed about four times. The time required for one stimulation process can be set to about 3 seconds, for example. A notice stimulus may be performed immediately before the stimulus processing. The notice stimulus is a process of displaying a visual stimulus at one of the first display position 35 and the second display position 37.

  The swing angle in visual stimulation is preferably in the range of 5 to 14 degrees. The swing angle is an angle formed by a direction 41 from the viewpoint of the driver 39 toward the first display position 35 and a direction 43 from the viewpoint of the driver 39 toward the second display position 37. When the swing angle is 5 degrees or more, the effect of awakening the driver is even higher. When the swing angle is 14 degrees or less, the safety of the host vehicle is further improved. The depression angle of the visual stimulus viewed from the viewpoint of the driver 39 is preferably within a range of 10 to 14 degrees. When the depression angle is within this range, the effect of awakening the driver is even higher.

  If a negative determination is made in step 5, the process proceeds to step 9 where the stimulus execution unit 7 executes a direct awakening process. The direct awakening process is a process of blowing cold air to the driver using the air conditioner 31. The direct awakening process is another process, and may be a known process that has an effect of awakening the driver.

  If a negative determination is made in step 2, the process proceeds to step 10 where the display content acquisition unit 17 acquires the display content of the traffic light located in front of the host vehicle. The display content acquisition unit 17 can acquire the display content of the traffic light using, for example, the communication device 29. Moreover, the display content acquisition unit 17 can acquire the image of the front of the own vehicle using a camera, for example, and can acquire the display content of a traffic light from the image.

  In step 11, the control unit 11 determines whether the display content of the traffic light acquired in step 10 corresponds to a red signal. The red light is the display content indicating the stop. If the display content corresponds to a red signal, the process proceeds to step 4, and if not, the process proceeds to step 12.

  In step 12, the traffic jam determination unit 19 acquires traffic jam information using the communication device 29. The traffic jam information includes information indicating the location of the traffic jam. The traffic jam information can be acquired from VICS (registered trademark), for example.

  In step 13, the traffic jam judgment unit 19 judges whether or not the own vehicle is in the traffic jam. The traffic jam judgment unit 19 collates the traffic jam information acquired in the step 12 with the map information stored in the map information storage unit 21 and judges whether or not the host vehicle is in the traffic jam. If the host vehicle is in a traffic jam, the process proceeds to step 4. If the host vehicle is not in a traffic jam, the process is terminated.

3. Effects produced by the wakefulness maintaining device 1 (1A) When the wakefulness maintaining device 1 makes an affirmative determination in step 2 and step 3, the stimulus processing is executed. When affirmative determination is made in step 2 and step 3, there is a low possibility that the surroundings of the host vehicle are congested. Therefore, the awakening maintenance device 1 can execute the stimulation process when the possibility that the surroundings of the host vehicle are in a congested situation is low. As a result, it can be suppressed that the driver feels bothered by the execution of the stimulation process.

  (1B) The awakening maintenance device 1 sets the interval time to be shorter as the driver's level of ambiguity is higher. As a result, the stimulation process can be executed more frequently as the degree of the driver's mood state is higher. As a result, the driver can be awakened more than when the interval time is constant.

  (1C) The awakening maintenance apparatus 1 acquires the driver's eye-closing rate, and estimates that the higher the eye-closing rate is, the higher the degree of driver's vague state is. Therefore, it is possible to easily and accurately estimate the level of the driver's moody state.

  (1D) The wakefulness maintaining device 1 executes the stimulation process even when the display content of the traffic light is a red signal and the elapsed time is longer than the interval time. Therefore, when the host vehicle is stopped by a red signal, the driver's awakening state can be maintained.

  (1E) The wakefulness maintaining device 1 executes the stimulation process even when the host vehicle is in a traffic jam and the elapsed time is longer than the interval time. Therefore, the driver's awakening state can be maintained when the host vehicle is in a traffic jam.

Second Embodiment
1. Differences from the First Embodiment Since the basic configuration of the second embodiment is the same as that of the first embodiment, the differences will be described below. Note that the same reference numerals as those in the first embodiment indicate the same configuration, and the preceding description is referred to.

  In the first embodiment, the closed eye rate is acquired, and the interval time is set according to the closed eye rate. In the first embodiment, the direct awakening process is executed when the closed eye rate exceeds the upper limit. On the other hand, in the second embodiment, the interval time is a fixed value and is 3 minutes. In the second embodiment, the direct awakening process is not executed.

2. Processing Performed by the Awakening Maintenance Device 1 The processing that the awakening maintenance device 1 repeatedly executes every predetermined time will be described with reference to FIG. The process of steps 21 to 23 is the same as the process of steps 1 to 3 in the first embodiment. If an affirmative determination is made in step 23, the process proceeds to step 24. Steps 24 and 25 are the same as steps 7 and 8 in the first embodiment. Steps 26 to 29 are the same as Steps 10 to 13 in the first embodiment. If an affirmative determination is made in step 27 or 29, the process proceeds to step 24.

3. Effects of Awakening Maintenance Device 1 According to the second embodiment described in detail above, the effects (1A), (1D), and (1E) of the first embodiment described above are exhibited.

<Third Embodiment>
1. Configuration of Awakening Maintenance Device 101 The configuration of the awakening maintenance device 101 will be described with reference to FIGS. The awakening maintenance device 101 is an in-vehicle device mounted on a vehicle. Hereinafter, the vehicle on which the awakening maintenance device 101 is mounted is referred to as the own vehicle. As shown in FIG. 6, the wakefulness maintaining apparatus 101 is mainly configured by a known microcomputer having a CPU 3 and a semiconductor memory (hereinafter referred to as a memory 5) such as a RAM, a ROM, and a flash memory. Various functions of the wakefulness maintaining apparatus 101 are realized by the CPU 3 executing a program stored in a non-transitional physical recording medium. In this example, the memory 5 corresponds to a non-transitional tangible recording medium that stores a program. Also, by executing this program, a method corresponding to the program is executed. Note that the number of microcomputers constituting the wakefulness maintaining apparatus 101 may be one or plural.

  As shown in FIG. 7, the wakefulness maintaining apparatus 101 includes a stimulus execution unit 7, a control unit 11, a casual state estimation unit 13, and a time setting unit as a function configuration realized by the CPU 3 executing a program. 15. The technique for realizing these elements constituting the wakefulness maintaining apparatus 101 is not limited to software, and some or all of the elements may be realized using one or a plurality of hardware. For example, when the above function is realized by an electronic circuit that is hardware, the electronic circuit may be realized by a digital circuit including a large number of logic circuits, an analog circuit, or a combination thereof.

  As shown in FIG. 6, the own vehicle includes a map information storage unit 21, a speed sensor 23, a driver camera 25, a vehicle exterior sensor group 27, a communication device 29, an air conditioner 31, and a display device 33 in addition to the awakening maintenance device 101. Prepare. These configurations are the same as those in the first and second embodiments.

2. Processing Performed by Awakening Maintenance Device 101 Processing performed by the awakening maintenance device 101 repeatedly every predetermined time will be described with reference to FIG. In step 31, the casual state estimation unit 13 first captures a driver's face using the driver camera 25 to obtain a moving image. Next, the random state estimation unit 13 acquires the driver's eye closure rate using the acquired moving image.

  In step 32, the vague state estimation unit 13 determines whether or not the closed eye rate acquired in step 31 is 8% or less. 8% is a preset upper limit value. The upper limit value may be a value other than 8%. When the closed eye rate is 8% or less, the process proceeds to step 33, and when the closed eye rate exceeds 8%, the process proceeds to step 36.

  In step 33, the time setting unit 15 sets an interval time based on the closed eye rate acquired in step 31. The time setting unit 15 sets the interval time shorter as the closed eye rate is higher. For example, when the closed eye rate is 1% or less, the interval time can be set to 3 minutes. In addition, when the eye closure rate is more than 1% and 3% or less, the interval time can be set to 2 minutes. Further, when the eye closure rate exceeds 3% and is 8% or less, the interval time can be set to 1 minute.

  In step 34, the control unit 11 determines whether or not the elapsed time is longer than the interval time set in step 33. The meaning of the elapsed time is the same as in the first and second embodiments. If the elapsed time is longer than the set time, the process proceeds to step 35, and if the elapsed time is equal to or shorter than the set time, the process is terminated.

In step 35, the stimulus execution unit 7 executes the stimulus process once. The content of the stimulation process is the same as in the first and second embodiments.
When a negative determination is made in step 32, the process proceeds to step 36, and the stimulus execution unit 7 executes a direct awakening process. The contents of the direct awakening process are the same as in the first embodiment.

3. Effects Awakened Maintaining Device 101 (3A) The awakened maintaining device 101 sets the interval time to be shorter as the driver's messy state is higher. As a result, the stimulation process can be executed more frequently as the degree of the driver's mood state is higher. As a result, the driver can be awakened more than when the interval time is constant.

(3B) The awakening maintenance apparatus 101 acquires the driver's eye-closing rate, and estimates that the higher the eye-closing rate is, the higher the degree of the driver's loose state is. Therefore, it is possible to easily and accurately estimate the level of the driver's moody state.
<Other embodiments>
As mentioned above, although embodiment of this indication was described, this indication is not limited to the above-mentioned embodiment, and can carry out various modifications.

(1) The display device 33 may be other than HUD. For example, the display device 33 may be an ambient lighting device.
(2) The random state estimation unit 13 may estimate the level of the random state by a method other than the method of acquiring the closed eye rate. For example, you may estimate the degree of an abrupt state from a driver's pulse wave, blood pressure, brain wave, driving condition, and combinations thereof.

  (3) The relationship between the eye closure rate and the interval time may be other than the relationship described above. For example, the relationship between the closed eye rate and the interval time may be an arbitrary function in which the interval time becomes shorter as the closed eye rate becomes higher.

  (4) In the first embodiment, if a negative determination is made in step 2, the process may be terminated. That is, it is not necessary to execute the stimulation process in the case of a red light or a traffic jam. In the second embodiment, if a negative determination is made in step 22, the process may be terminated. That is, it is not necessary to execute the stimulation process in the case of a red light or a traffic jam.

  (5) A plurality of functions of one constituent element in the above embodiment may be realized by a plurality of constituent elements, or a single function of one constituent element may be realized by a plurality of constituent elements. . Further, a plurality of functions possessed by a plurality of constituent elements may be realized by one constituent element, or one function realized by a plurality of constituent elements may be realized by one constituent element. Moreover, you may abbreviate | omit a part of structure of the said embodiment. In addition, at least a part of the configuration of the above embodiment may be added to or replaced with the configuration of the other embodiment. In addition, all the aspects included in the technical idea specified from the wording described in the claims are embodiments of the present disclosure.

  (6) In addition to the above-described wakefulness maintaining device, a system including the wakefulness maintaining device as a constituent element, a program for causing a computer to function as the wakefulness maintaining device, and a non-transitional actual record such as a semiconductor memory in which the program is recorded The present disclosure can also be realized in various forms such as a medium and a wakefulness maintaining method.

DESCRIPTION OF SYMBOLS 1,101 ... Awakening maintenance apparatus, 3 ... CPU, 5 ... Memory, 7 ... Stimulus execution unit, 9 ... Speed acquisition unit, 11 ... Control unit, 13 ... Random state estimation unit, 15 ... Time setting unit, 17 ... Display content Acquisition unit, 19 ... traffic jam judgment unit, 23 ... speed sensor, 25 ... driver camera, 27 ... vehicle exterior sensor group, 29 ... communication device, 31 ... air conditioner, 33 ... display device, 39 ... driver

Claims (7)

A wakefulness maintenance device for maintaining wakefulness of a vehicle driver,
A stimulus execution unit that executes a stimulus process for changing a display position of the visual stimulus in a left-right direction in a front view of the driver using a display device that displays a visual stimulus;
A speed acquisition unit for acquiring the speed of the vehicle;
A control unit that controls execution of the stimulus processing by the stimulus execution unit;
With
The control unit is a wakefulness maintaining device that executes the stimulation process by the stimulation execution unit when the following conditions J1 and J2 are satisfied.
J1: The time during which the speed acquired by the speed acquisition unit continuously exceeds a preset threshold speed is longer than a preset reference time.
J2: The elapsed time from the previous execution of the stimulation process by the stimulation execution unit is longer than a preset interval time. The wakefulness maintaining device according to claim 1,
A random state estimation unit for estimating the level of the driver's random state;
A time setting unit for setting the interval time to be shorter as the degree of the illusory state estimated by the illicit state estimation unit is higher,
A wakefulness maintaining apparatus further comprising: The wakefulness maintaining device according to claim 2,
The amorous state estimation unit is a wakefulness maintenance device configured to acquire the eye-closing rate of the driver and to estimate that the degree of the amorous state is higher as the eye-closing rate is higher. The wakefulness maintaining device according to any one of claims 1 to 3,
A display content acquisition unit for acquiring display content of a traffic light located in front of the vehicle;
When the display content acquired by the display content acquisition unit corresponds to a stop and the condition J2 is satisfied, the control unit further executes the stimulation processing by the stimulation execution unit. The wakefulness maintaining device according to any one of claims 1 to 4,
A traffic judgment unit for judging whether or not the vehicle is in traffic;
The control unit is a wakefulness maintaining device that further executes the stimulation process by the stimulation execution unit when the congestion determination unit determines that the vehicle is in a traffic jam and the condition J2 is satisfied. A wakefulness maintenance device for maintaining wakefulness of a vehicle driver,
A stimulus execution unit that executes a stimulus process for changing a display position of the visual stimulus in a left-right direction in a front view of the driver using a display device that displays a visual stimulus;
A control unit that executes the stimulation processing by the stimulation execution unit at intervals of time;
A random state estimation unit for estimating the level of the driver's random state;
A time setting unit for setting the interval time to be shorter as the degree of the illusory state estimated by the illicit state estimation unit is higher,
A wakefulness maintaining device comprising: The wakefulness maintaining device according to claim 6,
The amorous state estimation unit is a wakefulness maintenance device configured to acquire the eye-closing rate of the driver and to estimate that the degree of the amorous state is higher as the eye-closing rate is higher.

Images