JP6712825B2 - Navigation system, occupant monitoring device, information terminal device, server, and navigation program - Google Patents

Description

The present invention relates to a navigation system, an occupant monitoring device, an information terminal device, a server, and a navigation program.

Patent Document 1 analyzes a driver's state from an image captured by a camera mounted in a vehicle such as an automobile, detects a dangerous state such as drowsiness, looking away, and looking aside, and warns the driver. A driver situation determination device that performs

JP, 2005-108033, A

Patent Document 1 discloses that when a driver perceives a dangerous state, for example, an alarm sound is generated to give a warning to the driver. However, the driver situation determination device analyzes the state of the driver from the image taken by the driver, and only gives a warning to the driver when the driver perceives a dangerous state. It did not output the route recommended to drive according to the contents of.

The present invention has been made to solve the above problems. When an abnormality of an occupant is detected based on imaging data, it is possible to select a route recommended to travel according to the content of the abnormality. The object is to obtain a navigation system, an occupant monitoring device, an information terminal device, a server, and a navigation program that output.

A navigation system according to the present invention controls an image capturing unit that captures an image of a passenger's face to generate image capturing data, an environment information acquiring unit that acquires environmental information from a network, and based on the image capturing data, The detection unit that detects the first abnormal information indicating that the driver or the occupant of the passenger is wearing the mask, and the route from the current position of the vehicle to the set destination is searched until the destination. When the detection unit detects the first abnormal information , it avoids roads in areas where the amount of pollen or air pollutants is large, based on the environmental information acquired by the environmental information acquisition unit. a control unit for searching the first recommended route to the destination by the first recommended route is reflected retrieved in the route and the control unit to the destination and starts route guidance of the first recommended route And a display output control unit for generating and outputting screen information for selecting whether or not.

According to the present invention, when an abnormality of the occupant is detected based on the imaged data, a navigation system, an occupant monitoring device, an information terminal device, which selectively outputs a route recommended to travel according to the content of the abnormality, A server and a navigation program can be obtained.

1 is an example of a block diagram of a navigation system according to a first embodiment. 2A and 2B are diagrams showing an example of the hardware configuration of the occupant monitoring device. It shows an example of destination guidance screen information. It is an example of route selection screen information. It is another example of route selection screen information. 5A and 5B are diagrams showing an example of the hardware configuration of the information terminal device. 3 is a flowchart showing the operation of the navigation system according to the first embodiment. 7 is a flowchart showing the operation of the navigation system according to the second embodiment. FIG. 3 is a configuration diagram of a navigation system according to the first and second embodiments.

Hereinafter, in order to explain the present invention in more detail, modes for carrying out the present invention will be described with reference to the accompanying drawings.

Embodiment 1.
FIG. 1 is an example of a block diagram showing a configuration of a navigation system 1 according to the first embodiment of the present invention.

As shown in FIG. 1, the navigation system 1 includes an occupant monitoring device 2 and an information terminal device 3. The occupant monitoring device 2 is mounted on the vehicle. The information terminal device 3 is a navigation device mounted on a vehicle or a portable terminal carried by an occupant and brought into the vehicle. The mobile terminal is, for example, a portable navigation device, a tablet PC, or a smartphone. The occupant monitoring device 2 and the information terminal device 3 are connected by wire or wirelessly.

The occupant monitoring device 2 includes an imaging unit 21, an imaging control unit 22, a detection unit 23, and a communication control unit 24.
The occupant monitoring device 2 captures an image of the driver and detects the abnormal information described later. The occupant monitoring device 2 that images the driver is installed, for example, around a meter or a steering wheel. Further, the image capturing target of the occupant monitoring device 2 is not limited to the driver, and a passenger in the passenger seat or a rear seat (hereinafter referred to as a passenger) may be captured. In that case, the occupant monitoring device 2 is appropriately installed at a position where the passenger can be imaged.
In the first embodiment, a case where a driver and a passenger are imaged will be described. Hereinafter, the term "occupant" refers to a driver and a passenger.

The imaging unit 21 images the face of the occupant. The imaging unit 21 is, for example, a camera. The image pickup unit 21 also includes an infrared LED (not shown). The imaging unit 21 can image an occupant's face even at night by turning on the infrared LED. Further, as will be described later in detail, by turning on the infrared LED of the image pickup unit 21, the detection unit 23 can detect the infrared reflection intensity.

The imaging control unit 22 controls the imaging unit 21 to generate imaging data. The imaging control unit 22 outputs the imaging data to the detection unit 23.

The detection unit 23 detects the occupant's abnormality information based on the imaged data. Details of the change information will be described later. When detecting the change information, the detection unit 23 outputs the change information to the communication control unit 24.

The communication control unit 24 transmits and receives information. The communication control unit 24 transmits the abnormality information acquired from the detection unit 23 to the information terminal device 3. Further, the communication control unit 24 can be connected to the network.

In the first embodiment, the change information detected by the detection unit 23 includes (1) change information indicating that the driver or a passenger wears a mask (hereinafter referred to as first change information), (2) ) Incident information indicating that the driver or passenger is wearing sunglasses (hereinafter referred to as second incident information), (3) Incident information indicating that the driver or passenger is wearing the eye patch ( Hereinafter, referred to as third incident information), (4) incident information indicating that the eyes of the driver or the passenger are congested (hereinafter referred to as fourth incident information), (5) driver within the reference time Change information (hereinafter, referred to as fifth change information) indicating that the number of blinks of the is greater than a threshold value (hereinafter, referred to as first threshold value), (6) The driver's heart rate within the reference time is a threshold value (hereinafter, referred to as Abnormality information (hereinafter, referred to as sixth abnormal information) indicating that the driver's heart rate within the reference time is smaller than the threshold (hereinafter, referred to as third threshold). Change information (hereinafter, referred to as seventh change information). In the fifth incident information, the sixth incident information, and the seventh incident information, the reference time is, for example, 10 seconds.

When the imaging control unit 22 turns on the infrared LED of the imaging unit 21 and irradiates the driver's face with infrared light, the reflection intensity of the infrared light changes as the blood flow of the driver's face changes. The detection unit 23 measures the heart rate of the driver by detecting a change in the reflection intensity of the infrared ray based on the imaged data. Thereby, the detection unit 23 can detect the sixth abnormal information and the seventh abnormal information.

Next, a hardware configuration example of the passenger monitoring device 2 will be described.
2A and 2B are diagrams showing a hardware configuration example of the occupant monitoring device 2 according to the first embodiment.
The imaging control unit 22, the detection unit 23, and the communication control unit 24 in the occupant monitoring device 2 may be a processing circuit 100a that is dedicated hardware as shown in FIG. 2A or a memory as shown in FIG. 2B. It may be the processor 100b that executes a program stored in 100c.

As shown in FIG. 2A, when the imaging control unit 22, the detection unit 23, and the communication control unit 24 are dedicated hardware, the processing circuit 100a is, for example, a single circuit, a composite circuit, a programmed processor, or a parallel program. A processor, an ASIC (Application Specific Integrated Circuit), an FPGA (Field-programmable Gate Array), or a combination thereof is applicable. The functions of the respective units of the image pickup control unit 22, the detection unit 23, and the communication control unit 24 may be realized by the processing circuits, or the functions of the respective units may be collectively realized by one processing circuit.

As shown in FIG. 2B, when the imaging control unit 22, the detection unit 23, and the communication control unit 24 are the processor 100b, the function of each unit is realized by software, firmware, or a combination of software and firmware. The software or firmware is described as a program and stored in the memory 100c. The processor 100b realizes each function of the imaging control unit 22, the detection unit 23, and the communication control unit 24 by reading and executing the program stored in the memory 100c. That is, the imaging control unit 22, the detection unit 23, and the communication control unit 24, when executed by the processor 100b, store a program for executing steps ST2 to ST5 shown in FIG. 6 described later. The memory 100c is provided. It can also be said that these programs cause a computer to execute the procedures or methods of the imaging control unit 22, the detection unit 23, and the communication control unit 24.

Here, the processor 100b is, for example, a CPU (Central Processing Unit), a processing device, an arithmetic device, a processor, a microprocessor, a microcomputer, a DSP (Digital Signal Processor), or the like.
The memory 100c may be a nonvolatile or volatile semiconductor memory such as a RAM (Random Access Memory), a ROM (Read Only Memory), a flash memory, an EPROM (Erasable Programmable ROM), or an EEPROM (Electrically EPROM). However, it may be a magnetic disk such as a hard disk or a flexible disk, or may be an optical disk such as a mini disk, a CD (Compact Disc) or a DVD (Digital Versatile Disc).

Note that each of the functions of the imaging control unit 22, the detection unit 23, and the communication control unit 24 may be partially implemented by dedicated hardware and partially implemented by software or firmware. As described above, the processing circuit 100a in the occupant monitoring device 2 can realize the above-described functions by hardware, software, firmware, or a combination thereof.

The information terminal device 3 includes a control unit 31, a display output control unit 32, a voice output control unit 33, a communication control unit 34, an input unit 35, a vehicle position acquisition unit 36, a map data acquisition unit 37, an output unit 38, and an environment. The information acquisition unit 39 is provided.

The communication control unit 34 transmits and receives information. Further, when the communication control unit 34 receives the abnormal change information from the occupant monitoring device 2, the communication control unit 34 outputs the abnormal change information to the control unit 31. Further, the communication control unit 34 can be connected to the network.

The input unit 35 receives input of information such as a destination.
The vehicle position acquisition unit 36 receives a GPS signal from a GPS (Global Positioning System) satellite (not shown) and acquires the current position of the vehicle.
The map data acquisition unit 37 acquires map data from the map data storage unit 4. The map data acquisition unit 37 may acquire the map data from a server (not shown) outside the vehicle in which the map data storage unit 4 is provided.
The output unit 38 displays information. The output unit 38 is, for example, a display.

When the destination is input through the input unit 35 and the destination is set, the control unit 31 determines the destination from the current position of the vehicle to the destination based on the destination, the current position of the own vehicle, and the map data. Search for a route (hereinafter referred to as a destination route). The control unit 31 outputs the searched destination route, the current position of the own vehicle, and the map data to the display output control unit 32, and starts route guidance to the destination. Further, the control unit 31 outputs route guidance information to the destination to the voice output control unit 33.
The voice output control unit 33 generates voice information based on the route guidance information to the destination and outputs the voice information to the speaker 5.

Upon obtaining the destination route, the display output control unit 32 generates screen information (hereinafter referred to as destination guidance screen information) based on the destination route, the current position of the vehicle, and the map data, and outputs it to the output unit 38. Output.
FIG. 3 shows an example of destination guidance screen information. As shown in FIG. 3, the destination route screen is reflected in the destination guidance screen information.

When the control unit 31 acquires the abnormal information from the occupant monitoring device 2, the control unit 31 recommends a route to travel according to the content of the abnormal information based on the abnormal information, the current position of the own vehicle, and the map data (hereinafter, recommended route Search). It should be noted that the control unit 31 further acquires environment information, which will be described later, from the environment information acquisition unit 39, depending on the acquired change information, and searches for a recommended route also based on the environment information.
The control unit 31 outputs the searched recommended route to the display output control unit 32.

The environment information acquisition unit 39 acquires environment information from the network via the communication control unit 34. Environmental information includes pollen information and air pollution information. Pollen information is information indicating the amount of pollen scattered around the current position, around the destination route, or around the destination. The air pollution information is information indicating the amount of scattered air pollutants such as PM2.5 and yellow sand around the current position, around the destination route, or around the destination.

Upon obtaining the recommended route, the display output control unit 32 generates screen information (hereinafter referred to as route selection screen information) for selecting whether or not to start route guidance of the recommended route, and outputs the screen information to the output unit 38. In the first embodiment, the display output control unit 32 has a recommended route, a GUI (Graphical User Interface) button for selecting whether or not to start route guidance of the recommended route, a destination route, the current position of the own vehicle, And route selection screen information is generated based on the map data.
FIG. 4A shows an example of route selection screen information. As shown in FIG. 4A, the route selection screen information reflects the destination route and the recommended route. Further, as shown in FIG. 4B, the environment information acquired from the environment information acquisition unit 39 may be reflected in the route selection screen information. In this case, the control unit 31 outputs the environment information acquired from the environment information acquisition unit 39 to the display output control unit 32.

The control unit 31 determines whether or not an input to start route guidance of the recommended route has been input. The control unit 31 makes the determination based on whether the route guidance of the recommended route is input or the route guidance of the recommended route is not input via the input unit 35. To do. When the control unit 31 determines via the input unit 35 that the route guidance for the recommended route has been started, the control unit 31 outputs a route change instruction with the recommended route as the destination route to the display output control unit 32.

When the display output control unit 32 acquires the route change instruction, the display output control unit 32 generates destination guidance screen information having the recommended route as the destination route, and outputs the destination guidance screen information to the output unit 38.

Here, the recommended route searched when the control unit 31 acquires the first change information (change information indicating that the driver or the passenger wears the mask) will be described.
Upon acquiring the first change information, the control unit 31 further acquires the environment information from the environment information acquisition unit 39. As a first recommended route, the control unit 31 searches for a route to a destination while avoiding a road in an area where the amount of pollen or air pollutants scattered is large.
Here, the type of pollen changes depending on the season and the type of plants and trees. Therefore, the control unit 31 further acquires the season information and the distribution information of the plants as the environment information from the environment information acquisition unit 39, and obtains an area in which many plants that generate pollen in the current season are distributed. You may search for routes that avoid roads inside.

Next, the recommended route that the control unit 31 searches for when the second change information (change information indicating that the driver or the passenger wears sunglasses) is acquired will be described.
When the control unit 31 acquires the second change information, the control unit 31 searches for a route as a second recommended route that avoids the road where the occupant is exposed to sunlight and reaches the destination. The road where the occupant is exposed to sunlight is, for example, a road along the sea. The roads along the sea have few buildings and plants that block sunlight. In addition, the road is also exposed to reflected light from the sea surface.

Next, the control unit 31 causes the third change information (change information indicating that the driver or the fellow passenger is wearing the eye patch) or the fourth change information (the eyes of the driver or the fellow passenger are hyperemic. The recommended route to be searched when the (change information) indicating that it is acquired is acquired.
When the control unit 31 acquires the third change information or the fourth change information, the control unit 31 searches for a route to the ophthalmology around the current position, around the destination route, or around the destination as the third recommended route. ..
Further, when the third abnormality information indicates that the driver wears the eye patch, the control unit 31 travels on a road with good visibility and reaches the destination as the fourth recommended route. To search. A road with good visibility is, for example, a main road. This is because when the driver wears the eyepatch, the driver feels one-eye driving and loses the perspective.

Next, the recommended route that the control unit 31 searches for when the fifth change information (change information indicating that the number of blinks of the driver in the reference time is greater than the first threshold value) is acquired will be described.
When the fifth change information is acquired, the control unit 31 searches for a route to a place where a nap can be taken, as a fifth recommended route. This is to judge that the driver's eyes are tired and urge the driver to take a break. The place where a nap can be taken is, for example, a service area, a parking area, a hotel, or the like.

Next, the recommended route that the control unit 31 searches for when the sixth change information (change information indicating that the heart rate of the driver within the reference time is greater than the second threshold) is acquired will be described.
When the control unit 31 acquires the sixth change information, the control unit 31 searches, as a sixth recommended route, a route which is a road with a small amount of vehicle traffic and which travels on a wide road to reach a destination. This is to determine that the driver's mental state is in an excited state and calm the excited state.

Next, the recommended route searched when the control unit 31 acquires the seventh change information (change information indicating that the heart rate of the driver within the reference time is smaller than the third threshold value) will be described.
When the seventh change information is acquired, the control unit 31 searches for a route to the hospital around the current position, the destination route, or the destination as the seventh recommended route. This is to judge that the driver's health is abnormal and encourage the driver to stop by.

Next, a hardware configuration example of the information terminal device 3 will be described.
5A and 5B are diagrams showing a hardware configuration example of the information terminal device 3 according to the first embodiment.
The control unit 31, the display output control unit 32, the voice output control unit 33, the communication control unit 34, the input unit 35, the vehicle position acquisition unit 36, the map data acquisition unit 37, the output unit 38, and the environmental information in the information terminal device 3. The acquisition unit 39 may be the processing circuit 100d that is dedicated hardware as shown in FIG. 5A, or the processor 100e that executes the program stored in the memory 100f as shown in FIG. 5B. Good.

As shown in FIG. 5A, the control unit 31, the display output control unit 32, the voice output control unit 33, the communication control unit 34, the own vehicle position acquisition unit 36, the map data acquisition unit 37, and the environment information acquisition unit 39 are dedicated. In the case of hardware, the processing circuit 100d is, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC (Application Specific Integrated Circuit), an FPGA (Field-programmable Gate Array), or these. A combination of is applicable. The control unit 31, the display output control unit 32, the voice output control unit 33, the communication control unit 34, the input unit 35, the own vehicle position acquisition unit 36, the map data acquisition unit 37, the output unit 38, and the environmental information acquisition unit 39. Each of the functions may be realized by a processing circuit, or the functions of each unit may be collectively realized by one processing circuit.

As shown in FIG. 5B, the control unit 31, the display output control unit 32, the voice output control unit 33, the communication control unit 34, the vehicle position acquisition unit 36, the map data acquisition unit 37, and the environment information acquisition unit 39 are the processor 100e. If, the function of each unit is realized by software, firmware, or a combination of software and firmware. The software or firmware is described as a program and stored in the memory 100f. The processor 100e reads and executes the program stored in the memory 100f to execute the control unit 31, the display output control unit 32, the voice output control unit 33, the communication control unit 34, the vehicle position acquisition unit 36, and the map data acquisition. The respective functions of the unit 37 and the environment information acquisition unit 39 are realized. That is, the control unit 31, the display output control unit 32, the voice output control unit 33, the communication control unit 34, the vehicle position acquisition unit 36, the map data acquisition unit 37, and the environment information acquisition unit 39 are executed by the processor 100e. At times, a memory 100f for storing a program for executing steps ST6 to ST12 shown in FIG. 6 described later is provided. In addition, these programs are procedures of the control unit 31, the display output control unit 32, the voice output control unit 33, the communication control unit 34, the vehicle position acquisition unit 36, the map data acquisition unit 37, and the environment information acquisition unit 39, or It can be said that the method causes a computer to execute the method.

Here, the processor 100e is, for example, a CPU (Central Processing Unit), a processing device, an arithmetic device, a processor, a microprocessor, a microcomputer, a DSP (Digital Signal Processor), or the like.
The memory 100f may be a nonvolatile or volatile semiconductor memory such as a RAM (Random Access Memory), a ROM (Read Only Memory), a flash memory, an EPROM (Erasable Programmable ROM), or an EEPROM (Electrically EPROM). However, it may be a magnetic disk such as a hard disk or a flexible disk, or may be an optical disk such as a mini disk, a CD (Compact Disc) or a DVD (Digital Versatile Disc).

Some of the functions of the control unit 31, the display output control unit 32, the voice output control unit 33, the communication control unit 34, the own vehicle position acquisition unit 36, the map data acquisition unit 37, and the environment information acquisition unit 39 will be described. It may be realized by dedicated hardware and a part thereof may be realized by software or firmware. As described above, the processing circuit 100d in the information terminal device 3 can realize the above-described functions by hardware, software, firmware, or a combination thereof.

Next, the operation of the navigation system 1 will be described with reference to the flowchart of FIG.
When the destination is set, the control unit 31 provides route guidance to the destination (step ST1).
Next, the imaging control unit 22 controls the imaging unit 21 that images the occupant's face, generates imaging data, and outputs the imaging data to the detection unit 23 (step ST2).
Next, the detection unit 23 determines whether or not the abnormality information is detected based on the imaged data (step ST3). In step ST3, when the abnormal information is detected (step ST3; YES), the detection unit 23 outputs the abnormal information to the communication control unit 24 (step ST4).
Next, the communication control unit 24 transmits the change information to the information terminal device 3 (step ST5).
On the other hand, in step ST2, if no change information is detected (step ST3; NO), the process returns to step ST1 to guide the route to the destination.

When the control unit 31 acquires the change information, the control unit 31 searches for a recommended route (step ST6).
Next, the control unit 31 determines whether or not the recommended route for the incident information is currently the destination route (step ST7).
In step ST7, if the recommended route for the incident information is currently set as the destination route (step ST7; YES), the process returns to step ST1 to guide the route to the destination.
On the other hand, in step ST7, when the recommended route for the change information is not currently set as the destination route (step ST7; NO), the control unit 31 outputs the recommended route to the display output control unit 32 (step ST8).
Next, the display output control unit 32, upon acquiring the recommended route, generates route selection screen information and outputs it to the output unit 38 (step ST9).

Next, the control unit 31 determines whether or not an input to start the route guidance of the recommended route is input (step ST10). For example, when the output unit 38 is a touch panel type display and also serves as the input unit 35, the control unit 31 determines whether the GUI button shown in FIG. 4A, "Yes" or "No", is operated. , Make the judgment. When the input unit 35 is another device mounted on the vehicle, the control unit 31 makes the determination based on which of “Yes” or “No” is selected by the device.

When it is determined in step ST10 that the route guidance for the recommended route has been input (step ST10; YES), the control unit 31 displays the route change instruction for setting the recommended route as the destination route to the display output control unit 32. (Step ST11).
On the other hand, when it is determined in step ST10 that the route guidance of the recommended route is not started (step ST10; NO), the process returns to step ST1 and the route guidance to the destination is performed.

In step ST10, when the display output control unit 32 acquires the route change instruction, the display output control unit 32 generates new destination guidance screen information with the recommended route as the destination route, and outputs it to the output unit 38 (step ST12). Then, the process returns to step ST1 again.

In the above, the case where the control unit 31 searches one recommended route for one piece of abnormal information and outputs the recommended route in step ST8 has been described. Here, a case will be described in which, in the same step, the control unit 31 searches for a plurality of recommended routes for one piece of abnormal information and outputs the plurality of recommended routes.
In this case, in step ST8, the control unit 31 outputs the plurality of recommended routes to the display output control unit 32. Next, in step ST9, the display output control unit 32 generates the route selection screen information in order from the recommended route having the shortest travel distance from the current position to the destination among the plurality of recommended routes, for example. Output to the output unit 38. Then, in step ST10, the control unit 31 determines whether or not to start route guidance of the recommended route.

Further, a case will be described in which, in step ST8, the control unit 31 simultaneously acquires a plurality of pieces of change information, searches for a recommended route for each piece of change information, and outputs the recommended route.
In this case, in step ST8, the control unit 31 searches for a recommended route for each piece of change information and outputs a plurality of recommended routes to the display output control unit 32. At this time, the control unit 31 outputs to the display output control unit 32 information regarding which abnormal route each recommended route corresponds to. Next, in step ST9, the display output control unit 32 generates, for example, the route selection screen information of the recommended route corresponding to the change information in order for each change information, and outputs it to the output unit 38. Then, in step ST10, the control unit 31 determines whether or not to start route guidance of the recommended route. Alternatively, the priority may be set in advance for each piece of the change information, and the display output control unit 32 may generate and output the route selection screen information in descending order of priority.

As described above, the navigation system 1 according to the first embodiment controls the image capturing unit 21 that captures the image of the occupant's face, and the image capturing control unit 22 that generates the image capturing data, and the occupant's abnormality based on the image capturing data. When the detection unit 23 that detects information and the current position of the vehicle search for a route to a set destination and guide the route to the destination, and when the detection unit 23 detects the abnormality information, The control unit 31 that searches for a recommended route that recommends traveling according to the content of the change information, and the screen information that selects whether or not to start the route guidance of the recommended route searched by the control unit 31 are generated. The display output control part 32 which outputs is provided. Therefore, when an abnormality of the occupant is detected based on the imaged data, a route that recommends traveling according to the content of the abnormality is selectably output. Thereby, the occupant can select whether or not to drive the recommended route.

Embodiment 2.
The block diagram of the navigation system 1 according to the second embodiment is the same as that of the first embodiment shown in FIG.
In the navigation system 1 according to the first embodiment, the control unit 31 searches for the recommended route when the detection unit 23 detects the abnormal information while the route guidance to the destination is being performed.
In addition to the functions of the navigation system 1 according to the first embodiment, the navigation system 1 according to the second embodiment allows the detection unit 23 to perform the first operation even while the route guidance to the destination is not being performed. When the specific change information is detected from the change information in the seventh change information, the control unit 31 searches for the recommended route.

The specific abnormal information detected by the detection unit 23 and the recommended route searched by the control unit 31 when the abnormal information is acquired will be described below.
The detection unit 23 is the third change information (change information indicating that the driver or the passenger is wearing the eye patch) or the fourth change information (the eyes of the driver or the passenger are congested). When the change information indicating (1) is acquired, the control unit 31 searches for a route to the ophthalmology around the current position as the eighth recommended route.
When the detection unit 23 obtains the fifth change information (change information indicating that the number of blinks of the driver in the reference time is larger than the first threshold value), the control unit 31 determines, as the ninth recommended route, Find a route to where you can take a nap.
When the detection unit 23 acquires the seventh change information (change information indicating that the driver's heart rate within the reference time is smaller than the third threshold value), the control unit 31 determines that the current route is the tenth recommended route. Search the route around the position to reach the hospital.

Next, the operation of the navigation system 1 will be described with reference to the flowchart of FIG. The following operations are executed while route guidance to the destination is not being performed.
The image capturing control unit 22 controls the image capturing unit 21 that captures an image of the occupant's face, generates image capturing data, and outputs the image capturing data to the detecting unit 23 (step ST21).
Next, the detection unit 23 determines whether or not the abnormality information is detected based on the imaged data (step ST22). In step ST22, when the change information is detected (step ST22; YES), the detection unit 23 outputs the change information to the communication control unit 24 (step ST23).
Next, the communication control unit 24 transmits the change information to the information terminal device 3 (step ST24).
On the other hand, in step ST22, when no change information is detected (step ST22; NO), the process returns to step ST21.

Next, when the control unit 31 acquires the change information, the control unit 31 searches for a recommended route (step ST25). Then, the control unit 31 outputs the searched recommended route to the display output control unit 32 (step ST26).
Next, the display output control unit 32, when acquiring the recommended route, generates route selection screen information and outputs it to the output unit 38 (step ST27). In the second embodiment, the display output control unit 32 displays a recommended route, a GUI (Graphical User Interface) button for selecting whether to start route guidance of the recommended route, the current position of the vehicle, and map data. Based on this, route selection screen information is generated.

Next, the control unit 31 determines whether or not an input to start the route guidance of the recommended route has been input (step ST28).
When it is determined in step ST28 that the route guidance for the recommended route has been input (step ST28; YES), the control unit 31 outputs an instruction to set the recommended route as the destination route to the display output control unit 32. Yes (step ST29).
On the other hand, if it is determined in step ST28 that the route guidance of the recommended route is not started (step ST28; NO), the process returns to step ST21.

In step ST29, when the display output control unit 32 acquires the instruction to set the recommended route as the destination route, the display output control unit 32 generates destination guidance screen information in which the recommended route is set as the destination route, and outputs it to the output unit 38 (step ST30). ).
After step ST30, the process proceeds to step ST1 shown in FIG. 6, and the control unit 31 starts route guidance to the destination. After that, the operation shown in the flowchart of FIG. 6 is appropriately executed.

In the above, the case where the process proceeds to step ST1 shown in FIG. 6 after step ST30 has been described, but the present invention is not limited to this. For example, in step ST30, the display output control unit 32 generates destination guidance screen information with the tenth recommended route (route around the current position, the route leading to the hospital) as the destination route, and outputs it to the output unit 38. In such a case, the recommended route may not be searched until another abnormal information is detected until the destination is reached. This is to prioritize reaching the hospital.

As described above, according to the navigation system 1 according to the second embodiment, even when the route guidance to the destination is not performed, the recommended route is detected when a specific abnormality is detected in the occupant. Is searched, and the recommended route is output in a selectable manner. Thereby, the occupant can select whether or not to drive the recommended route.

The above description is an example of the configurations of the navigation system 1 according to the first embodiment and the navigation system 1 according to the second embodiment, and the information terminal device 3 is responsible for the functions of the respective parts of the occupant monitoring device 2. You may comprise.
For example, the function of the detection unit 23 may be configured to be included in the information terminal device 3. In this case, the information terminal device 3 performs the processes of step ST1, step ST3 to step ST12 of FIG. 6, and the processes of step ST22 to step ST30 of FIG.

Further, the function of each unit of the information terminal device 3 may be configured to be carried out by the occupant monitoring device 2. For example, the occupant monitoring device 2 may have the function of the control unit 31, the function of the display output control unit 32, the function of the own vehicle position acquisition unit 36, the function of the map data acquisition unit 37, and the function of the environment information acquisition unit 39. You may comprise. In this configuration, the occupant monitoring device 2 acquires the information input via the input unit 35 of the information terminal device 3 from the information terminal device 3. In this case, the occupant monitoring device 2 performs the processes of steps ST1 to ST12 of FIG. 6 and the processes of steps ST21 to ST30 of FIG.

FIG. 8 is a diagram showing an outline of another configuration of the navigation system 1 according to the first embodiment and the navigation system 1 according to the second embodiment.
In this configuration, the function of each part of the occupant monitoring device 2 and the function of each part of the information terminal device 3 are configured to be performed by the external server 6. The server 6 communicates with the occupant monitoring device 2 and the information terminal device 3 via the network.
The server 6 has, for example, the function of the detection unit 23, the function of the control unit 31, the function of the display output control unit 32, the function of the map data acquisition unit 37, and the function of the environment information acquisition unit 39. Further, the server 6 obtains from the information terminal device 3 the information input via the input unit 35 of the information terminal device 3 and the current position of the own vehicle acquired by the own vehicle position acquisition unit 36 of the information terminal device 3. get. In this case, the server 6 will perform the processing of step ST1, step ST3 to step ST12 of FIG. 6, and the processing of step ST22 to step ST30 of FIG.

It should be noted that, within the scope of the invention, the present invention can freely combine the respective embodiments, modify any constituent element of each embodiment, or omit any constituent element in the embodiment.

1 navigation system, 2 occupant monitoring device, 3 information terminal device, 4 map data storage unit, 5 speaker, 6 server, 21 imaging unit, 22 imaging control unit, 23 detection unit, 24 communication control unit, 31 control unit, 32 display Output control unit, 33 voice output control unit, 34 communication control unit, 35 input unit, 36 own vehicle position acquisition unit, 37 map data acquisition unit, 38 output unit, 39 environment information acquisition unit.

Claims (12)

An imaging control unit that controls the imaging unit that images the occupant's face to generate imaging data;
An environment information acquisition unit that acquires environment information from the network,
A detection unit that detects, based on the imaging data, first abnormal information indicating that a driver or an occupant of a passenger wears a mask ;
When the route from the current position of the vehicle to the set destination is searched and the route guidance to the destination is performed and the detection unit detects the first change information, the environmental information acquisition unit A control unit that searches for a first recommended route to the destination while avoiding a road in an area with a large amount of pollen or air pollutant scattering based on the environmental information acquired by
The route to the destination and the first recommended route searched by the control unit are reflected, and screen information for selecting whether to start route guidance of the first recommended route is generated and output. A navigation system, comprising: a display output control unit. An imaging control unit that controls the imaging unit that images the occupant's face to generate imaging data;
A detection unit that detects, based on the imaged data, second abnormality information indicating that a driver or an occupant of a passenger wears sunglasses ;
When the route from the current position of the vehicle to the set destination is searched and the route guidance to the destination is performed and the detection unit detects the second abnormality information, the occupant is exposed to sunlight. A control unit that searches for a second recommended route to the destination while avoiding a road that will be
The route to the destination and the second recommended route searched by the control unit are reflected, and screen information for selecting whether to start route guidance of the second recommended route is generated and output. A navigation system, comprising: a display output control unit. The imaging unit according to claim 1 or claim 2 navigation system according to characterized in that it comprises an infrared LED. The image pickup unit, the image pickup control unit, and the detection unit are provided in an occupant monitoring device mounted on a vehicle,
The navigation system according to any one of claims 1 to 3, wherein the control unit and the display output control unit are installed in a vehicle or provided in an information terminal device brought into the vehicle. An information terminal device mounted on or brought into a vehicle,
A detection unit that detects first abnormal information indicating that the occupant wears a mask , based on the imaged data generated by imaging the occupant's face;
The environment acquired from the network when the route from the current position of the vehicle to the set destination is searched and the route guidance to the destination is performed, and when the first abnormality information is detected by the detection unit A control unit for searching for a first recommended route to reach the destination while avoiding a road in an area where the amount of pollen or air pollutants scattered is large based on the information ;
The route to the destination and the first recommended route searched by the control unit are reflected, and screen information for selecting whether to start route guidance of the first recommended route is generated and output. An information terminal device, comprising: a display output control unit. An information terminal device mounted on or brought into a vehicle,
A detection unit that detects second abnormal information indicating that the occupant is wearing sunglasses , based on the imaged data generated by imaging the occupant's face;
When the route from the current position of the vehicle to the set destination is searched and the route guidance to the destination is performed and the detection unit detects the second abnormality information, the occupant is exposed to sunlight. A control unit that searches for a second recommended route to the destination while avoiding a road that will be
The route to the destination and the second recommended route searched by the control unit are reflected, and screen information for selecting whether to start route guidance of the second recommended route is generated and output. An information terminal device, comprising: a display output control unit. An occupant monitoring device mounted on a vehicle,
An imaging control unit that controls the imaging unit that images the occupant's face to generate imaging data;
A detection unit that detects first abnormal information indicating that an occupant is wearing a mask based on the imaged data;
The environment acquired from the network when the route from the current position of the vehicle to the set destination is searched and the route guidance to the destination is performed, and when the first abnormality information is detected by the detection unit A control unit for searching for a first recommended route to reach the destination while avoiding a road in an area where the amount of pollen or air pollutants scattered is large based on the information ;
The route to the destination and the first recommended route searched by the control unit are reflected, and screen information for selecting whether to start route guidance of the first recommended route is generated and output. An occupant monitoring device, comprising: a display output control unit. An occupant monitoring device mounted on a vehicle,
An imaging control unit that controls the imaging unit that images the occupant's face to generate imaging data;
A detection unit that detects second abnormal information indicating that the occupant is wearing sunglasses based on the imaged data;
When the route from the current position of the vehicle to the set destination is searched and the route guidance to the destination is performed and the detection unit detects the second abnormality information, the occupant is exposed to sunlight. A control unit that searches for a second recommended route to the destination while avoiding a road that will be
The route to the destination and the second recommended route searched by the control unit are reflected, and screen information for selecting whether to start route guidance of the second recommended route is generated and output. An occupant monitoring device, comprising: a display output control unit. It is a server that receives imaging data generated by imaging an occupant's face from an occupant monitoring device mounted on a vehicle, and transmits screen information to an information terminal device mounted on the vehicle or brought into the vehicle. hand,
A detection unit that detects first abnormal information indicating that an occupant is wearing a mask based on the imaged data;
The environment acquired from the network when the route from the current position of the vehicle to the set destination is searched and the route guidance to the destination is performed, and when the first abnormality information is detected by the detection unit A control unit for searching for a first recommended route to reach the destination while avoiding a road in an area where the amount of pollen or air pollutants scattered is large based on the information ;
The route to the destination and the first recommended route searched by the control unit are reflected, and screen information for selecting whether to start route guidance of the first recommended route is generated and output. A server comprising: a display output control unit. It is a server that receives imaging data generated by imaging an occupant's face from an occupant monitoring device mounted on a vehicle, and transmits screen information to an information terminal device mounted on the vehicle or brought into the vehicle. hand,
A detection unit that detects second abnormal information indicating that the occupant is wearing sunglasses based on the imaged data;
When the route from the current position of the vehicle to the set destination is searched and the route guidance to the destination is performed and the detection unit detects the second abnormality information, the occupant is exposed to sunlight. A control unit that searches for a second recommended route to the destination while avoiding a road that will be
The route to the destination and the second recommended route searched by the control unit are reflected, and screen information for selecting whether to start route guidance of the second recommended route is generated and output. A server comprising: a display output control unit. A computer installed in or brought into the vehicle,
A detection unit that detects first abnormal information indicating that the occupant wears a mask , based on the imaged data generated by imaging the occupant's face;
The environment acquired from the network when the route from the current position of the vehicle to the set destination is searched and the route guidance to the destination is performed, and when the first abnormality information is detected by the detection unit A control unit for searching for a first recommended route to reach the destination while avoiding a road in an area where the amount of pollen or air pollutants scattered is large based on the information ;
The route to the destination and the first recommended route searched by the control unit are reflected, and screen information for selecting whether to start route guidance of the first recommended route is generated and output. A navigation program that functions as a display output control unit. A computer installed in or brought into the vehicle,
A detection unit that detects second abnormal information indicating that the occupant is wearing sunglasses , based on the imaged data generated by imaging the occupant's face;
When the route from the current position of the vehicle to the set destination is searched and the route guidance to the destination is performed and the detection unit detects the second abnormality information, the occupant is exposed to sunlight. A control unit that searches for a second recommended route to the destination while avoiding a road that will be
The route to the destination and the second recommended route searched by the control unit are reflected, and screen information for selecting whether to start route guidance of the second recommended route is generated and output. A navigation program that functions as a display output control unit.

Images