JP5838842B2 - Information output device - Google Patents

Description

  The present invention relates to an information output apparatus.

  A technology has been proposed in which a driver's psychological state (irritability) is detected based on the accelerator pedal operation ratio, and the driver's psychological state and vehicle position information are associated with each other and notified to an information center or other vehicle ( Patent Document 1).

JP 2010-218101 A

With the technique described in Patent Document 1, even if the driver is frustrated, the frustrated emotion cannot be detected unless it appears in the driving behavior.
The present invention has been made in view of the above points, and an object of the present invention is to provide an information output device that makes it easy to detect the emotion of a vehicle occupant.

The information output device of the present invention includes a face image acquisition unit that acquires a face image of an occupant of the own vehicle, an emotion information acquisition unit that acquires emotion information representing the occupant's emotion based on the face image, and (a) an emotion Information, (b) location information of the vehicle, and (c) information group creation means for creating a group of information associated with predetermined vehicle information related to the vehicle, and output means for outputting the information group , the emotion The information acquisition means is capable of acquiring a plurality of types of emotions, and the emotion information represents any one of the plurality of types of emotions .

  According to the information output device of the present invention, it is possible to output an information group in which emotion information, position information of the own vehicle, and predetermined vehicle information related to the own vehicle are associated with each other. Therefore, if the information group is used, it is possible to acquire road conditions (there are many frustrated drivers and many smiling drivers), near-miss information, event information, and the like that cannot be acquired only by navigation information.

2 is a block diagram illustrating configurations of an information output device 1 and a navigation system 400. FIG. It is a flowchart showing the main flow of the information group output process which the information output device 1 performs. It is a flowchart showing the emotion determination process which the information output device 1 performs. It is a flowchart showing the information group creation process which the information output device 1 performs. It is a flowchart showing the output determination process which the information output device 1 performs. It is a flowchart showing the output process which the information output device 1 performs. It is a flowchart showing the main flow of the information group reception process which the information output device 1 performs. It is a flowchart in which the information output device 1 represents an information selection process. 6 is an explanatory diagram illustrating an example of a display mode of an information group in an interface unit 407. FIG. It is explanatory drawing showing AU (Action Unit) in the face of the driver 200. FIG. It is explanatory drawing showing the example of a display of an information group. 3 is a block diagram illustrating a configuration of an information output device 701. FIG.

Embodiments of the present invention will be described with reference to the drawings.
<First Embodiment>
1. Configuration of Information Output Device 1 The configuration of the information output device 1 will be described with reference to FIG. The information output device 1 is an in-vehicle device mounted on the host vehicle 100, and includes a camera (face image acquisition unit) 3, a feature amount extraction unit (emotion information acquisition unit) 5, an emotion determination unit (emotion information acquisition unit) 7, A storage unit (emotion information acquisition unit) 9, a vehicle information collection unit 11, and an information group creation unit (information group creation unit) 13 are provided.

  The camera 3 is installed on the steering column of the host vehicle 100, images the face of the driver (occupant) 200, and acquires the face image. The camera 3 also captures the driving behavior of the driver 200.

  The feature amount extraction unit 5 extracts a preset feature amount (AU) from the face image of the driver 200 and the whole body image captured by the camera 3 by image processing. Details thereof will be described later.

The emotion determination unit 7 determines the emotion of the driver 200 from the feature amount (AU) extracted by the feature amount extraction unit 5, and creates emotion information. Details thereof will be described later.
The storage unit 9 stores a database that is referred to when the emotion determination unit 7 determines emotions.

  The vehicle information collection unit 11 collects vehicle information of the vehicle 100 (predetermined vehicle information related to the vehicle) from an in-vehicle sensor 300 such as a seat sensor or an acceleration sensor. The seat sensor is installed in each seat of the host vehicle 100 and can detect whether an occupant is sitting on each seat. Moreover, it becomes possible to calculate the number of passengers of the own vehicle 100 from the detection result of the seat sensor.

  The information group creation unit 13 includes emotion information of the driver 200 determined by the emotion determination unit 7, vehicle information of the host vehicle 100 collected by the vehicle information collection unit 11, position information of the host vehicle 100 collected from the communication unit 401 described later, Link road information etc. (associate) and create information group.

2. Configuration of Navigation System 400 The information output device 1 is used together with the navigation system 400. The configuration of the navigation system 400 will be described with reference to FIG.

  Similar to the information output device 1, the navigation system 400 is a vehicle-mounted device mounted on the host vehicle 100, and includes a communication unit 401, a storage unit 403, an information selection unit 405, and an interface unit 407.

  The communication unit 401 receives navigation / VICS (registered trademark) information (position information of the own vehicle 100, traffic jam information, accident information, road regulation information) from an information center outside the vehicle or the Internet (hereinafter referred to as an information center / Internet) 500. ), Web information (event holding information, word-of-mouth information), and information groups output from other vehicles. The communication unit 401 transmits the information group of the vehicle 100 to the information center / internet 500.

  The storage unit 403 includes an information group created by the information group creation unit 13 of the own vehicle 100, an information group of other vehicles received by the communication unit 401, an output determination criterion and a display determination criterion described later input to the interface unit 407. , And the information group selected by the information selection unit 405 is stored.

  The information selection unit 405 determines the judgment criteria (output judgment criteria, display) input from the interface unit 407 for the information group created by the information group creation unit 13 of the host vehicle 100 and the information group of other vehicles received by the communication unit 401. The transmission / reception contents are selected according to the criteria. Details thereof will be described later.

  The interface unit 407 includes display means such as a liquid crystal display, and stores information groups stored in the storage unit 403 (information groups created by the information group creation unit 13 of the host vehicle 100, information on other vehicles received by the communication unit 401). Group), the information selected by the information selection unit 405 is displayed. Further, the interface unit 407 includes an input button or a voice input unit, and the driver 200 can input a determination criterion used in the information selection unit 405 by using the input button or the voice input unit.

Instead of the navigation system 400, a mobile terminal (for example, a smartphone) having the same configuration may be used.
2. Information group output processing executed by the information output device 1 and the navigation system 400 The information group output processing repeatedly executed by the information output device 1 and the navigation system 400 every predetermined time will be described with reference to the flowcharts of FIGS.

  In step 1 of FIG. 2, an output determination criterion input by the driver 200 is acquired for the interface unit 407. The output determination criterion is related to the emotion information of the driver 200, and one or more of the following (A-1) to (A-4) are selected, and (A-5) is selected. There are cases where it has been.

(A-1) Sending smile (joy) (A-2) Sending anger (irritated) (A-3) Sending surprise (near hat) (A-4) Sending drowsiness (A-5) No emotion is transmitted. In step 1, additional information conditions input by the driver 200 to the interface unit 407 are also acquired. The additional information conditions include (B) the number of passengers (vehicle information), (C) the location information item of the host vehicle 100, and (D) the surrounding information item.

(B) In the item of the number of passengers, one of the following (B-1) to (B-3) is selected.
(B-1) Disclosure of the number of passengers (B-2) Disclosure when the number of passengers is X or more (X is a natural number)
(B-3) The number of passengers is not disclosed. In (C) the position information item of the host vehicle 100, any one of the following (C-1) to (C-2) is selected.

(C-1) The latitude and longitude of the host vehicle 100 are disclosed. (C-2) The area where the host vehicle 100 is present is disclosed. In the item of (D) peripheral information, the following (D-1) to (D -2) is selected.

(D-1) Add Peripheral Information (D-2) Do Not Add Peripheral Information In Step 2, the output judgment criteria and additional information conditions acquired in Step 1 are stored in the storage unit 403.

  In step 3, emotion determination processing for acquiring emotion information representing the emotion of the driver 200 based on the face image of the driver 200 is executed. This emotion determination process will be described with reference to FIG. In step 11 of FIG. 3, the camera 3 repeatedly acquires the face image of the driver 200 every predetermined time.

  In step 12, a facial feature (for example, eyebrows, eyelids, mouth) is extracted by performing image analysis on each of the face images of the driver 200 repeatedly obtained in step 11, and further, the passage of time The motion of the characteristic part (hereinafter referred to as AU (Action Unit)) associated with is extracted. Examples of AU include those shown in Table 1 and FIG. Note that R and L in FIG. 10 mean right and left in the face.

It is known that there is a correlation between human emotion and AU (Facial Action Coding System advocated by Ekman).
In step 13, the emotion of the driver 200 is determined from the AU extracted in step 12. Specifically, it is as follows. The storage unit 9 stores in advance a database showing the correspondence between AU and emotion. This database stores, for example, the following correspondences.

Joy: 6R, 6L, 12R, 12L, 25
Surprise: 1R, 1L, 2R, 2L, 5R, 5L, 25, 27
Sorrow: 1R, 1L, 4R, 4L, 15R, 15L, 17
By applying the AU extracted in step 12 to this database, the emotion of the driver 200 can be determined.

  Returning to FIG. 2, in step 4, information group creation processing is executed. This information group creation processing will be described with reference to FIG. In step 21 of FIG. 4, the determination result of step 13 is acquired as emotion information of the driver 200.

  In step 22, vehicle information of the vehicle 100 is acquired from the vehicle information collection unit 11. The vehicle information includes the number of passengers in the vehicle 100, the temperature inside the vehicle, the selection of radio stations, the type of music being listened to, and the like. The number of passengers can be detected by a seat sensor provided on each seat of the host vehicle 100.

  In step 23, the position information (navigation / VICS information) of the own vehicle 100, the surrounding information of the own vehicle 100 (congestion information (navigation / VICS information), accident information (navigation / VICS information), road, etc. Regulation information (Navi / VICS information), event holding information (Web information), word of mouth (Web information), Twitter (registered trademark) information (Web information), Facebook (registered trademark) information (Web information)).

  In step 24, the emotion information acquired in step 21, the vehicle information acquired in step 22, and the position information and surrounding information of the vehicle 100 acquired in step 23 are linked to create an information group.

In step 25, the information group created in step 24 is stored in the storage unit 403.
Returning to FIG. 2, in step 5, an output determination process is executed. This output determination process will be described with reference to FIG.

In step 31, the information group stored in step 25 is called from the storage unit 403.
In step 32, the output judgment criterion stored in step 2 is called from the storage unit 403.

  In step 33, the information group called in step 31 and the output determination means called in step 32 are collated to determine whether or not they match. That is, when the emotion included in the emotion information in the information group corresponds to one of the emotions selected by the output criteria (smiling (joy), anger (irritated), surprise (near hat), sleepiness) , It is determined to match, otherwise it is determined not to match. If it is determined that the information group matches the output determination criteria, the process proceeds to step 34, and if it is determined that the information group does not match, the process is terminated.

  In step 34, the information to be added is determined based on the additional information condition input in step 1 for the information group determined in step 33 to meet the output determination criteria. For example, regarding the number of passengers included in the information group, the item of the number of passengers in the additional information condition ((B-1) publicly disclose the number of passengers, (B-2) public if the number of passengers is X or more, (B- 3) Decide whether or not to add the number of passengers based on whether the number of passengers is not disclosed. In addition, regarding the position information included in the information group, the position information item ((C-1) the latitude and longitude of the own vehicle 100 in the additional information condition is disclosed, and (C-2) the area where the own vehicle 100 exists is disclosed. The position information addition mode is determined based on any one of the above. Further, for peripheral information included in the information group, based on the peripheral information item ((D-1) Add peripheral information or (D-2) Do not add peripheral information) in the additional information condition. Then, it is determined whether to add peripheral information.

  Returning to FIG. 2, in step 6, output processing is executed. This output process will be described with reference to FIG. In step 41 of FIG. 6, the information group determined to have matched the output determination criteria in step 33 is acquired.

  In step 42, the information group acquired in step 41 is displayed on the interface unit 407. At this time, in step 34, information determined to be added (passenger number, peripheral information) is displayed, and information determined not to be added is not displayed.

  In step 43, it is determined whether or not the interface unit 407 has received an instruction to refuse to transmit the information group displayed in step 42. When there is no refusal instruction, the process proceeds to step 44, and when there is a refusal instruction, this process is terminated. It should be noted that the driver 200 can input to the interface unit 407 refusing transmission by looking at the information displayed on the interface unit 407 in step 42.

  In step 44, the information group displayed on the interface unit 407 in step 42 is transmitted to the information center / internet 500 via the communication unit 401. Other vehicles receive the information group from the information center Internet 500. Note that the information group may be transmitted directly from the own vehicle 100 to another vehicle without using the information center / internet 500.

Returning to FIG. 2, in step 7, it is determined whether or not the vehicle 100 is traveling. If the host vehicle 100 is traveling, the process proceeds to step 3; otherwise, the process is terminated.
The output criteria can be changed or reset at any time. If the driver 200 changes or resets the output determination criteria during the process shown in FIG. 2, the process is interrupted at that point, and the process starts again from step 1.

3. Information group reception processing executed by the information output device 1 and the navigation system 400 The information group reception processing repeatedly executed by the information output device 1 and the navigation system 400 every predetermined time will be described with reference to the flowcharts of FIGS. The process of FIG. 7 is processed in parallel independently of the process of FIG.

  In step 51 of FIG. 7, the display determination criterion input by the driver 200 is acquired for the interface unit 407. The display criteria include (E) emotion information item, (F) vehicle information (passenger number) item, (G) peripheral information item, and (H) position information item.

  (E) About the item of emotion information, when any one of the following (E-1), (E-6), and (E-7) is selected, and (E-2)-( One or more of E-5) may be selected.

(E-1) Display all emotions (E-2) Display smile (joy) (E-3) Display anger (irritated) (E-4) Display surprise (near-miss) (E- 5) Display sleepiness (E-6) Automatic mode (E-7) Do not display any emotions Here, (E-6) Automatic mode refers to the emotions of the driver 200 acquired in step 13 described above. Emotions associated in advance are set. For example, when a smile (joy) is detected in step 13, (E-6) “(E-2) display smile (joy)” associated with the automatic mode is selected as the automatic mode. (Display determination standard setting means). In the (E-6) automatic mode, the emotion associated with the emotion of the driver 200 acquired in step 13 is not limited to the same emotion, and can be arbitrarily set. Further, a plurality of emotions may be associated with the emotion of the driver 200 acquired in step 13.

In the item of (F) vehicle information, any one of the following (F-1) to (F-3) is selected.
(F-1) Display the number of passengers (F-2) Display when the number of passengers is X or more (X is a natural number)
(F-3) The number of passengers is not displayed. Also, in the item of (G) peripheral information, one of the following (G-1) to (G-2) is selected.

(G-1) Display surrounding information (G-2) Do not display surrounding information Moreover, in the item of (H) position information, either one of the following (H-1) and (H-5) One is selected, and one or more are selected from (H-2) to (H-4).

(H-1) Display all roads (H-2) Display highways / automobile roads (H-3) Display general roads (H-4) Display roads that are congested (from VICS information) H-5) No road is displayed In addition, conditions such as “display only roads on the navigation screen” and “display only roads within a radius α km from the own vehicle 100” may be added to the position information.

  In step 51, (I) display method input to the interface unit 407 by the driver 200 is also acquired. (I) In the item of display method, one of the following (I-1) and (I-2) is selected.

(I-1) Individual display (I-2) Aggregation display Note that (I-2) Aggregation display is subject to the conditions of “when there are more than Y units in succession” and “when more than Z% is included in a predetermined section”. be able to. In addition, examples of the aggregate display include a belt-like display and a shade change display.

In step 52, the display criterion and display method acquired in step 51 are stored in the storage unit 403.
In step 53, an information group of other vehicles (information group output from the other vehicles) is received from the information center / internet 500 via the communication unit 401. The information center / internet 500 receives information groups from a plurality of vehicles (including the host vehicle 100), and distributes the received information groups to each vehicle. The information group of other vehicles may be directly received from other vehicles without going through the information center / internet 500.

In step 54, the information group of the other vehicle received in step 53 is stored in the storage unit 403.
In step 55, the contents of the information group displayed on the interface unit 407 of the host vehicle 100 are selected from the information group of other vehicles stored in step 54. This process will be described with reference to FIG.

In step 61 of FIG. 8, the information group of other vehicles stored in step 54 is called from the storage unit 403.
In step 62, the display criteria and display method stored in step 52 are called from the storage unit 403.

  In step 63, the information group of the other vehicle called in step 61 is compared with the display determination standard called in step 62. The comparison is performed for each element of the information group (emotion information, position information of the own vehicle 100, vehicle information, and surrounding information). That is, the emotion information in the information group is compared with the item (E) emotion information in the display determination criterion, and it is determined whether or not the criterion is satisfied. Further, the position information of the vehicle 100 in the information group is compared with the item of (H) position information in the display determination criterion, and it is determined whether or not the criterion is satisfied. In addition, the vehicle information in the information group is compared with the item (F) vehicle information in the display determination criterion, and it is determined whether or not the criterion is satisfied. Further, the peripheral information in the information group is compared with the item (G) peripheral information in the display determination criterion, and it is determined whether or not the criterion is satisfied.

  In step 64, information to be displayed is selected based on the comparison result in step 63. That is, if each of the emotion information, the position information of the own vehicle 100, the vehicle information, and the surrounding information constituting the information group matches the display determination criteria, it is selected to be displayed. , Do not select.

  Returning to FIG. 7, in step 56, the information group of the other vehicle is displayed on the interface unit 407. At this time, only the contents selected to be displayed in step 64 are displayed.

  An example of the display mode of the information group is shown in FIG. In this example, emotion information is selected to be displayed. Each face type marker 600 displayed on the map image 700 in the interface unit 407 represents one information group (that is, one other vehicle). The marker 600 includes a marker 600a representing emotion information of smile (joy) and a marker 600b representing emotion information of anger (irritability). In addition, there are markers that represent surprise emotion information, markers that represent sleepiness emotion information (both not shown), and the like. If the emotion information is not selected to be displayed, the same marker is always displayed regardless of the emotion information.

The position of each marker 600 represents the position of the corresponding information group (the position on the map of the other vehicle that transmitted the information group (vehicle position information)).
In the example shown in FIG. 9, vehicle information (passenger number) is selected to be displayed. The size of each marker 600 is proportional to the number of passengers in the corresponding information group, and the size of the marker 600 increases as the number of passengers increases. If vehicle information is not selected to be displayed, the same size marker is always displayed regardless of the vehicle information.

  A triangular portion 601 attached to the marker 600 represents the traveling direction of the marker 600 (the traveling direction of another vehicle that has transmitted the information group corresponding to the marker 600). The traveling direction can be determined based on which lane the other vehicle exists on the road.

  In the example shown in FIG. 9, peripheral information is selected to be displayed. When the information group includes peripheral information, a peripheral information display area 603 for displaying the peripheral information is formed in the vicinity of the marker 600 corresponding to the information group. If the peripheral information is not selected to be displayed, the peripheral information is not displayed even if the information group includes the peripheral information.

  Further, the map image 700 is provided with a peripheral information button 604. When the surrounding information button 604 is pressed while the host vehicle 100 is stopped, detailed information about the surrounding area is displayed on the interface unit 407.

  In the step 51, when “(I-2) consolidated display” is selected for the item of “(I) display method”, other vehicles having the same emotion information have a predetermined number (predetermined number) within a predetermined section. If the ratio is higher than the above, the display of the plurality of markers 600 becomes a band-shaped aggregated display 605.

Returning to FIG. 7, in step 57, it is determined whether or not the host vehicle 100 is traveling. When the host vehicle 100 is traveling, the process proceeds to step 53, and when it is not traveling, this process is terminated.
The display criteria can be changed or reset at any time. If the driver 200 changes or resets the display determination criteria during the process shown in FIG. 7, the process is interrupted at that point and the process starts again from step 51.

4). Effects produced by the information output device 1 (1) The information output device 1 can output an information group in which emotion information, position information of the vehicle 100, vehicle information, and surrounding information are associated with each other. Therefore, using the information group, it is possible to acquire road conditions (many frustrated drivers, many smiling drivers), near-miss information, event information, etc. that cannot be acquired only by navigation information (see FIG. 11). ). For example, when emotion information in a plurality of other vehicles running on a crowded road is a smile (joy), it is possible to infer a situation such as a beautiful scenery around the area or an event being held in the vicinity.
(2) Since the number of passengers is included in the information group output by the information output device 1, the information group can be selected based on the number of passengers. As a result, it becomes possible to select a route suitable for the situation and purpose of the vehicle 100 (for example, commuting, family trip, shopping, etc.). For example, when the vehicle 100 is traveling only by the driver 200 (one person), the information group transmitted from the other vehicle having one person is selected, and based on the driver's emotion information in the information group, You can get information on stores and events that are good for traveling alone, with less frustrating routes even if you run alone.
<Second Embodiment>
1. Configuration of Information Output Device 701 and Process to be Performed As shown in FIG. 12, the information output device 701 in the second embodiment is a combination of the information output device 1 in the first embodiment and the navigation system 400. It has a configuration. That is, the information output device 701 has a configuration of the information output device 1 in the first embodiment, a communication unit (reception unit) 401, a storage unit 403, an information selection unit (output determination unit, display determination unit) 405, and An interface unit (display means) 407 is provided.

  The information output device 701 executes the same processing as the information output device 1 and the navigation system 400 in the first embodiment. In FIG. 12, the configuration having the same reference numeral as that of the first embodiment has the same configuration as that of the first embodiment.

2. Effect produced by the information output device 701 (1) The information output device 701 produces the same effect as the information output device 1 in the first embodiment.
(2) The information output device 701 can select and display information that matches the display determination criteria from the information group transmitted from the other vehicle by the information selection unit 405. Therefore, it is possible to efficiently acquire and display information suitable for the purpose of the driver 200 (for example, to avoid a frustrating route or to go to an interesting place).
(3) The information output device 701 can use the information selection unit 405 to select and transmit information that matches the output determination criteria from the information group created by the host vehicle 100. Therefore, it is possible to prevent output of information that is not desired to be disclosed to other vehicles.

In addition, this invention is not limited to the said embodiment at all, and it cannot be overemphasized that it can implement with a various aspect in the range which does not deviate from this invention.
For example, the camera 3 may be installed on the roof of the host vehicle 100 and can capture a face image of not only the driver 200 but also another occupant (for example, everyone other than the driver 200). In this case, emotions can be acquired for each of a plurality of occupants (for example, all occupants), and the average emotion or the most emotion can be used as emotion information of the vehicle 100.

  Further, even if emotion information is accumulated in the information center / internet 500 or the own vehicle 100 and a location where many drivers frequently show similar emotions is displayed based on the frequency of occurrence of the accumulated emotion information. Good (for example, a street with many near misses).

  Further, the information group can include detection information of rainfall in each vehicle. Rain can be detected by a raindrop sensor provided in each vehicle.

DESCRIPTION OF SYMBOLS 1,701 ... Information output device, 3 ... Camera, 5 ... Feature-value extraction part,
7 ... emotion determination unit, 9 ... storage unit, 11 ... vehicle information collection unit,
13 ... information group creation unit, 100 ... own vehicle, 200 ... driver,
300 ... vehicle-mounted sensor, 400 ... navigation system,
401 ... Communication unit, 403 ... Storage unit, 405 ... Information selection unit,
407: Interface unit, 500: Information center / Internet,
600, 600a, 600b ... marker, 601 ... triangular part,
603 ... Peripheral information display area, 604 ... Peripheral information button,
605 ... Integrated display, 700 ... Map image

Claims (7)

A face image acquisition means (3) for acquiring a face image of an occupant (200) of the host vehicle (100);
Emotion information acquisition means (5, 7, 9) for acquiring emotion information representing the passenger's emotion based on the face image;
(A) information group creating means (13) for creating an information group in which the emotion information, (b) position information of the own vehicle, and (c) predetermined vehicle information related to the own vehicle are associated with each other;
Output means (13, 401) for outputting the information group;
Equipped with a,
The emotion information acquisition means is capable of acquiring a plurality of types of emotions, and the emotion information represents any one of the plurality of types of emotions (1, 701) .   2. The information output device according to claim 1, wherein the information group creating means creates an information group in which the information of (a) to (c) and (d) the surrounding information of the own vehicle are associated with each other. 3. The position display unit according to claim 1, further comprising a position display unit configured to store the emotion information and display a position where emotion information representing the same emotion frequently occurs based on the stored emotion information. Information output device. Output judgment means (405) for judging whether to output the information group created by the information group creation means of the own vehicle based on a preset output judgment criterion,
And the output means, the information output device according to any one of claims 1-3, characterized in that outputs the information group has been decided to output by the output determination means. Receiving means (401) for receiving the information group output from another vehicle;
Display means (407) for displaying the information group received by the receiving means;
The information output device according to any one of claims 1 to 4 , further comprising: Display judgment means (405) for judging whether to display the information group received by the reception means based on a preset display judgment criterion,
6. The information output apparatus according to claim 5 , wherein the display means displays the information group determined to be displayed by the display determination means. 7. The information output apparatus according to claim 6, further comprising a display determination criterion setting unit (405) for setting the display determination criterion based on the emotion information acquired by the emotion information acquisition unit of the own vehicle.