WO2024042359A1

WO2024042359A1 - Information processing method and information processing device

Info

Publication number: WO2024042359A1
Application number: PCT/IB2023/000484
Authority: WO
Inventors: 睿申夏; 美友紀茂田
Original assignee: 日産自動車株式会社; ルノーエス．ア．エス．
Priority date: 2022-08-26
Filing date: 2023-08-16
Publication date: 2024-02-29

Abstract

An information processing method that provides notification information to users using an agent apparatus having a display unit for displaying face images. The information processing method includes a control process for controlling the display form of the display unit. In the control process, when the display unit is caused to display notification information, switchover rendering using the display unit is executed, and the notification information is shown by the display unit after the display of a face image is erased.

Description

Information processing method and information processing device

The present invention relates to an information processing method and an information processing apparatus for notifying users of information.

Conventionally, there are robots that can communicate with users. For example, a device has been proposed that communicates with a user by displaying information such as a character string on a display device that displays a facial image (for example, see JP2019-124855A).

With the above-mentioned conventional technology, it is possible to gradually change the facial image, completely hide the facial image, and display information such as character strings on the display device. Here, a case is assumed in which information to be notified (notification information) is displayed on a display device on which a face image that gives the user a feeling of being alive is displayed. In this case, there is a risk that the creature-likeness may be insufficient after the time of switching from the information (face image) that makes the information feel like a living thing to the notification information that does not make it feel like a living thing. In such a case, it is assumed that interest in the notification information displayed on the display device decreases due to the lack of life-like appearance, and there is also a possibility that it becomes difficult to appropriately notify the user of the notification information. Therefore, when displaying information that should be reported to the user, it is important to increase the user's interest in the information being reported at the time of switching, and to notify the user of that information more appropriately. be.

The purpose of the present invention is to more appropriately notify users of information.

One aspect of the present invention is an information processing method that provides notification information to a user using an agent device that has a display device that displays a facial image. This information processing method includes a control process that controls the display mode of the display device, and in this control process, when displaying notification information on the display device, a switching effect using the display device is executed, and a face After erasing the image display, the notification information is displayed.

FIG. 1 is a diagram showing a simplified example of the configuration of the interior of a vehicle. FIG. 2 is a simplified front view showing an example of the external configuration of the agent device. FIG. 3 is a diagram showing an example of the system configuration of an information processing system installed in a vehicle. FIG. 4 is a diagram showing an example of transition when providing notification information using two display units. FIG. 5 is a diagram showing an example of transition when providing notification information using two display units. FIG. 6 is a diagram showing an example of transition when providing notification information using two display units. FIG. 7 is a diagram illustrating a transition example in the case where notification information is provided using two display sections that are realized using a flat display panel that is rotatably provided on the face. FIG. 8 is a diagram showing an example of transition when providing notification information using a slideable display section and a fixed display section. FIG. 9 is a diagram illustrating an example of transition when providing notification information using two display units. FIG. 10 is a diagram showing an example of transition when providing broadcast information using one display unit. FIG. 11 is a flowchart illustrating an example of broadcast information output processing in the information processing device. FIG. 12 is a flowchart illustrating an example of broadcast information output processing in the information processing device. FIG. 13 is a flowchart illustrating an example of broadcast information output processing in the information processing device.

Embodiments of the present invention will be described below with reference to the accompanying drawings.

[Example of agent device installation]
FIG. 1 is a diagram showing a simplified example of the configuration of the interior of a vehicle C1. Note that FIG. 1 shows an example of the external appearance when the front side of the driver's seat and passenger seat (not shown) is viewed from the rear side of the vehicle C1. Further, in FIG. 1, for ease of explanation, illustrations other than the dashboard 2, steering wheel 3, front window 4, rearview mirror 5, camera 101, and agent device 200 are omitted.

The agent device 200 is a small robot installed on the dashboard 2 of the vehicle C1. In this embodiment, an example is shown in which the agent device 200 is a robot imitating a human. Note that although FIG. 1 shows an example in which the agent device 200 is installed on the dashboard 2, the present invention is not limited to this. For example, the agent device 200 may be installed above the front window 4. Further, although FIG. 1 shows an example in which the agent device 200 is a robot imitating a human, the present invention is not limited to this. For example, robots imitating animals such as rabbits, pigs, etc., robots imitating virtual creatures (e.g. the faces of anime characters), robots imitating other objects (e.g. television-type devices, radio-type devices) A robot may be used as the agent device 200. In this way, it is possible to use a simulated agent as the agent device 200.

The agent device 200 executes various operations based on instructions from the information processing device 110 (see FIG. 3). For example, the agent device 200 outputs various information related to driving support when the user performs a driving operation based on the control of the information processing device 110. As this driving support, notification of a moving object in front or behind is assumed. For example, as a notification of a moving object ahead, it is possible to output a voice saying, ``There is a railroad crossing ahead, so be careful,'' or a voice saying, ``There are people ahead.'' In this way, the agent device 200 performs driving assistance.

Here, notification means to convey or inform some kind of information. Further, information to be notified to the user of the vehicle C1 (occupant of the vehicle C1) will be referred to as notification information and will be described. The notification information may be communicated to the user through image display or audio output. This embodiment mainly shows an example in which notification information is conveyed to the user by displaying an image. Note that the notification shown in this embodiment may also be referred to as notification, transmission, or the like.

The camera 101 is installed on the ceiling inside the vehicle C1, and captures an image of a subject inside the vehicle C1 to generate an image (image data). Note that the camera 101 is configured by, for example, one or more camera devices or image sensors capable of capturing an image of a subject. For example, the camera 101 can be provided above the front window 4, that is, above the rearview mirror 5. Although FIG. 1 shows an example including at least one camera 101, it is also possible to include two or more imaging devices and use images from all or part of these imaging devices. Further, the installation location of each imaging device is not limited to the example shown in FIG. 1, and can be changed as appropriate. Alternatively, one or more devices, such as a 360-degree camera, may be used that can capture objects present in all directions of the vehicle C1 and objects inside the vehicle C1.

[Example of external configuration of agent device]
FIG. 2 is a simplified front view showing an example of the external configuration of the agent device 200. As shown in FIG. In this embodiment, when the agent device 200 is in the on state, a face image, notification information, etc. are displayed on the display unit 210. Note that it is possible to turn on the agent device 200 in response to a turn-on operation of the vehicle C1. Further, the agent device 200 can be turned on in response to a user operation regarding the agent device 200. Note that the on/off operation of the vehicle C1 means an on or off operation of a start key related to starting or stopping the vehicle C1.

FIG. 2(A) shows a front view of the agent device 200 in a normal state. The agent device 200 includes a substantially box-shaped body part 202 and a substantially box-shaped face part 201 arranged vertically via a connecting part 203. Further, the face section 201 is provided with a display section 210 that displays various images. A body image showing the body is displayed on the surface of the body part 202. As the display section 210, various display media such as a light emitting sheet, a liquid crystal display, an organic EL (Electro Luminescence), etc. can be used. Further, the connecting portion 203 is recognized as a portion corresponding to the neck of a living creature.

The display section 210 of the face section 201 displays various parts that make up the agent's face, such as eyes 211, nose 212, and mouth 213. In this embodiment, an example is shown in which the agent device 200 is installed on the dashboard 2 of the vehicle C1 in a direction in which the eye portion 211 looks inside the vehicle. In addition, the side where the display unit 210 of the agent device 200 is provided will be referred to as the front side of the agent device 200, and the side opposite to the front side of the agent device 200 will be referred to as the rear side of the agent device 200. In the agent device 200, the left side in FIG. 2 will be referred to as the right side of the agent device 200, and the right side in FIG. 2 will be referred to as the left side of the agent device 200.

FIG. 2(B) shows a front view of the agent device 200 with each part of the face 201 facing left. FIG. 2C shows a front view of the agent device 200 with each part of the face section 201 facing to the right. As shown in FIG. 2(B), by moving the eye part 211 to the left side, moving the black eye part of the eye part 211 to the left side, and making the mouth part 213 into an oval shape that is elongated in the vertical direction, the eye part 211 is turned to the left side. It is possible to make the facial expression 201 look like this. In addition, as shown in FIG. 2C, the eye part 211 is moved to the right side, the black part of the eye part 211 is moved to the right side, and the mouth part 213 is made into an oval shape that is elongated in the vertical direction. It is possible to make the expression of the face part 201 facing the direction.

FIG. 2(D) shows a front view of the agent device 200 in a state where the face section 201 is expressing an effect to make the user feel like a living thing as a switching effect before displaying the notification information. show. As an effect to make the object feel like a living thing, for example, it is possible to use a display that conveys a surprised expression to the user.

For example, as shown in FIG. 2(D), the eye portion 211 is formed into an oval shape that is long in the vertical direction, the black part of the eye portion 211 is moved downward, and the mouth portion 213 is formed into an oval shape that is long in the vertical direction. By doing so, it is possible to make the expression of the face part 201 look surprised. Furthermore, by displaying an exclamation mark image 214 to draw attention or outputting surprising audio information, it is possible to express a state of being even more surprised. As a result, it is assumed that the user is surprised by the agent device 200 and turns his attention to the display unit 210 to see if something will happen in the future. Furthermore, by making the agent device 200 look surprised, it is possible to make the user feel like a living thing. This makes it possible to direct the user's attention to the display unit 210 and increase the user's interest in displaying the notification information. In this way, it is possible to draw the user's attention by making use of biological functions such as eyes, nose, mouth, etc. as an effect to make the user feel like a living thing. In other words, these effects can also be understood as effects for guiding the user's attention.

In this way, by performing effects using various images such as the exclamation mark image 214, it is possible to further attract the user's attention. Furthermore, various effects such as effects using movements of the face part 201 may be performed to attract the user's attention by using other means than images such as the exclamation mark image 214, for example, effects using movements of the face part 201. The effects using the movement of the face 201 of the agent device 200 will be described in detail with reference to FIGS. 5 to 9.

FIGS. 2(E) and 2(F) show front views of the agent device 200 in a state where notification information (notification images 400, 410) is displayed on the display unit 210. FIG. 2E shows an example of displaying a notification image 400 on the display unit 210 for notifying the user of fastening the seat belt. Further, FIG. 2F shows an example in which a notification image 410 for notifying that the remaining battery level of the vehicle C1 is decreasing is displayed on the display unit 210. Note that these broadcast information are just examples, and other information may be displayed as the broadcast information. For example, a notification image may be displayed on the display unit 210 to notify that any door of the vehicle C1 is ajar. As notification information regarding this ajar door, image information indicating the door can be displayed on the display unit 210.

Note that the shape, display mode, and voice output mode of these agent devices 200 are merely examples, and other shapes, display modes, and voice output modes are also possible. Further, although FIG. 2 shows an example in which the face part 201 and the body part 202 are configured as separate bodies, the face part 201 and the body part 202 may be configured as an integrated housing.

In addition, in this embodiment, an example is shown in which a face image is displayed as an image representing a creature-like appearance (living creature display), but other images (for example, the agent's whole body, a mechanical object, a virtual face) are displayed as a creature-like image. It may be displayed as an image representing.

Here, since the agent device 200 installed on the dashboard 2 is a three-dimensional anthropomorphic robot, it is assumed that its presence is recognized by the user of the vehicle C1. For this reason, for example, when notifying the user of the vehicle C1 of some information, it is conceivable to do so using the agent device 200. For example, it is conceivable that the display unit 210, which previously displayed a face image that gives the user a feeling of being a living creature, may switch from the face image to display information. For example, at the timing when the face image shown in any one of FIGS. 2(A) to (C) is displayed on the display unit 210, the notification information shown in either FIG. 2(E) or (F) is displayed on the display unit 210. It is conceivable to display it in In this case, there is a risk that the facial image may lack the appearance of a living creature after the transition from the face image that gives the impression of a living creature to the notification information that does not give the impression of a living creature. In such a case, it is assumed that interest in the notification information displayed on the display unit 210 decreases due to the lack of living creature-likeness, and it may become difficult to appropriately notify the user of the notification information. Therefore, when displaying notification information, by making the user feel like a living thing when switching between notifications, it increases the user's interest in displaying the notification information and allows the notification information to be conveyed more appropriately to the user. It is important to inform.

Therefore, in the present embodiment, when displaying notification information on the display section 210, after performing a switching effect using the display section 210 and erasing the display of the face image on the display section 210, display the notification information. For example, at the timing when the face image shown in any one of FIGS. 2(A) to (C) is displayed on the display unit 210, the notification information shown in either FIG. 2(E) or (F) is displayed on the display unit 210. In the case of displaying the notification information, the switching effect is executed by displaying the face image shown in FIG. 2(D) on the display unit 210 before displaying the notification information. In this way, by performing a switching effect that makes the user feel like a living creature before the notification information is displayed, the user's interest in the notification information being displayed is increased, and the notification information is conveyed more appropriately to the user. It becomes possible to notify.

Note that the switching effect shown in FIG. 2 is an example, and other switching effects may be performed. For example, FIG. 10 shows another example of switching effect using the same display screen. Furthermore, for example, in addition to the switching effect using the same display screen, a switching effect using a plurality of display screens may be performed. An example of this is shown in FIG. These switching effects can be executed by switching processing using software. Moreover, these switching effects make it possible to exclusively display the face image and the notification information.

Furthermore, for example, a switching effect using physical movement of the face part 201 may be performed. Examples of this are shown in FIGS. 5 to 9. These switching effects can be executed by switching processing using physical movements such as rotation and parallel movement. Moreover, these switching effects make it possible to exclusively display the face image and the notification information. Note that even when performing a switching effect using these physical movements, it is possible to make the display position of the face image and the display position of the notification information the same. In this case, the notification information is displayed at the position of the face image after the switching effect that makes the user feel like a living thing, so it is possible to further increase the user's interest in the notification information, and the notification information It becomes possible to notify the user more appropriately.

[Configuration example of information processing system]
FIG. 3 is a diagram showing an example of the system configuration of the information processing system 100 installed in the vehicle C1.

The information processing system 100 includes a camera 101, a position information acquisition sensor 102, an audio input unit 103, sensors 104, an information processing device 110, and an agent device 200. Note that the information processing device 110 and the agent device 200 are connected by a communication method using wired communication or wireless communication. Further, the information processing device 110 is connected to the network 20 by a communication method using wireless communication. The network 20 is a network such as a public line network or the Internet. Note that the agent device 200 may also be connected to the network 20 using a communication method using wireless communication. Although FIG. 3 shows an example in which the information processing device 110 and the agent device 200 are configured as separate devices, the information processing device 110 and the agent device 200 may be configured as an integrated device.

The camera 101 captures an image of a subject and generates an image (image data) under the control of the information processing device 110, and outputs image information regarding the generated image to the information processing device 110. The camera 101 is provided at least inside the vehicle C1, and captures an image of a subject inside the vehicle C1 to generate an image (image data). Note that FIG. 1 shows a camera 101 provided inside the vehicle C1. As described above, the camera 101 includes, for example, one or more camera devices or image sensors capable of capturing an image of a subject. For example, one camera 101 may be provided in front of the vehicle C1 to capture an image of a subject from the front of the vehicle C1 to generate an image (image data), and another camera 101 may be provided in the rear of the vehicle C1 to generate an image (image data). An image (image data) may be generated by capturing an image of a subject behind C1.

The position information acquisition sensor 102 acquires position information regarding the position where the vehicle C1 is present, and outputs the acquired position information to the information processing device 110. For example, it can be realized by a GNSS receiver that acquires position information using GNSS (Global Navigation Satellite System). Further, the position information includes various data related to the position such as latitude, longitude, altitude, etc. at the time of receiving the GNSS signal. Alternatively, the location information may be acquired using other location information acquisition methods. For example, location information may be derived using information from nearby access points and base stations. Alternatively, location information may be acquired using a beacon. For example, based on the information acquired by the position information acquisition sensor 102, it is possible to determine the state of the vehicle C1, for example, whether it is running, stopped, or moving backward.

Furthermore, for example, it is possible to determine that the vehicle C1 is near a facility that exists outside the vehicle C1, such as a coffee shop, based on the position information acquired by the position information acquisition sensor 102.

The audio input unit 103 is provided inside the vehicle C1, and is configured to acquire sounds inside the vehicle C1 based on the control of the information processing device 110, and transmits sound information regarding the acquired sounds to the information processing device 110. Output. As the audio input unit 103, for example, one or more microphones or sound acquisition sensors can be used.

The sensors 104 are various sensors installed in the vehicle C1, and output detection information acquired by each sensor to the information processing device 110. Examples of the sensors include a human sensor, a distance sensor, a vehicle speed sensor, an acceleration sensor, a seating sensor, a seatbelt sensor, a door sensor, and a battery sensor. Note that these are just examples, and other sensors may be used. Further, only some of these sensors may be used.

The human sensor is a sensor that detects the presence or absence, number of people, position, state, etc. of people inside the vehicle C1. For example, it is possible to use a human sensor using infrared rays, ultrasonic waves, visible light, an image sensor, or the like. For example, if a person is seated in the driver's seat, passenger seat, or rear seat, the presence of that person can be detected by a human sensor. Further, by using both the human sensor and the seating sensor, it is possible to improve the accuracy of detecting the seating state of each seat.

The distance sensor is a sensor that detects the distance to a person existing inside the vehicle C1, the distance to a notification target, etc. For example, various sensors such as a distance sensor can be used as the distance sensor.

The seating sensor (or seat sensor) is a sensor that detects the presence or absence of an occupant sitting in each seat of the vehicle C1. The seat belt sensor is a sensor that detects whether or not the occupant seated in each seat of the vehicle C1 is wearing a seat belt. The door sensor is a sensor that detects whether each door of the vehicle C1 is ajar. The battery sensor is a sensor for measuring the remaining amount of the battery installed in the vehicle C1. For each of these sensors, known sensors can be used.

The information processing device 110 includes a control section 120, a storage section 130, and a communication section 140. The communication unit 140 exchanges various information with other devices using wired communication or wireless communication under the control of the control unit 120.

The control unit 120 controls each unit based on various programs stored in the storage unit 130. The control unit 120 is realized by, for example, a processing device such as a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit). For example, it is possible to increase the calculation speed by performing image processing using a GPU. Further, by executing parallel calculations using GPU, it is possible to further increase the calculation speed. Note that a vehicle ECU (Electronic Control Unit) of the vehicle C1 may be used as the control unit 120, or a processing device different from the vehicle ECU may be provided as the control unit 120. Note that the control unit 120 has a conversion function that converts characters into speech. This conversion function is realized by, for example, TTS (Text to Speech).

The control unit 120 executes control processing to control the operating state of the agent device 200 based on each piece of information output from the camera 101, location information acquisition sensor 102, audio input unit 103, sensors 104, communication unit 140, etc. do. Specifically, the control unit 120 includes a display switching determination unit 121 and an agent control unit 122.

The display switching determination unit 121 determines whether to switch the content displayed on the display unit 210 based on each piece of information output from the camera 101, position information acquisition sensor 102, audio input unit 103, sensors 104, communication unit 140, etc. The agent controller 122 outputs the determination result to the agent control unit 122. Specifically, the display switching determination unit 121 determines the timing of switching from the face image to the notification information.

For example, the display switching determination unit 121 determines whether notification information has occurred based on information output from the camera 101, position information acquisition sensor 102, audio input unit 103, sensors 104, communication unit 140, etc. judge. For example, based on a seat belt sensor that detects whether a seat belt is worn or not, and a seating sensor (or seat sensor) that detects the presence or absence of an occupant in each seat of the vehicle C1, the number of occupants in each seat of the vehicle C1 is determined. It is possible to determine whether or not a seat belt is worn. Therefore, if it is determined that the occupant is not wearing a seatbelt even though he or she is seated, it is determined that notification information has occurred.

Note that the display switching determination unit 121 may adjust the timing of switching from the face image to the notification information based on the importance level of the notification information, and may adjust the timing of switching from the face image to the notification information based on the degree of importance of the notification information. The timing of switching from the face image to the notification information may be adjusted based on whether or not the face image is displayed. A method for adjusting these switching timings will be described in detail with reference to FIGS. 12 and 13.

The agent control unit 122 determines whether the agent It controls the operating state of the device 200. For example, the agent control unit 122 causes the display unit 210 to display each part (eyes 211, nose 212, mouth 213) that make up the face of the simulated agent. Further, the agent control unit 122 causes the display unit 210 to display information (notification information) to be notified to the occupants of the vehicle C1. Further, the agent control unit 122 causes the sound output unit 220 to output the voice of the simulated agent, the voice corresponding to information to be notified to the occupants of the vehicle C1, and the like.

For example, the agent control unit 122 determines notification information to be displayed on the display unit 210 and notification information to be output from the sound output unit 220, and executes control to output the notification information. Note that notification information regarding objects existing inside the vehicle C1 is stored in the notification information DB 132. Further, examples of output of each of these notification information are shown in FIGS. 2, 4 to 10. For example, if the notification information is about wearing a seatbelt, an image showing the seatbelt (notification image 400 (see FIG. 2(E))) is displayed as the notification information. Further, if the notification information is related to the remaining amount of battery, an image indicating the battery (notification image 410 (see FIG. 2(F))) is displayed as the notification information. Further, if the notification information is about an ajar door, an image showing the door is displayed as the notification information.

Furthermore, for example, when switching the display state of the display unit 210 from a face image to notification information, the agent control unit 122 executes control to cause the agent device 200 to perform a switching effect. This switching effect will be explained in detail with reference to FIGS. 4 to 10.

The storage unit 130 is a storage medium that stores various information. For example, the storage unit 130 stores various information (for example, a control program, an agent information DB 131, a notification information DB 132, and a map information DB 133) necessary for the control unit 120 to perform various processes. Further, the storage unit 130 stores various information acquired via the communication unit 140. Examples of the storage unit 130 include ROM (Read Only Memory), RAM (Random Access Memory), SRAM (Static Random Access Memory), and HDD (Hard Disk). drive), SSD (Solid State Drive), or a combination thereof be able to.

The agent information DB 131 stores information necessary to realize various operations of the agent device 200. For example, facial image information (eg, eyes 211, nose 212, and mouth 213) displayed on the display unit 210 and audio information output from the sound output unit 220 are stored in the agent information DB 131. Further, for example, operation information for operating the face portion 201 (see FIGS. 5 to 9) when performing a switching effect is stored in the agent information DB 131.

The notification information DB 132 stores information necessary for outputting notification information regarding objects existing inside or outside the vehicle C1. For example, in the case of notification information regarding a door ajar, image information indicating the door and audio information for notifying the door ajar are stored in the notification information DB 132 as notification information. For example, in the case of notification information regarding the fastening of a seatbelt, image information indicating the seatbelt (notification image 400 (see FIG. 2(E))) and audio information for notifying the fastening of the seatbelt are combined. It is stored in the broadcast information DB 132 as broadcast information. For example, when the notification information is about the remaining battery level, the notification information includes image information indicating the battery (notification image 410 (see FIG. 2(F))) and audio information for notifying the fastening of the seat belt. It is stored in the broadcast information DB 132 as .

The map information DB 133 stores map information such as road information regarding roads necessary for route guidance of the vehicle C1. The map information includes road slope, road intersections, number of road lanes, road width information, and road undulation information. The map information also includes road signs indicating speed limits, one-way traffic, etc., crosswalks, lane markings, etc. Further, the map information may include information on facilities such as road structures (for example, traffic lights, telephone poles), buildings, etc., information on tourist guides in the surrounding area, and the like. Note that the agent information DB 131, notification information DB 132, and map information DB 133 may be stored and used in the storage unit 130 included in the vehicle C1, or may be obtained and used from an external device via the network 20.

The agent device 200 is a robot device that performs various operations based on instructions from the information processing device 110. Agent device 200 includes a display section 210, a sound output section 220, and a drive section 230. Note that the display section 210, the sound output section 220, and the drive section 230 are controlled based on a control section (not shown) included in the agent device 200.

The display unit 210 is a display unit that displays various images based on instructions from the information processing device 110. Note that as the display unit 210, a display panel such as an organic EL (Electro Luminescence) panel or an LCD (Liquid Crystal Display) panel can be used. Note that the display unit 210 may be configured as a touch panel that allows the user to perform operation input by touching or approaching the display surface with his or her finger, or may be configured as a separate user interface. .

Although FIG. 2 shows an example in which the agent device 200 includes one display unit 210, the agent device 200 may include multiple display units. Examples in which the agent device 200 includes a plurality of display units are shown in FIGS. 4 to 9. Note that each display section shown in FIGS. 4 to 9 corresponds to the display section 210 shown in FIG. 3.

The sound output unit 220 outputs various sounds based on instructions from the information processing device 110. As the sound output section 220, for example, one or more speakers can be used. Note that the display section 210 and the sound output section 220 are examples of user interfaces, and some of them may be omitted or other user interfaces may be used.

The drive section 230 drives each section of the agent device 200 based on instructions from the information processing device 110. For example, the drive section 230 is a drive device that realizes a mechanism for rotating the face section 201 (see FIGS. 5, 6, and 9). Further, the drive section 230 is a drive device that realizes a mechanism for moving the display panel 270 (see FIG. 7) in the face section 201. Further, the drive section 230 is a drive device that realizes a mechanism for moving the display section 300 (see FIG. 8). For example, the drive section 230 is configured with a motor, a servo motor, etc. that can drive each section. Note that the drive unit 230 will be described in detail with reference to FIGS. 5 to 9.

[Example of providing notification information using multiple display units]
FIG. 2 shows an example in which one display unit 210 is used to provide notification information. As described above, it is also possible to provide notification information using a plurality of display units. Therefore, FIGS. 4 to 9 show examples in which notification information is provided using a plurality of display units. Note that FIGS. 4 to 9 show examples in which notification information (notification image 410 (see FIG. 2(F))) regarding the remaining battery level is output. Further, FIG. 10 shows an example in which notification information (notification image 400 (see FIG. 2E)) regarding fastening of the seat belt is output.

[Example of providing notification information using multiple display units installed vertically]
FIG. 4 is a diagram showing an example of transition when providing notification information using two

display units

241 and 242. FIG. 4 shows an example in which the agent device 200 includes two

display units

241 and 242 arranged in the vertical direction. Specifically, the display section 241 is installed on the face section 201, and the display section 242 is installed on the body section 202. That is, in the example shown in FIG. 4, a display section 241 is provided in place of the display section 210 in the agent device 200 shown in FIG. 2, and a display section 242 is provided on the body part 202.

It is assumed that the display section 241 mainly displays facial images, and the display section 242 mainly displays notification information. For example, in normal times, various facial images are displayed on the display unit 241, similar to the examples shown in FIGS. 2(A) to 2(C).

Further, the display switching determination unit 121 determines information to be notified to the user of the vehicle C1 based on each information output from the camera 101, the position information acquisition sensor 102, the audio input unit 103, the sensors 104, the communication unit 140, etc. Determine whether (broadcast information) has occurred. Then, when notification information is generated, the display switching determination unit 121 outputs a notification to that effect to the agent control unit 122.

Next, when the display switching determination unit 121 determines that notification information has been generated, the agent control unit 122 executes control to display the notification information on the display unit 242. Specifically, the agent control unit 122 executes a switching effect using the display unit 241, and after erasing the display of the face image on the display unit 241, causes the display unit 242 to display the notification information. Note that instead of performing the switching effect using the display section 241, a switching effect using the

display sections

241 and 242, a switching effect using only the display section 242, etc. may be performed.

For example, when notification information is generated, the agent control unit 122, as shown in FIG. Execute the performance (switching performance). Specifically, the agent control unit 122 executes the switching effect by controlling the display state of the display unit 241 so that the facial image on the display unit 241 has a surprised facial expression (see FIG. 2(D)). do.

Next, as shown in FIG. 4(B), the agent control unit 122 erases the display of the face image on the display unit 241, and causes the display unit 242 to display the notification image 410 as notification information.

In this way, when displaying notification information, by displaying a face image with a surprised expression on the display unit 241 when switching from a face image to notification information, the user can feel like a living thing, and the notification information can be displayed. It becomes possible to increase the user's interest in being notified. This makes it possible to more appropriately notify the user of the notification information.

[Example of providing notification information by rotating a housing with display units installed on both sides in the left and right directions]
FIG. 5 is a diagram showing an example of transition when providing notification information using two display sections 252 and 253. In FIG. 5, the agent device 200 includes a casing 250 (face portion 201) that can be rotated in the left-right direction, and a display portion 252 (see FIGS. 5(A) and 5(B)) on one surface of the casing 250. An example is shown in which a display unit 253 (see FIG. 5C) is installed on the other surface of the housing 250. The display section 252 mainly displays face images, and the display section 253 mainly displays notification information.

Specifically, the housing 250 (face part 201) and the body part 202 are connected by the neck part 251, using the neck part 251 as a rotation support part. The neck portion 251 is connected to a drive portion 230 (see FIG. 3), and the rotating operation of the drive portion 230 allows the casing 250 to be rotated in the left-right direction (arrow A1 direction) using the neck portion 251 as a rotation axis. It is possible. Note that the rotation range of the housing 250 can be set, for example, in a range of 180 to 360 degrees. For example, by rotating the housing 250 by about 180 degrees in the left-right direction, the front-back direction of the housing 250 can be reversed. Normally, the display unit 252 side is set to be the front side, and various facial images are displayed on the display unit 252, similar to the examples shown in FIGS. 2(A) to 2(C).

Similarly to FIG. 4, the display switching determination unit 121 determines whether or not notification information has been generated, and if notification information has been generated, outputs a notification to that effect to the agent control unit 122.

Next, when the display switching determination unit 121 determines that notification information has been generated, the agent control unit 122 executes control to display the notification information on the display unit 253. Specifically, the agent control unit 122 executes a switching effect using the housing 250, erases the display of the face image on the display unit 252, and then displays the notification information on the display unit 253.

For example, when notification information is generated, as shown in FIGS. 5(A) and 5(B), the agent control unit 122 creates a switching effect that gives the user a feeling of living beings at a timing before displaying the notification information. A performance (switching performance) for the purpose of the change is executed. Specifically, the agent control unit 122 executes the switching effect by controlling the display state of the display unit 252 so that the facial image on the display unit 252 has a surprised facial expression (see FIG. 2(D)). do.

Next, as shown in FIG. 5B, the agent control unit 122 erases the display of the face image on the display unit 252, and rotates the casing 250 to the right (in the direction of arrows A2 and A3) using the neck 251 as the rotation axis. ). Note that during this rotation, the face image on the display section 252 may be displayed, and when this rotation ends, the face image on the display section 252 may be erased. Furthermore, before the rotation starts or at the time of this rotation, the sound output unit 220 may output audio information to make the user feel like a living thing.

Next, as shown in FIG. 5(C), the agent control unit 122 displays a notification image 410 as notification information on the display unit 253 on the user side of the vehicle C1. In this way, when notification information is generated, a switching effect is executed using the housing 250 (display sections 252 and 253), and after erasing the display of the face image on the display section 252, the display section 253 The notification information (notification image 410) is displayed.

In this way, when displaying notification information, when switching from a face image to notification information, a facial image with a surprised expression is displayed on the display unit 252, and the housing 250 (face unit 201) is rotated. let By rotating the housing 250, it is possible to express a movement in which the face of the agent device 200 looks backward, and therefore it is possible to increase the user's interest in the agent device 200. Furthermore, it is possible to give the user the impression that the notification information is displayed on the head or back of the agent device 200 after the face of the agent device 200 turns backward. With these, it is possible to make the user feel like a living thing and increase the user's interest in being notified of the notification information. Further, the display position of the face image and the display position of the notification information are the same position as viewed from the user. Therefore, it is possible to display the notification information at a position that is easily visible to the user who is viewing the face image. With these, it becomes possible to more appropriately notify the user of the notification information.

[Example of providing notification information by vertically rotating a case with display units installed on both sides]
FIG. 6 is a diagram showing an example of transition when providing notification information using two

display sections

264 and 265. In FIG. 6, the agent device 200 includes a vertically rotatable housing 260 (face portion 201), and a display unit 264 (see FIG. 6(A)) is installed on one surface of the housing 260. An example is shown in which a display section 265 (see FIG. 6(C)) is installed on the other surface of the housing 260. The display section 264 mainly displays face images, and the display section 265 mainly displays notification information.

Specifically, the casing 260 is installed inside a frame 261 that has a square shape when viewed from the front, and both ends of the casing 260 in the left and right direction and the inner surface of the frame 261 are connected to the rotation support part 262. , 263. Note that since the

rotational support parts

262 and 263 are provided at positions corresponding to the ears of the face part 201, the

rotation support parts

262 and 263 may be configured as the ears of the face part 201. The

rotation support parts

262 and 263 are connected to the drive part 230 (see FIG. 8), and the rotation movement of the drive part 230 causes the face part 201 to move in the vertical direction (arrow A10 direction). In this way, the housing 260 can be rotated in the vertical direction inside the frame portion 261. Note that the rotation range of the housing 260 (face portion 201) can be set, for example, in a range of 180 degrees to 360 degrees. For example, by rotating the housing 260 approximately 180 degrees in the vertical direction, the front-back direction of the housing 260 can be reversed. Normally, the display unit 264 side is set to be the front side, and various facial images are displayed on the display unit 264, similar to the examples shown in FIGS. 2(A) to 2(C).

Next, when the display switching determination unit 121 determines that notification information has been generated, the agent control unit 122 executes control to display the notification information on the display unit 265. Specifically, the agent control unit 122 executes a switching effect using the housing 260 and, after erasing the display of the face image on the display unit 264, causes the display unit 265 to display the notification information.

For example, when notification information is generated, as shown in FIGS. 6(A) and 6(B), the agent control unit 122 creates a switching effect that gives the user a feeling of living beings at a timing before displaying the notification information. A performance (switching performance) for the purpose of the change is executed. Specifically, the agent control unit 122 executes the switching effect by controlling the display state of the display unit 264 so that the facial image on the display unit 264 has a surprised facial expression (see FIG. 2(D)). do.

Next, as shown in FIG. 6B, the agent control unit 122 erases the display of the face image on the display unit 264, and rotates the housing 260 in the vertical direction (arrow A11, A12 direction). Note that during this rotation, the face image on the display section 264 may be displayed, and when this rotation ends, the face image on the display section 264 may be erased. Furthermore, before the rotation starts or at the time of this rotation, the sound output unit 220 may output audio information to make the user feel like a living thing.

Next, as shown in FIG. 6(C), the agent control unit 122 displays a notification image 410 as notification information on the display unit 265 on the user side of the vehicle C1. In this way, when notification information is generated, after performing a switching effect using the housing 260 (display sections 264 and 265) and erasing the display of the face image on the display section 264, the display section 265 The notification information (notification image 410) is displayed.

In this way, when displaying notification information, when switching from a face image to notification information, a facial image with a surprised expression is displayed on the display section 264, and the housing 260 (face section 201) is rotated. let By rotating the housing 260, it is possible to express a movement in which the face of the agent device 200 is facing downward, so that it is possible to increase the user's interest in the agent device 200. Further, it is possible to give the user the impression that the notification information is displayed on the head or back of the agent device 200 after the face of the agent device 200 is turned downward. With these, it is possible to make the user feel like a living thing and increase the user's interest in being notified of the notification information. Further, the display position of the face image and the display position of the notification information are the same position as viewed from the user. Therefore, it is possible to display the notification information in a position that is easily visible to the user who is viewing the face image. With these, it becomes possible to more appropriately notify the user of the notification information.

Note that the left-right rotation mechanism shown in FIG. 5 is an example, and there is a rotation axis at the center of the front-rear direction and left-right direction of a plate-shaped casing with display sections on both sides, and the casing is rotated around the rotation axis. Other mechanisms may also be used. In addition, the vertical rotation mechanism shown in FIG. 6 is an example, and there is a rotation axis at the center of the front-rear direction and vertical direction of a plate-shaped casing with display sections on both sides, and the casing is rotated around the rotation axis. Other mechanisms may also be used.

FIGS. 5 and 6 show examples in which display sections are provided on both sides of the

casings

250 and 260. However, by swinging the

casings

250 and 260, it is also possible to give the user a feeling of living beings. Therefore, a display section may be provided only on one surface of the

casings

250, 260, and an operation of swinging the

casings

250, 260 may be performed as a switching effect. In this case, when notification information is generated, a switching effect is executed in which the housing is rotated, and after erasing the display of the face image on one display section, the notification information is displayed on that display section. Display.

In this way, it is possible to draw the user's attention by rotating the face part 201 or by swinging the face part 201, and to perform a notification operation to the user. Thereby, it is possible to appropriately notify the user. In this way, when the face section 201 itself starts moving, it is possible to draw the user's attention to what will be displayed.

[Example of providing notification information using multiple movable display panels]
FIG. 7 shows notification information using two display sections that are realized using a flat display panel 270 (see FIGS. 7(B) and 7(C)) that is rotatably provided on the face section 201. It is a figure which shows the example of a transition when providing.

The display panel 270 has a first display section 271 provided on one surface, and a second display section 272 provided on the opposite surface. Further, the display panel 270 is provided with a rotation support section 273 at one end thereof, and is provided on the display section 280 so as to be rotatable about the rotation support section 273 as a rotation axis. Further, the display section 280 is installed on the face section 201.

The rotation support section 273 is connected to the drive section 230 (see FIG. 3), and the rotation operation of the drive section 230 causes the display panel 270 to move in the vertical direction (in the direction of arrow A20 (FIG. 7) with the rotation support section 273 as a rotation axis). (See (B))). Note that the rotation range of the display panel 270 can be set to, for example, a range of 180 degrees.

The display device constituted by the display panel 270 and the display section 280 enters either a first state in which a face image is displayed or a second state in which notification information is displayed by the rotating operation of the display panel 270. controlled as follows. As shown in FIG. 7A, in the first state, the display panel 270 is arranged in the upper area of the display part 280, and the first display part 271 of the display panel 270 and the lower display area 281 of the display part 280 are arranged in the first state. Let the display area consist of . Further, as shown in FIG. 7D, in the second state, the display panel 270 is arranged in the lower area of the display part 280, and the second display part 272 of the display panel 270 and the upper display area of the display part 280 are arranged. 282. Note that in the first state, a face image is mainly displayed, and in the second state, notification information is mainly displayed.

In this way, the movable display panel 270 functions like a lid that covers the upper display area of the display unit 280 or the lower display area of the display unit 280. Therefore, the display panel 270 can also be referred to as a foldable display section or a lid section.

Next, when the display switching determination unit 121 determines that notification information has been generated, the agent control unit 122 causes the notification information to be displayed on the display device configured by the display panel 270 and the display unit 280. control. Specifically, the agent control unit 122 executes a switching effect using the display panel 270 and the display unit 280, erases the display of the face image in the first state, and then displays the notification information in the second state. Display.

For example, when notification information is generated, as shown in FIGS. 7A to 7C, the agent control unit 122 displays a creature-like image to the user as a switching effect before displaying the notification information. Execute a performance (switching performance) to make the user feel the feeling. Specifically, as shown in FIG. 7A, the agent control unit 122 controls the display panel 270 and the display panel 270 so that the facial image in the first state has a surprised facial expression (see FIG. 2D). The display state of the display unit 280 is controlled to execute a switching effect.

Next, as shown in FIGS. 7B and 7C, the agent control unit 122 erases the display of the face image on the first display section 271 of the display panel 270 and the lower display area 281 of the display section 280. , the display panel 270 is rotated downward (in the direction of arrows A21 and A22) using the rotation support part 273 as a rotation axis. Note that during this rotation, the face image may be displayed, and at the end of this rotation, the face image may be erased. Furthermore, before the rotation starts or at the time of this rotation, the sound output unit 220 may output audio information to make the user feel like a living creature.

Next, as shown in FIG. 7(D), the agent control unit 122 displays a notification image 410 as notification information in a second state in which the display panel 270 is placed in the lower area of the display unit 280. That is, the notification image 410 is displayed in a display area formed by the second display section 272 of the display panel 270 and the upper display area 282 of the display section 280. In this way, when notification information is generated, a switching effect is performed in which the display panel 270 is rotated to transition from the first state to the second state, and the facial image is displayed in the first state. After erasing, the notification information (notification image 410) is displayed in the second state. Note that, as shown in FIG. 7C, notification information (notification image 410) may be displayed while the display panel 270 is rotating.

In this way, when displaying notification information, a facial image with a surprised expression is displayed on display section 264 and display panel 270 is rotated when switching from a facial image to notification information. By rotating the display panel 270, it is possible for the agent device 200 to remove the mask of its face and express interesting movements that reveal its true appearance, thereby increasing the user's interest in the agent device 200. is possible. Further, it is possible to give the user an interesting impression by displaying the notification information on the real face of the agent device 200 after removing the mask of the face of the agent device 200. With these, it is possible to make the user feel like a living thing and increase the user's interest in being notified of the notification information. Further, the display position of the face image and the display position of the notification information are the same position as viewed from the user. Therefore, it is possible to display the notification information at a position that is easily visible to the user who is viewing the face image. With these, it becomes possible to more appropriately notify the user of the notification information.

Although FIG. 7 shows an example in which the display panel 270 is rotated in the vertical direction using the rotation support portion 273 extending in the left-right direction as a rotation axis, the display panel 270 is not limited to this. For example, the display panel 270 may be rotated in the left-right direction using a rotation support portion extending in the vertical direction as a rotation axis.

[Example of providing notification information using a display unit that can be slid]
FIG. 8 is a diagram illustrating an example of transition when providing notification information using a slideable display section 300 and a fixed display section 310. The display unit 300 is a plate-shaped housing that includes a display screen 301, and the display unit 310 is a plate-shaped housing that includes a display screen 311.

The display section 300 is installed in front of the display section 310 so as to be movable in the vertical direction. Specifically, the display section 300 is attached to rail

sections

305 and 306 fixed to the front of the body section 202 so as to be slidable in a direction substantially parallel to the display surface of the display section 310. In addition, the slide mechanism realized by the

rail parts

305 and 306 can employ a known technique.

Further, the size of the display screen 301 of the display unit 300 and the size of the display screen 311 of the display unit 310 may be the same (or substantially the same) or may be different sizes. For example, the size of the display screen 301 of the display unit 300 can be set to a size that can cover at least a portion of the display screen 311 of the display unit 310.

Further, the display unit 300 is configured to transition to either a first state (see FIG. 8(A)) in which a face image is displayed or a second state (see FIG. 8(C)) in which notification information is displayed. controlled. As shown in FIG. 8A, in the first state, the display section 300 is arranged so as to cover the display screen 311 of the display section 310 in front of the display section 310. Further, as shown in FIG. 8C, in the second state, the user slides the display unit 300 in the first state in a direction substantially parallel to the display screen 311 of the display unit 300. The display screen 311 of the display unit 310 can be viewed.

In addition, the display section 300 is directly or indirectly connected to the drive section 230 (see FIG. 3), and is driven by the drive section 230 in the vertical direction (arrow A30 direction (FIG. 8 (B)) along the

rail sections

305 and 306. )).

Next, when the display switching determination unit 121 determines that notification information has been generated, the agent control unit 122 executes control to display the notification information on the display unit 310. Specifically, the agent control unit 122 executes a switching effect using the display unit 300 and, after erasing the display of the face image on the display unit 300, causes the display unit 310 to display the notification information.

For example, when notification information is generated, as shown in FIGS. 8(A) and 8(B), the agent control unit 122 provides a switching effect that gives the user a feeling of living beings at a timing before displaying the notification information. A performance (switching performance) for the purpose of the change is executed. Specifically, as shown in FIG. 8(A), the agent control unit 122 controls the display unit 300 so that the facial image on the display unit 300 has a surprised facial expression (see FIG. 2(D)). Control the display state and execute switching effects.

Next, as shown in FIG. 8B, the agent control unit 122 erases the face image on the display unit 300 and moves the display unit 300 downward (in the direction of arrow A31) along the

rails

305 and 306. let Note that the face image may be displayed during this movement, and the face image may be erased at the end of this movement. Furthermore, before starting this movement or during this movement, the sound output unit 220 may output audio information to make the user feel like a living creature.

Next, as shown in FIG. 8(C), the agent control unit 122 causes the display unit 310 to display a notification image 410 as notification information. In this way, when notification information is generated, the display section 300 is slid downward (in the direction of arrow A31) along the

rail sections

305 and 306 to effect a transition from the first state to the second state. After performing this as a switching effect and erasing the display of the face image on the display unit 300, notification information (notification image 410) is displayed on the display unit 310.

In this way, by sliding the display unit 300 vertically along the

rails

305 and 306, the impression that the display screen 301 of the display unit 300 is swiping over the display screen 311 of the display unit 310 is created. It is possible to give it to the user.

In this manner, when displaying notification information, a facial image with a surprised expression is displayed on display unit 300, and display unit 300 is moved when switching from a face image to notification information. By this movement of the display unit 300, the filter that has hidden the face of the agent device 200 is removed, and it is possible to express interesting movements that reveal the real face of the agent device 200, thereby increasing the user's interest in the agent device 200. It is possible to increase the Furthermore, it is possible to give the user an interesting impression in which the notification information is displayed on the real face of the agent device 200 after the filter that has hidden the face of the agent device 200 is removed. With these, it is possible to make the user feel like a living thing and increase the user's interest in being notified of the notification information. Further, the display position of the face image and the display position of the notification information are the same position as viewed from the user. Therefore, it is possible to display the notification information at a position that is easily visible to the user who is viewing the face image. With these, it becomes possible to more appropriately notify the user of the notification information.

In the example shown in FIG. 8, the display unit 300 in the second state is placed in front of the body part 202, and a part of the body part 202 is covered by the display unit 300 when viewed from the user. An example is shown in which a part of the body part 202 is hidden. However, when the display unit 300 is in the second state, the display unit 300 may be housed inside the body part 202 so that the body part 202 is not hidden when viewed from the user. Furthermore, when the display unit 300 in the second state is placed in front of the body part 202, an image that is the same as the part of the body part 202 covered by the display unit 300 when viewed from the user (or Other related images) may also be displayed on the display unit 300. These allow the user to recognize the body part 202 even when the notification information is displayed on the face part 201, making it possible for the user to feel that the agent device 200 resembles a living creature.

[Example of providing notification information by rotating a rectangular parallelepiped display device vertically]
FIG. 9 is a diagram showing an example of transition when providing notification information using two

display sections

324 and 325. FIG. 9 shows an example in which the agent device 200 includes a casing 320 (face portion 201) that is rotatable in the vertical direction. Note that FIG. 9(D) shows a perspective view of the external appearance of the vertically rotatable casing 320 (face portion 201). As shown in FIG. 9(D), a display section 324 (see FIG. 9(A)) is installed on one surface of the casing 320, and the other surface adjacent to the surface of the display section 324 of the casing 320 is provided with a display section 324 (see FIG. 9(A)). A display unit 325 (see FIG. 9(C)) is installed. The display section 324 mainly displays face images, and the display section 325 mainly displays notification information.

Note that the example shown in FIG. 9 is a modification of FIG. 6, and differs in the shape of the housing 320, the positional relationship between the two display units in the housing 320, etc.

Specifically, the casing 320 is installed inside a frame 321 that has a square shape when viewed from the front, and both ends of the casing 320 in the left and right direction and the inner surface of the frame 321 are connected to the rotation support part 322. , 323. Note that since the

rotation support parts

322 and 323 are provided at positions corresponding to the ears of the face part 201, the

rotation support parts

322 and 323 may be configured as the ears of the face part 201. The rotational supports 322 and 323 are connected to a drive unit 230 (see FIG. 3), and the rotational movement of the drive unit 230 causes the housing 320 to move in the vertical direction (arrow A40 direction). In this way, the housing 320 can be rotated in the vertical direction inside the frame portion 321. Note that the rotation range of the housing 320 can be set, for example, in a range of 180 degrees to 360 degrees. For example, the two

display sections

324 and 325 can be switched by rotating about 90 degrees in the vertical direction. Normally, as shown in FIG. 9(A), the display unit 324 side is set to be the front side, and as in the examples shown in FIGS. 2(A) to (C), various faces are displayed on the display unit 324. The image is displayed.

Next, when the display switching determination unit 121 determines that notification information has been generated, the agent control unit 122 executes control to display the notification information on the display unit 325. Specifically, the agent control unit 122 executes a switching effect using the housing 320, erases the face image on the display unit 324, and then displays the notification information on the display unit 325.

For example, when notification information is generated, as shown in FIGS. 9A and 9B, the agent control unit 122 creates a switching effect that gives the user a feeling of living beings at a timing before displaying the notification information. A performance (switching performance) for the purpose of the change is executed. Specifically, as shown in FIG. 9(A), the agent control unit 122 controls the display unit 324 so that the facial image on the display unit 300 has a surprised facial expression (see FIG. 2(D)). Control the display state and execute switching effects.

Next, as shown in FIG. 9B, the agent control unit 122 erases the face image on the display unit 324, and rotates the housing 320 downward (in the direction of arrow A41) using the

rotational supports

322 and 323 as rotation axes. ). Note that during this rotation, the face image on the display section 324 may be displayed, and when this rotation ends, the face image on the display section 324 may be erased. Furthermore, before the rotation starts or at the time of this rotation, the sound output unit 220 may output audio information to make the user feel like a living creature.

Next, as shown in FIG. 9(C), the agent control unit 122 displays a notification image 410 as notification information on the display unit 325 on the user side of the vehicle C1. In this way, when notification information is generated, a switching effect is performed using the housing 320 (display sections 324, 325), and after erasing the face image on the display section 324, the notification information is displayed on the display section 325. Information (notification image 410) is displayed.

In this way, when displaying the notification information, a face image with a surprised expression is displayed on the display unit 324 and the housing 320 is moved when switching from the face image to the notification information. By rotating the housing 320, it is possible to express a movement in which the face of the agent device 200 faces downward, and therefore it is possible to increase the user's interest in the agent device 200. Furthermore, it is possible to give the user the impression that the notification information is displayed on the head or back of the agent device 200 after the face of the agent device 200 is turned downward. With these, it is possible to make the user feel like a living thing and increase the user's interest in being notified of the notification information. Furthermore, the display position of the face image and the display position of the notification information are approximately the same position as viewed from the user. Furthermore, it is possible to make the display size of the notification information larger than the display size of the face image. Therefore, it is possible to display the notification information in a large size at a position that is easily visible to the user who is viewing the face image. With these, it becomes possible to more appropriately notify the user of the notification information.

Further, as shown in FIG. 9(D), a facial image is displayed on the horizontally elongated display section 324, and notification information is displayed on the vertically wide display section 325. This allows the user to visually and intuitively understand that information more important than the facial image is displayed on the display unit 325. In addition, by rotating the display section 324 (displaying the face image) and displaying the notification information on the relatively large display section 325 adjacent to the upper side of the display section 324, the information can be displayed on the back near the face of the agent device 200 (or in front of the face). It is possible to give the user an interesting impression that the notification information is displayed on the abdominal part of the user. With these, it is possible to give the user a feeling of being like a living thing, and it is possible to increase the user's interest in the broadcast information.

Note that in the example shown in FIG. 9, a face image is displayed on the horizontally elongated display section 324, and notification information is displayed on the vertically wide display section 325, but the present invention is not limited to this. For example, the notification information may be displayed on the horizontally elongated display section 324, the facial image may be displayed on the vertically wide display section 325, and the facial image and the notification information may be displayed on the other two adjacent surfaces. It's okay.

Furthermore, although FIG. 9 shows an example using two display sections provided on two adjacent surfaces of the rectangular parallelepiped-shaped housing 320, two display sections provided on two adjacent surfaces of the cubic-shaped housing 320 are used. A single display section may also be used.

Further, although FIG. 9 shows an example in which the rectangular parallelepiped-shaped housing 320 is rotated in the vertical direction, the present invention is not limited thereto. For example, a rectangular parallelepiped-shaped housing configured to form a face image elongated in the vertical direction may be rotated in the left-right direction.

[Example of providing notification information using one display unit]
4 to 9 show examples in which notification information is displayed by switching the screen contents of a plurality of display units. Here, by switching the screen contents displayed on one display unit, it is also possible to make the user recognize the face image display screen and the notification information display screen as different screens. Therefore, FIG. 10 shows an example in which notification information is displayed by switching the screen content of one display unit.

FIG. 10 is a diagram showing an example of transition when providing notification information using one display unit 210. FIG. 10 shows an example in which the display unit 210 has a display function that can display each image with different display characteristics. Note that the display characteristics refer to characteristics when displaying images, such as image quality, color, resolution, and presence or absence of stereoscopic viewing. For example, different display characteristics can be realized by switching between a three-dimensional image and a two-dimensional image. Further, for example, different display characteristics can be realized by switching between high image quality and low image quality. Further, for example, different display characteristics can be realized by switching between a color image and a monochrome image.

For example, by displaying the facial image as a three-dimensional image on the display section 241 and displaying the notification information as a two-dimensional image on the display section 241, it becomes possible to display the facial image and the notification information with different display characteristics. Furthermore, for example, by displaying the face image on the display unit 241 as a high-quality image and displaying the notification information on the display unit 241 as a low-quality image, it is possible to display the face image and the notification information with different display characteristics. Become. In this case, the high quality face image is, for example, a colorful and beautiful image, and the low quality face image is, for example, at least one of a black and white image, a pixel image, and a mosaic image. Further, for example, by displaying the face image on the display unit 241 as a color image and displaying the notification information as a black and white image on the display unit 241, it is possible to display the face image and the notification information with different display characteristics.

Next, when the display switching determination unit 121 determines that notification information has been generated, the agent control unit 122 executes control to display the notification information on the display unit 210. Specifically, the agent control unit 122 executes a switching effect using the display unit 210, erases the face image on the display unit 210, and then displays the notification information on the display unit 210.

For example, when notification information is generated, the agent control unit 122, as shown in FIG. Execute the performance (switching performance). Specifically, as shown in FIG. 10(A), the agent control unit 122 controls the display unit 210 so that the facial image on the display unit 210 has a surprised facial expression (see FIG. 2(D)). Control the display state and execute switching effects.

Next, as shown in FIG. 10(B), the agent control unit 122 erases the face image on the display unit 210 and causes the display unit 210 to display the notification image 400 as notification information. In the case of transitioning the display from the face image to the notification information, an effect that makes the user feel that the face image display screen and the notification information display screen are different screens may be performed as a switching effect. For example, as described above, switching from a stereoscopic image to a two-dimensional image, switching from high image quality to low image quality, switching from a color image to a monochrome image, etc. can be performed as a switching effect. Further, the switching effect may be performed by changing the color scheme or changing the resolution. With these, different display characteristics (first display characteristics, second display characteristics) can be realized by the display section 210.

Furthermore, when the display is to be transitioned from the face image to the notification information, the switching effect may be performed using software-based image processing. For example, after the face image gradually disappears, the notification information may be gradually displayed. In this way, by performing an effect in which the face image gradually disappears, it is possible to give the user a sense of expectation that some kind of information will be forthcoming, and it is possible to direct the user's attention to the display unit 210. . Moreover, before the start of this switching or at the time of this switching, audio information for making the user feel like a living thing may be outputted from the sound output unit 220.

In this manner, when displaying notification information, a facial image with a surprised expression is displayed on the display unit 210 when switching from a face image to notification information, and notification information is displayed as a different display characteristic. Thereby, it is possible to make the user feel like a living thing and increase the user's interest in being notified of the notification information. Furthermore, the difference in display characteristics allows the user to clearly distinguish between the facial image and the notification information. Therefore, it becomes possible to more appropriately notify the user of the notification information.

Note that FIG. 10 shows an example in which notification information is displayed as a display characteristic different from that of a face image by switching the screen content of one display unit 210. However, even in embodiments (for example, FIGS. 4 to 9) in which notification information is displayed by switching the screen contents of a plurality of display sections, each of the plurality of display sections may be configured to have different display characteristics.

For example, the first display section can be an LCD (Liquid Crystal Display), and the second display section can be an OLED (Organic Electro Luminescence Diode). Further, it is possible to make the first display section a glossy screen and the second display section a non-glossy screen. Further, the first display section can be a flat screen, and the second display section can be a curved screen. Further, the first display section can be a stereoscopic screen capable of displaying a three-dimensional image, and the second display section can be a screen capable of displaying a two-dimensional image. Further, it is possible to make the first display section and the second display section different in size. For example, if the first display section is an LCD and the second display section is an OLED, the visual images may be the same, but the brightness is different, so it is possible to perform different effects. . Furthermore, in these cases, when displaying the notification information on the second display section, a switching effect is executed on at least one of the first display section and the second display section. For example, the switching effect is performed by moving the casings of the first display section and the second display section, or by displaying a surprised expression on the first display section.

[Operation example of information processing device]
FIG. 11 is a flowchart illustrating an example of notification information output processing in the information processing device 110. Further, this notification information output processing is executed by the control unit 120 based on a program stored in the storage unit 130. Moreover, this notification information output process is always executed in every control cycle. Further, this notification information output processing will be explained with reference to FIGS. 1 to 10 as appropriate.

In step S501, the display switching determination unit 121 executes an analysis process to analyze input information. This input information includes information input to the information processing apparatus 110 from the camera 101, position information acquisition sensor 102, audio input unit 103, sensors 104, etc., and information acquired from the outside via the communication unit 140 and input to the information processing apparatus 110. This is input information, etc.

In step S502, the display switching determination unit 121 determines whether there is information (notification information) to be notified to the occupants of the vehicle C1, based on the analysis result of the input information.

For example, the remaining battery level of the vehicle C1 can be detected based on the battery sensor. Therefore, when it is determined that the remaining battery amount is equal to or less than the threshold value, it is determined that there is notification information for notifying that the remaining battery amount is decreasing.

For example, based on a seat belt sensor that detects whether a seat belt is worn or not, and a seating sensor (or seat sensor) that detects the presence or absence of an occupant in each seat of the vehicle C1, the number of occupants in each seat of the vehicle C1 is determined. It is possible to determine whether or not a seat belt is worn. Therefore, if it is determined that the occupant is not wearing a seatbelt even though he or she is seated, it is determined that there is notification information for the occupant.

Further, for example, it is possible to detect whether a door of the vehicle C1 is ajar based on a door sensor that detects whether each door of the vehicle C1 is ajar. Therefore, when a door in an ajar state is detected, it is determined that there is notification information for the door in an ajar state.

For example, based on the information acquired from an external device, such as an information providing server, via the communication unit 140 and the current location of the vehicle C1 acquired by the position information acquisition sensor 102, the locations around the vehicle C1 may be determined. It is possible to obtain the presence or absence of goods, commercial facilities, etc. Therefore, for example, if it is determined that a commercial facility, such as a coffee shop, exists around the vehicle C1, it is determined that an advertisement for the coffee shop exists as the notification information. Further, for example, if it is determined that a tourist facility such as ABC Castle exists around the vehicle C1, it is determined that information for guiding the ABC Castle exists as broadcast information.

In step S503, the display switching determination unit 121 determines whether information to be notified to the occupants of the vehicle C1 has occurred. If information to be notified to the occupants of the vehicle C1 occurs, the process advances to step S504. On the other hand, if the information to be notified to the occupants of the vehicle C1 is not generated, the operation of the notification information output process is ended.

In step S504, the agent control unit 122 executes a switching effect from the face image to the notification information. For example, FIG. 4(A), FIG. 5(A)(B), FIG. 6(A)(B), FIG. 7(A) to (C), FIG. 8(A)(B), FIG. 9(A) As shown in FIG. 10(B) and FIG. 10(A), a switching effect using each part of the agent device 200 is executed. In this case, audio information related to the switching effect may be output from the sound output unit 220. Note that although FIGS. 5 to 9 show examples in which both a surprised facial expression and the movement of the face part 201 are executed as a switching effect, only the movement of the face part 201 may be executed as a switching effect. .

In step S505, the agent control unit 122 causes the agent device 200 to perform output processing to output notification information. For example, as shown in FIG. 4(B), FIG. 5(C), FIG. 6(C), FIG. 7(D), FIG. 8(C), FIG. 9(C), and FIG. 10(B), the

notification image

400 and 410 are displayed on the display section 210. In this case, audio information related to the broadcast information may be output from the sound output unit 220.

In step S506, the agent control unit 122 determines whether the end timing of the notification information output in step S505 has come. When the end timing of the broadcast information has come, the process advances to step S507. On the other hand, if it is not the end timing of the broadcast information, the process returns to step S505.

Here, the end timing of the notification information is when there is a predetermined action by the occupant of the vehicle C1 corresponding to the notification information, when a predetermined time has elapsed since the display of the notification information, and when the current location of the vehicle C1 is within the display area of the notification information. This can be done when the value is out of range.

For example, if the notification information output in step S505 is notification information regarding the remaining battery amount, the predetermined action is to increase the remaining battery amount or to charge the battery. An increase in the remaining battery capacity can be determined based on information detected by the battery sensor. Furthermore, battery charging can be determined based on the exchange between the charging equipment and the vehicle C1 via the charging cable when the charging cable is connected to the vehicle C1.

Further, for example, if the notification information output in step S505 is notification information regarding the fastening of a seatbelt, the predetermined action is to fasten the seatbelt by the occupant seated in the seat targeted for notification. becomes. Whether or not the seat belt is fastened can be determined based on information detected by the seat belt sensor.

Further, for example, if the notification information output in step S505 is notification information regarding the door of the vehicle C1 being ajar, the predetermined action is the action of closing the door targeted for notification. Whether or not the door is closed can be determined based on information detected by the door sensor.

Further, for example, if the notification information output in step S505 is notification information regarding commercial facilities, tourist facilities, etc. that exist around the vehicle C1, the operation of moving the vehicle C1 to the location targeted for notification is performed. is the predetermined action. Whether there is an operation to move the vehicle C1 to the location targeted for notification can be determined based on the position information of the vehicle C1 acquired by the position information acquisition sensor 102. Furthermore, in this case, the predetermined action is also an action in which the occupant makes a sound regarding the location targeted for notification. For example, if the notification information is about a commercial facility that exists around the vehicle C1, such as an XYZ coffee shop, an action to emit a sound related to the XYZ coffee shop, such as "XYZ coffee is nice" or "XYZ coffee looks delicious", etc. can be a predetermined action. For example, if the information is about a tourist facility that exists around the vehicle C1, such as ABC Castle, a voice related to ABC Castle, such as "I like ABC Castle" or "I want to see ABC Castle", is emitted. The motion can be a predetermined action. The presence or absence of these voice-related actions can be determined based on the degree of matching (or similarity) between the voice information acquired by the voice input unit 103 and a predetermined keyword stored in the storage unit 130. Note that as a method for determining the degree of matching (or similarity) of voices, it is possible to employ a known voice recognition technique.

For example, if the notification information output in step S505 is notification information regarding commercial facilities, tourist facilities, etc. that exist around the vehicle C1, the timing when a predetermined period of time has elapsed since the display of the notification information is It may also be the end timing of the notification information. Alternatively, the timing for ending the notification information may be set to a time when the current location of the vehicle C1 is outside the display area of the notification information. For example, if the notification information is about a commercial facility that exists around the vehicle C1, such as an XYZ coffee shop, information is sent outside a predetermined area based on the XYZ coffee shop, for example, outside a 2 km radius around the XYZ coffee shop. It is possible to set the timing at which the vehicle C1 moves as the end timing of the notification information.

In step S507, the agent control unit 122 executes a notification information termination process to terminate the display of the notification information output in step S505, and after this termination process, executes a display process to display a face image. For example, if the notification information is about a commercial facility or a tourist facility, a deletion process is executed to erase the notification information, and a display process is executed to display a face image. Note that in the examples shown in FIGS. 5 to 9, the display unit that displays the face image moves when displaying the notification information. Therefore, in the facial image display process in step S507, the facial image is displayed after the display unit that displays the facial image is returned to its original position.

[Example of changing the timing of switching to broadcast information based on the importance of broadcast information]
FIG. 12 is a flowchart illustrating an example of notification information output processing in the information processing device 110. Further, this notification information output processing is executed by the control unit 120 based on a program stored in the storage unit 130. Moreover, this notification information output process is always executed in every control cycle. Further, this notification information output processing will be explained with reference to FIGS. 1 to 11 as appropriate.

Note that this output control process is a partial modification of the notification information output process shown in FIG. Specifically, the difference is that steps S511 and S512 are added to the notification information output process shown in FIG. 11. Note that other points than these are the same as the notification information output process shown in FIG. 11, so the same reference numerals as in FIG. 11 are given, and the description thereof will be omitted.

In step S511, the display switching determination unit 121 determines whether the importance of the notification information to be output is high. The importance of the broadcast information can be determined based on the urgency of the broadcast information, for example. For example, information regarding the driving of the vehicle C1 and the safety of the occupants of the vehicle C1 is assumed to have a high degree of urgency. Therefore, the importance of the notification information is set high for information regarding the driving of the vehicle C1 and the safety of the occupants of the vehicle C1. For example, the importance level of the notification information is set to be higher than the standard for notification information regarding seatbelt fastening, door ajar, remaining battery level, and the like. On the other hand, it is assumed that the level of urgency for providing information about the surroundings of the vehicle C1, tourist information, gourmet information, etc. is low. Therefore, regarding the provision of information around the vehicle C1, sightseeing information, gourmet information, etc., the importance of the notification information is set lower than the standard. For example, the importance level of the notification information regarding the facilities around the vehicle C1 (for example, restaurants, commercial facilities) is set to be low. Note that the level of importance of broadcast information is stored in the broadcast information DB 132 (see FIG. 3).

If the importance of the broadcast information to be output is high, the process advances to step S504. On the other hand, if the importance of the broadcast information to be output is low, the process advances to step S512.

In step S512, the agent control unit 122 executes an effect to smoothly erase the face image. Here, the effect of smoothly erasing the face image is realized, for example, by smoothly displaying the gesture of the face image. For example, the facial image can be smoothly deleted by expressing the gesture of the surprised facial image shown in FIG. 4(A) with a relatively slow movement and then deleting the facial image. In this way, in the case of broadcast information of low importance, there is little need to notify the user in a hurry, so it is possible to shift to output processing of the broadcast information while enhancing the creature-like nature of the agent device 200. . That is, it becomes possible to display the notification information after smoothly erasing the face image.

Note that in the examples shown in FIGS. 5 to 9, when displaying notification information, the display unit that displays the face image is moved. In such a case, it is assumed that the facial image becomes difficult to see due to the movement of the display unit. Therefore, in the examples shown in FIGS. 5 to 9, the process of smoothly erasing the face image may be omitted when switching the notification information.

Furthermore, if the importance of the notification information is low, the face image and the notification information may be temporarily displayed simultaneously. Alternatively, if the importance of the notification information is low, an effect may be performed in which the face image is gradually erased and the notification information is gradually displayed.

[Example of delaying the timing of switching to notification information based on the presence or absence of facial image production]
FIG. 13 is a flowchart illustrating an example of notification information output processing in the information processing device 110. Further, this notification information output processing is executed by the control unit 120 based on a program stored in the storage unit 130. Moreover, this notification information output process is always executed in every control cycle. Further, this notification information output processing will be explained with reference to FIGS. 1 to 12 as appropriate.

Note that this output control process is a partial modification of the notification information output process shown in FIG. 12. Specifically, the notification information output process shown in FIG. 12 differs in that the process in step S512 is omitted and the processes in steps S521 and S522 are added. Note that other points than these are the same as the notification information output process shown in FIG. 12, so the same reference numerals as in FIG. 12 are given, and the description thereof will be omitted.

In step S521, the display switching determination unit 121 determines whether or not the face image is being rendered. For example, if a predetermined exchange (for example, conversation) is occurring between the agent device 200 and the occupant of the vehicle C1, it is determined that the facial image is being rendered. Furthermore, for example, when the agent device 200 is performing a performance such as a behavior to appeal its autonomy (for example, behaving while sleeping or acting tired), it is determined that the facial image is being performed. Ru. For example, if the agent device 200 is behaving like it's going to sleep, and the agent device 200 is trying hard to send out advertising information for a ramen restaurant near the vehicle C1 as notification information, the user may feel uncomfortable. There is a risk of giving. In this case, there is a possibility that the user may no longer feel trustworthiness or attachment to the agent device 200 as a living thing. Therefore, in order to emphasize the autonomy of the agent device 200 and create a sense of unity in expressing autonomy, when the agent device 200 is performing a performance such as a behavior to appeal its autonomy, it is necessary to Avoid outputting low notification information. Thereby, it is possible to increase the reliability and attachment of the agent device 200 as a living thing, and it is possible to increase interest in the broadcast information. If the face image is being rendered, the process advances to step S522. On the other hand, if the face image is not being rendered, the process advances to step S504.

In step S522, the display switching determination unit 121 determines whether the notification information determined in step S503 is being generated. That is, it is assumed that for some reason it becomes unnecessary to output the broadcast information. In this way, when output of broadcast information is no longer necessary, it is determined that broadcast information is not being generated. If broadcast information is being generated, the process returns to step S521. On the other hand, if broadcast information is not being generated, the operation of broadcast information output processing is ended.

For example, in the case of broadcast information regarding an advertisement for a commercial facility, when the vehicle C1 moves far away from the commercial facility, it becomes unnecessary to output the broadcast information. Further, for example, in the case of broadcast information regarding an advertisement of a commercial facility, when a predetermined time (for example, about 10 minutes) has elapsed since the broadcast information was generated, the output of the broadcast information may not be necessary.

Here, it is important to prevent the switching effect of the agent device 200 from interfering with the driver while driving. For example, when a driver in the driver's seat is driving, the driver is aware of the switching effects of the agent device 200, but it is also assumed that the driver does not direct his/her line of sight in the direction of the agent device 200. be done. Therefore, it is preferable that the switching effect of the agent device 200 is performed while the vehicle C1 is stopped. However, if the target is a passenger other than the driver sitting in the driver's seat, the process may be executed while the vehicle C1 is running.

[Example of agent device that can be installed outside of vehicle]
Above, an example of the agent device 200 installed in the vehicle C1 has been shown. However, this embodiment is also applicable to agent devices that can be removed from the vehicle C1, agent devices that can be installed outside the vehicle, and the like. For example, when a user with a portable agent device gets into the vehicle C1, the agent device is installed on the dashboard 2 of the vehicle C1, and when the user gets off the vehicle C1, the user installs the agent device on the dashboard 2 of the vehicle C1. It is also assumed that people carry around in their possession. It is also assumed that users use agent devices at home.

For example, in a home, it is possible to output notification information regarding each device installed in the home. For example, it is envisaged that the notification will be given at the timing when the bath is boiled, when the cooking is finished using the cooking utensils, etc. Further, for example, when the entrance door or window is open, it is assumed that a notification to that effect is provided. Furthermore, for example, if the user forgets to turn off the gas stove, it is assumed that a notification to that effect will be provided. In these cases, it is assumed that notification information regarding the bath, various cooking utensils, doors, windows, etc. will be provided. Further, the degree of importance can be set based on safety, degree of urgency, etc. For example, for objects with a high degree of urgency, the importance level can be set higher than the standard, and for objects with a low degree of urgency, the importance level can be set lower than the standard. For example, objects with a high degree of urgency and objects whose safety must be maintained are a gas stove (to prevent forgetting to turn off the fire), an entrance door, and a window (to notify when it is open). On the other hand, objects with a low degree of urgency include, for example, a bath (notifies the timing when the bath is boiled) and cooking utensils (notifies the timing when cooking is finished).

[Example of representing an agent device in two dimensions]
The above description has been made using the three-dimensional agent device 200 as an example. However, as long as it is possible to express the creature-like appearance of the agent device, the present embodiment may be applied by displaying the agent image as a two-dimensional image. In this case, both the face and body are displayed as two-dimensional images.

[Example of effects of this embodiment]
Here, when switching the display target of the agent device 200 from the face image to the notification information, if the display target of the agent device 200 is simply switched from the face image to the notification information, the face image and the notification information are not clearly separated, so the agent device 200 has a feeling that it is a living thing. There is a risk of a shortage. For example, if notification information is mechanically displayed on the face 201 whose facial image is desired to be recognized, there is a risk that the user will recognize the face 201 as a machine. Furthermore, if the notification information is suddenly displayed after the face image is displayed, there is a risk that the user may be made to think that the display part of the face image is a mechanical display screen. In these cases, the user's degree of attachment to the agent device 200 may decrease, and there is a risk that the user's interest in the notification information displayed on the agent device 200 may decrease. In this case, it may be difficult to appropriately convey the broadcast information to the user.

Additionally, when switching the display target of the agent device 200 from facial images to notification information, if the facial images and notification information are displayed together, the user may be confused. Therefore, in this embodiment, instead of displaying the face image and the notification information together, a switching effect is executed from the time the face image is displayed to before the notification information is displayed, and the face image and the notification information are displayed separately. . That is, a switching effect is performed between the display of the face image and the display of the notification information so that the face image and the notification information are separated.

In this way, the switching effect is executed after the face image is displayed (or while the face image is being displayed), and the notification information is displayed after this switching effect is executed, so the notification information displayed after the switching effect is This allows the user to hold the camera in place. In other words, by clearly distinguishing between the face image display screen that displays emotional and emotional movements and the notification information display screen that reports predetermined information, the user can control to some extent the content that will be displayed after the switching effect is executed. Becomes predictable. For example, when a switching effect is executed from the display of a face image, the user can anticipate that important notification information will be displayed after this switching effect. In this way, by displaying the notification information after the execution of the switching effect, it is possible to predict the notification information, and it is possible to alleviate confusion caused to the user. This makes it possible to appropriately convey broadcast information.

Here, we will consider a case where the agent device 200 outputs the notification information without executing the switching effect, and a case where the notification information is output after executing the switching effect. In this case, it is assumed that the agent device 200 is more likely to feel like a living thing when the notification information is output after executing the switching effect than when the notification information is output without executing the switching effect. . Therefore, in this embodiment, the notification information is output after the switching effect is executed. Thereby, it becomes possible to make the user feel that the agent device 200 is like a living thing, and it becomes possible to appropriately convey notification information.

Furthermore, in this embodiment, by performing a performance that gives the agent device 200 a sense of intelligence while ensuring its autonomy, it is possible to efficiently convey notification information while maintaining the appearance of a living creature.

In addition, in this embodiment, when notification information with a high degree of urgency, for example, notification information with a high degree of importance, occurs, after quickly performing a switching effect to exclusively display the face image and notification information, It is possible to display notification information. In this way, by quickly performing the switching effect at least in an emergency, it becomes possible to make the user feel that the agent device 200 is like a living thing, and it becomes possible to quickly convey notification information.

Note that although the example above has shown an example in which the notification information output processing, etc. is executed in the agent device 200 and the information processing device 110 (or the information processing system 100), all or part of each of these processes may be executed in other devices. You may. In this case, each device that executes a part of each of these processes constitutes an information processing system. For example, in-vehicle devices, devices that can be used by users (e.g., smartphones, tablet terminals, personal computers, car navigation devices, IVI), various information processing devices such as servers that can be connected via a predetermined network such as the Internet, various At least a portion of each process can be performed using an electronic device.

Further, a part (or all) of the information processing system that can execute the functions of the information processing device 110 (or the information processing system 100) may be provided by an application that can be provided via a predetermined network such as the Internet. good. This application is, for example, SaaS (Software as a Service).

[Configuration example of this embodiment and its effects]
The information processing method according to this embodiment is an information processing method that provides notification information to a user using an agent device 200 having a display unit 210 (an example of a display device) that displays a face image. This information processing method includes a control process (steps S503 to S507) that controls the display mode of the display unit 210, and in the control process, when displaying notification information on the display unit 210, switching using the display unit 210 is performed. After performing the performance and erasing the display of the face image, notification information is displayed. Further, the program according to the present embodiment is a program that causes a computer to execute each of these processes. In other words, the program according to this embodiment is a program that causes a computer to implement each function that can be executed by the information processing device 110.

According to this configuration, when switching from the face image to the notification information, the display unit 210 is used to perform a switching effect, for example, displaying a surprised expression, so that the user feels like a living creature, and the notification information is not notified. It becomes possible to increase the user's interest in the subject. This makes it possible to more appropriately notify the user of the notification information.

In the information processing method according to the present embodiment, the display unit 210 includes a first display unit (

display units

241, 252, 264, 271, 281, 300, and 324) that displays a face image, and a second display unit that displays notification information. display units (

display units

242, 253, 265, 272 and 282, 310, 325), and in the control process (steps S504, S505), when displaying the notification information on the second display unit, the first display unit After performing a switching effect on at least one of the display section and the second display section and erasing the display of the face image on the first display section, the notification information is displayed on the second display section. For example, as a switching effect using the first display section, a surprised facial expression may be displayed, or as a switching effect using the first display section and the second display section, a housing equipped with the first display section and the second display section may be used. It is possible to rotate. Further, for example, by displaying an image with different display characteristics on at least one of the first display section and the second display section, a switching effect using the first display section or the second display section may be executed. is also possible.

According to this configuration, by executing the switching effect when switching from the face image to the notification information, it is possible to make the user feel like a living thing and increase the user's interest in being notified of the notification information. . Moreover, the difference in the display units that display the facial image and the notification information allows the user to clearly distinguish between the facial image and the notification information. Therefore, it becomes possible to more appropriately notify the user of the notification information.

In the information processing method according to the present embodiment, in the control process (step S504), an effect of moving the display unit 210 is executed as a switching effect. For example, as shown in FIGS. 5(A)(B), FIGS. 6(A)(B), FIGS. 7(A) to (C), FIGS. Then, a switching effect is executed to move the display section of the agent device 200.

According to this configuration, by performing an effect of moving the display unit 210 when switching from the face image to the notification information, the user is made to feel like a living thing, and the user's interest in being notified of the notification information is increased. becomes possible. Therefore, it becomes possible to more appropriately notify the user of the notification information.

In the information processing method according to the present embodiment, the display unit 210 (an example of a display device) is provided with a first display unit (

display units

252, 264, and 324) on one surface that displays face images, and displays notification information. The second display section (display section 253, 265, 325) to display is composed of a cube-shaped or rectangular parallelepiped-shaped housing provided on another surface different from one surface, and in the control processing (steps S504, S505) , when displaying notification information on the second display section, a rotation operation that switches the side of the display device visible to the user from one side to another side is performed as a switching effect, and the face image on the first display section is After erasing the display, the notification information is displayed on the second display section.

According to this configuration, when switching from the face image to the notification information, the rotating motion of the display unit 210 is executed as a switching effect, thereby making the user feel that the movement of the face looks like a living thing, and the notification information is This makes it possible to increase the user's interest in what is being done. Therefore, it becomes possible to more appropriately notify the user of the notification information.

In the information processing method according to the present embodiment, the display unit 210 (an example of a display device) is provided with a first display unit (display units 252, 264) on one side, and a first display unit (display units 252, 264) on the opposite side of the first side. It consists of a flat case in which a second display section (display sections 253, 265) is provided on the other surface, and in the control process (step S504), the first display section and the second display section are arranged around the rotation axis. A rotation action of rotating the part by 180 degrees is executed as a switching effect. For example, as shown in FIGS. 5A and 5B and 6A and 6B, a switching effect is performed in which the display section of the agent device 200 is rotated.

According to this configuration, when switching from the face image to the notification information, the rotating motion of the display unit 210 is executed as a switching effect, so that the agent's face moves like a living creature, such as turning backwards or downwards. It is possible to make the user feel it. Thereby, it becomes possible to increase the user's interest in being notified of the broadcast information, and it becomes possible to notify the user of the broadcast information more appropriately.

In the information processing method according to the present embodiment, the display section 210 (an example of a display device) is provided with a display section 324 (an example of a first display section) on one surface, and the other surface is adjacent to the first surface. It consists of a cube-shaped or rectangular parallelepiped-shaped housing in which a display section 325 (an example of a second display section) is provided on the surface thereof. A rotation action of rotating 90 degrees is performed as a switching effect. For example, as shown in FIGS. 9A and 9B, a switching effect is performed in which the

display units

324 and 325 of the agent device 200 are rotated.

According to this configuration, it is possible to give the user an interesting impression that the notification information is displayed on the back behind the face of the agent device 200 (or on the abdomen in front of the face). Thereby, it is possible to give the user a feeling of being like a living thing, and it is possible to increase the user's interest in the broadcast information.

In the information processing method according to the present embodiment, the display section 210 (an example of a display device) has a first display section 271 provided on one surface, and a second display section 272 provided on the surface opposite to the one surface. The display panel 270 includes a flat display panel 270 and a display section 280 (an example of a third display section). The display unit 210 is provided in a first state in which a face image is displayed in a first display area constituted by a first display unit 271 and a part of a display unit 280, and a first state in which a face image is displayed in a first display area configured by a first display unit 271 and a part of a display unit 280. The control process (steps S504, S505 ), when displaying notification information on the display unit 210, a switching effect is performed in which the display panel 270 is rotated to transition from the first state to the second state, and the face image in the first display area is After erasing the display, the notification information is displayed in the second display area. For example, as shown in FIGS. 7A to 7C, a switching effect is performed in which the display panel 270 of the agent device 200 is rotated.

According to this configuration, since the display panel 270 is rotated and the notification information is switched from the face image, the unexpected movement of the display panel 270 makes the user feel like a living creature, and the notification information is This makes it possible to increase the user's interest in what is being done. Therefore, it becomes possible to more appropriately notify the user of the notification information.

In the information processing method according to the present embodiment, the display unit (an example of a display device) includes a display unit 300 (an example of a first display unit) that displays a face image, and a display unit 310 (an example of a second display unit) that displays notification information. The display section 300 has a first state where the display surface of the display section 310 is covered in front of the display section 310, and a state where the display section 300 is slid in a direction substantially parallel to the display surface of the display section 310 so that the user can view the display section 300. The display screen and the display screen of the display unit 310 are installed so as to be able to be changed to a second state in which the display screen can be viewed, and in the control processing (steps S504 and S505), when displaying notification information on the display unit 310 To do this, a switching effect is performed in which the display section 300 is slid to transition from the first state to the second state, and after erasing the display of the face image on the display section 300, a notification is sent to the display section 310. Display information.

According to this configuration, since the display unit 300 is slid and the notification information is switched from the face image, the unexpected movement of the display unit 300 makes the user feel like a living thing, and the notification information is It becomes possible to increase the user's interest in being notified. Therefore, it becomes possible to more appropriately notify the user of the notification information.

In the information processing method according to the present embodiment, the display unit 210 (an example of a display device) switches at least one of a three-dimensional image and a two-dimensional image, a high image quality and a low image quality, and a color image and a monochrome image. It is possible to display each image with different display characteristics, and in the control processing (steps S504 and S505), when displaying notification information on the display unit 210, display characteristics different from those used when displaying the face image are used. After executing the effect of displaying a predetermined image as a characteristic as a switching effect and erasing the display of the face image on the display section 210, the notification information is displayed on the display section 210.

According to this configuration, by displaying the notification information as a different display characteristic when switching from the face image to the notification information, it is possible to make the user feel like a living thing and increase the user's interest in being notified of the notification information. becomes possible. Furthermore, the difference in display characteristics allows the user to clearly distinguish between the facial image and the notification information. Therefore, it becomes possible to more appropriately notify the user of the notification information.

In the information processing method according to the present embodiment, the display unit 210 (an example of a display device) includes a first display unit (

display units

241, 252, 264, 271, 281, 300, and 324) that displays a face image, and a a second display section (

display sections

242, 253, 265, 272 and 282, 310, 325) that displays information; At least one of a low image quality, a color image, and a monochrome image has different display characteristics, and in the control process (steps S504 and S505), when displaying notification information on the second display section, the first display section After performing a switching effect on at least one of the display section and the second display section and erasing the display of the face image on the first display section, the notification information is displayed on the second display section.

According to this configuration, when switching from the face image to the notification information, by displaying the notification information on the second display section that has different display characteristics, the user can feel like a living thing, and the user can feel that the notification information is being notified. It becomes possible to increase user interest. Furthermore, the difference in display characteristics allows the user to clearly distinguish between the facial image and the notification information. Therefore, it becomes possible to more appropriately notify the user of the notification information.

In the information processing method according to the present embodiment, in the control processing (steps S504, S511, S512), the degree of importance is determined based on the degree of urgency of the notification information, and based on the degree of importance of the notification information, the degree of importance is determined from the display of the face image. Change the timing of switching to the display of notification information.

According to this configuration, broadcast information with high importance can be outputted quickly, and broadcast information with low importance can be outputted at an appropriate timing. Therefore, it becomes possible to more appropriately notify the user of the notification information.

In the information processing method according to the present embodiment, in the control process (steps S504, S511, S512, S521, S522), if the importance of the broadcast information is higher than the standard, the face When switching from displaying an image to displaying notification information, and when the importance of the notification information is lower than the standard, when the face image displayed on the display unit 210 (an example of a display device) is performing a predetermined effect. , after the predetermined effect is completed, the display of the face image is switched to the display of the notification information, and when the face image displayed on the display unit 210 is not performing the predetermined effect, after the notification information is generated, Switch from displaying face images to displaying notification information.

According to this configuration, it is possible to output notification information of high importance quickly, and output notification information of low importance at an appropriate timing according to the presentation state of the face image. Therefore, it becomes possible to more appropriately notify the user of the notification information.

The information processing device 110 is an information processing device that provides notification information to a user using an agent device 200 that has a display unit 210 (an example of a display device) that displays a facial image. The information processing device 110 includes a control unit 120 that controls the display mode of the display unit 210, and when displaying notification information on the display unit 210, the control unit 120 executes a switching effect using the display unit 210. , and after erasing the display of the face image, the notification information is displayed on the display unit 210. Further, an information processing system that can execute each process realized by the information processing device 110 may be used.

Note that each processing procedure shown in this embodiment is an example for realizing this embodiment, and the order of a part of each processing procedure may be changed to the extent that this embodiment can be realized. Often, a part of each processing procedure may be omitted or other processing steps may be added.

Note that each process shown in this embodiment is executed based on a program for causing a computer to execute each process procedure. Therefore, this embodiment can also be understood as an embodiment of a program that implements the function of executing each of these processes, and a recording medium that stores the program. For example, when an update process is performed to add a new function to an information processing device, the program can be stored in the storage device of the information processing device. This makes it possible to cause the updated information processing device to perform each process described in this embodiment.

Although the embodiments of the present invention have been described above, the above embodiments merely show a part of the application examples of the present invention, and are not intended to limit the technical scope of the present invention to the specific configurations of the above embodiments. do not have.

Note that this application claims priority based on Japanese Patent Application No. 2022-135323 filed with the Japan Patent Office on August 26, 2022, and the entire contents of this application are incorporated herein by reference.

Claims

An information processing method for providing notification information to a user using an agent device having a display device that displays a face image, the method comprising:
including a control process for controlling a display mode of the display device,
In the control process, when displaying the notification information on the display device, performing a switching effect using the display device, and displaying the notification information after erasing the display of the face image.
Information processing method.
The information processing method according to claim 1,
The display device includes a first display section that displays the face image, and a second display section that displays the notification information,
In the control process, when displaying the notification information on the second display section, a switching effect is executed on at least one of the first display section and the second display section, and displaying the notification information on the second display unit after erasing the display of the face image on the display unit;
Information processing method.
The information processing method according to claim 1,
In the control process, performing an effect of moving the display device as the switching effect;
Information processing method.
The information processing method according to claim 3,
The display device is a cube in which a first display section for displaying the face image is provided on one surface, and a second display section for displaying the notification information is provided on another surface different from the one surface. Consisting of a casing in the shape of a rectangular parallelepiped,
In the control process, when displaying the notification information on the second display section, a rotation operation that switches a surface of the display device that is visible to the user from the one surface to the other surface is performed as the switching effect. and displaying the notification information on the second display section after erasing the display of the face image on the first display section;
Information processing method.
The information processing method according to claim 4,
The display device is a flat case in which the first display section is provided on the one surface, and the second display section is provided on the other surface that is the opposite surface to the one surface. Consisting of
In the control process, a rotation operation of rotating the display device 180 degrees around a rotation axis is executed as the switching effect.
Information processing method.
The information processing method according to claim 4,
The display device has a cubic or rectangular parallelepiped shape, and the first display section is provided on the one surface, and the second display section is provided on the other surface that is adjacent to the one surface. Consists of a casing,
In the control process, a rotation operation of rotating the display device 90 degrees around a rotation axis is executed as the switching effect.
Information processing method.
The information processing method according to claim 3,
The display device includes a flat display panel having a first display section on one surface and a second display section on the opposite surface of the first surface, and a third display section. ,
The display panel is provided on the third display section so as to be rotatable about one end of the display panel,
The display device has a first state in which the face image is displayed in a first display area configured by the first display section and a part of the third display section by a rotational operation of the display panel; controlled to be in any one of the display states of a second state in which the notification information is displayed in a second display area formed by the second display section and a part of the third display section;
In the control process, when displaying the notification information on the display device, an effect of rotating the display panel to transition from the first state to the second state is executed as the switching effect, and displaying the notification information in the second display area after erasing the display of the face image in the first display area;
Information processing method.
The information processing method according to claim 3,
The display device includes a first display section that displays the face image, and a second display section that displays the notification information,
The first display section is arranged in a first state in front of the second display section to cover the display surface of the second display section and in a direction substantially parallel to the display surface of the second display section so that the user can installed so as to be able to transition to a second state in which the display surface of the first display section and the display surface of the second display section can be viewed;
In the control process, when displaying the notification information on the second display section, the switching effect is an effect of transitioning from the first state to the second state by sliding the first display section. displaying the notification information on the second display unit after executing the display and erasing the display of the face image on the first display unit;
Information processing method.
The information processing method according to claim 1,
The display device is capable of displaying each image with different display characteristics by switching at least one of a three-dimensional image and a two-dimensional image, a high image quality and a low image quality, a color image and a monochrome image,
In the control process, when displaying the notification information on the display device, executing as the switching effect an effect of displaying a predetermined image having display characteristics different from display characteristics when displaying the face image, and , displaying the notification information on the display device after erasing the display of the face image on the display device;
Information processing method.
The information processing method according to claim 1,
The display device includes a first display section that displays the face image, and a second display section that displays the notification information,
The first display section and the second display section have different display characteristics for at least one of a three-dimensional image and a two-dimensional image, a high image quality and a low image quality, a color image and a monochrome image,
In the control process, when displaying the notification information on the second display section, a switching effect is executed on at least one of the first display section and the second display section, and displaying the notification information on the second display unit after erasing the display of the face image on the display unit;
Information processing method.
The information processing method according to any one of claims 1 to 10,
In the control process, the degree of importance is determined based on the degree of urgency of the notification information, and the timing of switching from displaying the face image to displaying the notification information is changed based on the degree of importance of the notification information.
Information processing method.
The information processing method according to claim 11,
In the control process,
If the importance of the notification information is higher than a standard, immediately after the notification information is generated, switching from displaying the face image to displaying the notification information,
When the importance of the notification information is lower than the standard, and when the face image displayed on the display device is performing a predetermined effect, after the predetermined effect is finished, the display of the face image is stopped. When the display of the notification information is switched to, and the face image displayed on the display device is not performing the predetermined effect, after the notification information is generated, the display of the notification information is switched from the display of the face image to the display of the notification information. switch to,
Information processing method.
An information processing device that provides notification information to a user using an agent device having a display device that displays a face image,
comprising a control unit that controls a display mode of the display device,
When displaying the notification information on the display device, the control unit executes a switching effect using the display device, and displays the notification information after erasing the display of the face image.
Information processing device.