JP2023135476A - Information processing system, information processing method, program, and storage medium - Google Patents

Abstract

To provide a technique capable of appropriately notifying a driver of a vehicle of a reminder on a mover.SOLUTION: An information processing system includes an information processing device and a vehicle. The information processing device comprises: first acquisition means for acquiring data related to travel of the vehicle from the vehicle; second acquisition means for acquiring location information on a communication device carried by a mover; determination means for determining whether action by the mover carrying the communication device is nonroutine action on the basis of the location information from the communication device; and provision means for providing the vehicle with action information showing whether the action by the mover is nonroutine action. The vehicle includes control means for, when action information is provided, controlling notification means so as to urge the driver of the vehicle to take precautions on the basis of the action information. When the action information indicates that the action of the mover at a specific point is nonroutine action and the vehicle is associated with the specific point, the control means controls the notification means so as to urge the driver of the vehicle to take precautions in a mode different from the mode when the action of the mover is routine action.SELECTED DRAWING: Figure 6A

Description

The present invention relates to an information processing system, an information processing method, a program, and a storage medium.

In recent years, technology has become known that notifies parents based on the actions of the person being watched. Patent Document 1 discloses that a roadside device 5 receives pedestrian information from a pedestrian terminal owned by a person to be watched over, accumulates traffic history information, and when the target person does not pass during the scheduled traffic time, The company discloses technology that determines that an abnormal situation has occurred and notifies parents.

In addition, Patent Document 2 discloses that the day of the week and time of day when an elderly person or pregnant woman rides a bus is acquired, and when the elderly person approaches the vicinity of a roadside machine as usual, the driver is notified of the bus to stop. Discloses user support technology.

International Publication No. 2019/049444 JP2019-53371

By the way, when a child or the like who is being watched over moves by walking, it is desirable to call attention to vehicles traveling around the child in order to ensure their safety. However, by notifying the driver every time the vehicle approaches the person to be monitored, there is a possibility that the traveler may become accustomed to the notification and be unable to take prompt action in response to serious danger. Alternatively, if the traveler finds the notification bothersome, it is possible that the notification function may be stopped.

The present invention has been made in view of the above-mentioned problems, and its purpose is to realize a technique that can appropriately notify a driver of a vehicle of a warning regarding a moving person.

According to the invention,
An information processing system including an information processing device and a vehicle,
The information processing device includes:
a first acquisition means for acquiring data related to the traveling of the vehicle from the vehicle;
a second acquisition means for acquiring location information of a communication device carried by a moving person;
determination means for determining whether the behavior of the traveler carrying the communication device is an unusual behavior based on the position information from the communication device;
providing means for providing the vehicle with behavioral information indicating whether or not the moving person's behavior is an unusual behavior;
The vehicle has a control means that controls a notification means to call attention to a driver driving the vehicle based on the behavior information when the vehicle is provided with the behavior information,
If the behavior information indicates that the behavior of the traveler at a specific point is an unusual behavior, and the vehicle is associated with the specific point, the control means may cause a driver of the vehicle to An information processing system is provided, characterized in that the notification means is controlled so as to call attention to the movement in a manner different from the case where the movement indicates that the movement is a daily movement.

According to the present invention, it is possible to appropriately notify a driver of a vehicle of a warning regarding a moving person.

A diagram showing an example of an information processing system according to an embodiment of the present invention Block diagram showing an example of functional configuration of a vehicle according to an embodiment Block diagram showing an example of functional configuration of a communication device according to an embodiment Block diagram showing an example of functional configuration of an information processing device according to an embodiment A diagram illustrating an example of data transmitted from a vehicle to an information processing device according to an embodiment. Flowchart showing a series of operations of behavior information provision processing according to the embodiment Flowchart showing a series of operations of notification control processing according to the embodiment Diagram (1) illustrating an example of a behavior map provided according to the embodiment Diagram (2) illustrating an example of a behavior map provided according to the embodiment Diagram (3) illustrating an example of a behavior map provided according to the embodiment Diagram (4) illustrating an example of the behavior map provided according to the embodiment

Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the claimed invention, and not all combinations of features described in the embodiments are essential to the invention. Two or more features among the plurality of features described in the embodiments may be arbitrarily combined. In addition, the same or similar configurations are given the same reference numerals, and duplicate explanations will be omitted.

<Configuration of information provision system>
With reference to FIG. 1, the configuration of an information processing system 10 according to this embodiment will be described. The information processing system 10 includes, for example, a vehicle 100, a server 110 as an example of an information processing device, and a communication device 120.

Vehicle 100 is, for example, a four-wheeled vehicle driven by a driver, but may also be a two-wheeled vehicle. Vehicle 100 connects to network 140 via wireless communication such as Wi-Fi or fifth generation mobile communication, for example. Vehicle 100 can measure internal and external conditions of the vehicle (such as the position of the vehicle, driving conditions, and targets of surrounding objects) using various sensors, and can transmit the measured data to server 110 . The data collected and transmitted in this way is generally also called floating data, probe data, traffic information, etc. This information regarding the vehicle (floating data) is sent to the server 110 at regular intervals or in response to the occurrence of certain events.

Server 110 acquires vehicle-related information transmitted from vehicle 100 and position information transmitted from communication device 120 via network 140 . Additionally, the server 110 can acquire information related to the driving position, driver attribute information, and statistical information regarding traffic accidents from one or more external servers (not shown). The driving position related information includes, for example, weather information at each location where the vehicle travels and information indicating sunrise and sunset times. The driver's attribute information includes, for example, information such as the driver's gender, age, and place of residence. The statistical information regarding traffic accidents includes, for example, statistical information regarding traffic accidents depending on driver attributes. The information related to the driving position and the driver's attribute information are also referred to as environmental information in the following explanation.

The communication device 120 is a device that can be carried by a mobile person 130, such as a child, and is a wearable terminal that can be worn on a part of the body, such as the shoulder. The communication device 120 is not limited to this, and may be a portable terminal such as a smartphone, a tablet terminal, a game machine, or the like. The communication device 120 connects to the network 140 via wireless communication such as Wi-Fi or fifth generation mobile communication, for example. The communication device 120 transmits location information of the communication device 120 based on a GPS signal or the like to the server 110. In the following embodiment, a case will be explained in which the moving person 130 is a pedestrian, but the present invention is applicable not only to a pedestrian but also to a case where the moving person 130 is riding a bicycle.

Network 140 includes, for example, a communication network such as the Internet or a mobile phone network, and transmits information between server 110 and vehicle 100 and between server 110 and communication device 120.

For example, when driving around a school route where there are children attending school, drivers should be careful not to follow the children as they are likely to be walking or cycling during normal school hours. You may need to be careful while driving. Although it is unlikely that a child is commuting to school during times other than normal school hours, due to school events, schedule changes, etc., children may be commuting to and from school at times other than normal school hours (i.e. In some cases, it may not be a proper action). For this reason, it is necessary to give appropriate warnings to drivers when commuting to school and when the driver thinks that there are no children present, which is different from when the driver is engaged in daily activities. be.

In this information processing system 10, the server 110 determines whether the mover's behavior is unusual based on the position information of the communication device 120, and determines whether the mover's behavior is unusual. Provides the vehicle with behavioral information indicating whether or not the vehicle is present. If the behavior information indicates that the behavior of the traveler at a specific point is an unusual behavior, and the vehicle is passing or is planning to pass through that specific point, the vehicle will notify the driver of the vehicle that the movement is unusual. This system provides a warning that calls for more attention than when the person is taking daily actions.

<Vehicle configuration>
An example of the functional configuration of the vehicle 100 according to the present embodiment will be described with reference to FIG. 2. Note that each of the functional blocks described with reference to the subsequent figures may be integrated or separated, and the functions described may be realized by separate blocks. Additionally, what is described as hardware may be implemented in software, or vice versa.

The sensor unit 201 may include various sensors such as a GPS, a gyro sensor, an acceleration sensor, and other sensors that output acceleration, position information, steering angle, etc. of the vehicle 100. It also includes a camera that outputs a photographed image of the front of the vehicle (and the surroundings and interior of the vehicle). The sensor unit 201 may further include a Lidar (Light Detection and Ranging) that measures the distance in front of (and around) the vehicle and outputs a distance image obtained. The sensor unit 201 may include an image recognition function capable of detecting a route and a traveling vehicle, and may further include a function to detect activation of a collision mitigation brake and a route departure prevention function, and a function to monitor an inter-vehicle distance.

The communication unit 202 is a communication device including, for example, a communication circuit, and communicates with the server 110, surrounding transportation systems, etc. via mobile communication standardized as, for example, LTE, LTE-Advanced, or so-called 5G. The communication unit 202 receives part or all of map data, traffic information, etc. from other information processing servers and surrounding transportation systems.

The operation unit 203 includes operation members such as buttons and a touch panel installed in the vehicle 100, as well as members such as a steering wheel and a brake pedal that accept inputs for driving the vehicle 100. The power supply section 204 includes a battery such as a lithium ion battery, and supplies power to each section within the vehicle 100. The power unit 205 includes, for example, an engine and a motor that generate power for driving the vehicle.

The driving control unit 206 controls the driving of the vehicle 100 by converting the operation by the driver into a control amount or correcting the control amount. Note that in the description of this embodiment, the travel control section 206 is illustrated as having a configuration different from the control section 208, but it may be included in the control section 208.

The storage unit 207 includes a nonvolatile large-capacity storage medium (storage device) such as a semiconductor memory. The actual image output from the sensor unit 201 and other various sensor data output from the sensor unit 201 are temporarily stored.

Control unit 208 includes, for example, CPU 210, RAM 211, and ROM 212, and controls the operation of each part of vehicle 100. Further, the control unit 208 acquires image data from the sensor unit 201 and executes, for example, a route deviation prevention function and a following distance monitoring function. The control unit 208 allows the CPU 210 to develop a computer program stored in the ROM 212 into the RAM 211 and execute it, thereby allowing each unit of the control unit 208, such as the vehicle running data providing unit 214, to perform its functions. Furthermore, the control unit 208 executes a notification control process, which will be described later, by executing the computer program.

The notification unit 209 is a device that can output audio, vibration, light, etc. to the driver. For example, it may include a speaker that outputs audio, a vibration element attached to the handle that outputs vibration, a display panel that outputs images, etc. It is possible to change the operating frequency per unit time of the speaker, vibration element, and display panel, and to change the intensity of notification such as output intensity (volume, vibration intensity, display brightness).

CPU 210 includes one or more processors. The RAM 211 is composed of a volatile storage medium such as a DRAM, and functions as a work memory for the CPU 210. The ROM 212 is composed of a nonvolatile storage medium, and stores computer programs executed by the CPU 210, setting values for operating the control unit 208, and the like. The control unit 208 may include one or more other processors (eg, GPU) to perform image processing at high speed.

The navigation information generation unit 213 generates route candidates to the destination based on destination information set by the driver. When the driver selects a route to travel, the route the vehicle will travel is transmitted to the server 110. The navigation information generation unit 213 monitors the route that the vehicle 100 is traveling, and when the vehicle 100 deviates from the planned route, generates a new route and sends the generated route to the server 110. do.

Vehicle running data providing section 214 transmits various data collected from sensor section 201 to server 110 as information regarding the vehicle. At this time, information identifying the vehicle 100, information identifying the driver, and the like may be added to the information regarding the vehicle and transmitted.

The behavior information acquisition unit 215 acquires behavior information generated by the server 110. Behavior information will be described later. The notification control unit 216 performs notification control processing to control the notification to the driver by the notification unit 209 using voice, vibration, or the like. The notification control process will be described later.

<Communication device configuration>
Next, a configuration example of the communication device 120 will be described with reference to FIG. 3. The configuration shown in FIG. 3 shows functional blocks that constitute a wearable device as an example of the communication device 120 of this embodiment. Note that each of the functional blocks to be described may be integrated or separated, and the functions to be described may be realized by separate blocks. Also, what is described as hardware may be implemented in software, or vice versa.

The communication unit 301 is a communication device including, for example, a communication circuit, and transmits and receives necessary data to and from the server 110 via mobile communication such as LTE.

The operation unit 303 includes buttons and a touch panel provided in the communication device 120, and can operate a GUI for various operations displayed on a display unit (display) not shown. The sensor unit 304 includes a GPS for identifying the current position, as well as an acceleration sensor and a gyro sensor that measure the acceleration and rotation of the communication device 120. The output device 305 includes one or more of a speaker, a vibration element, and a display panel such as an LCD or an OLED.

The storage unit 306 includes, for example, a nonvolatile memory such as a semiconductor memory, and stores programs and the like executed by the control unit 302.

The control unit 302 includes a CPU 310 and a RAM 311, and controls the operation of each functional block in the control unit 302 and each unit in the communication device 120, for example, by the CPU 310 executing a program stored in the storage unit 306.

The location information providing unit 312 acquires the location information, acceleration information, etc. from the sensor unit 304, and uses the location information of the communication device 120, the moving direction of the communication device 120, the moving acceleration of the communication device 120, etc. as location information, and sends the information to the server. 110.

<Configuration of information processing device>
Furthermore, the configuration of the server 110 as an example of the information processing apparatus according to this embodiment will be described with reference to FIG. 4. Server 110 is composed of one or more server devices. Note that each of the functional blocks to be described may be integrated or separated, and the functions to be described may be realized by separate blocks. Additionally, what is described as hardware may be implemented in software, or vice versa.

Communication unit 401 includes a communication circuit that communicates with communication device 120 and vehicle 100 via network 140.

The control unit 402 includes a CPU 410, which is a central processing unit, and a RAM 411. The control unit 402 controls the operation of each unit inside the control unit 402 and the operation of each unit of the server 110 by expanding the program stored in the storage unit 403 into the RAM 411 and executing it. Further, the control unit 402 executes behavior information providing processing, which will be described later. The RAM 411 includes a volatile storage medium such as a DRAM, and temporarily stores parameters, processing results, etc. for the control unit 402 to execute a program.

The storage unit 403 includes, for example, a nonvolatile storage medium such as a semiconductor memory, and stores setting values and programs necessary for the operation of the server 110. The storage unit 403 stores vehicle-related information received from a plurality of vehicles via the communication unit 401. Information regarding the vehicle may include data obtained from various data sources, such as shown in FIG. 5, for example. Examples include data based on gyro sensors and acceleration sensors, vehicle data, data based on advanced driving support technology, data obtained from drive recorders and smartphones, and the like. The data based on the gyro sensor/acceleration sensor includes data indicating operating characteristics of the driver during driving, such as the strength of the accelerator and the strength of the brakes. The vehicle data also includes data indicating the appropriateness of vehicle operation necessary for safe driving. Data based on advanced driver assistance technology includes the history of functions activated by the vehicle to prevent danger. In addition, vehicle-related information includes image information taken with a drive recorder that shows the driver checking his/her surroundings, and history information on smartphone operations while driving (i.e., records of actions that may impede safe driving). May include.

The storage unit 403 also stores the above-mentioned environmental information acquired from one or more external servers (not shown), that is, information related to the driving position (for example, weather information at each point where the vehicle travels, and sunrise and sunset information). (including information indicating the time of day) and driver attribute information (including information such as the driver's gender, age, place of residence, etc.). Furthermore, the storage unit 403 stores statistical information regarding traffic accidents (including, for example, statistical information regarding traffic accidents depending on driver attributes).

The driving data acquisition unit 412 acquires the above information regarding the vehicle from each of the plurality of vehicles and stores it in the storage unit 403. The driving data acquisition unit 412 may store information about the vehicle in association with information that identifies the vehicle. Note that the information regarding the vehicle does not necessarily need to be stored in the storage unit 403, and may be handled by the control unit 402 in real time.

The position information acquisition unit 413 acquires the above-mentioned position information (position information of the communication device 120, movement direction of the communication device 120, movement acceleration of the communication device 120, etc.) from each of the plurality of communication devices, and stores the information in the storage unit 403. to be memorized. Location information constitutes time series data. Note that the position information does not necessarily need to be stored in the storage unit 403, and may be handled by the control unit 402 in real time.

The daily behavior determination unit 414 determines whether the behavior of the traveler carrying the communication device 120 is an unusual behavior based on the traveler's behavior information. For example, the daily behavior determination unit 414 inputs the location information acquired for each traveler and the time information associated with the location information into the machine learning model. This machine learning model classifies whether the behavior of the traveler carrying the communication device 120 is an unusual behavior based on the input time series data. In other words, this machine learning model is a classifier that detects abnormalities regarding the behavior of each traveler. Note that the moving direction, moving acceleration, etc. included in the position information are not essential. The daily behavior determining unit 414 uses this machine learning model to determine whether the behavior of the traveler carrying the communication device 120 is an unusual behavior. The daily behavior determination unit 414 determines the behavior of each of the plurality of travelers, thereby creating a map containing information indicating whether the behavior of the traveler is unusual for each point where the plurality of travelers are present. Create information. In this embodiment, the map information is referred to as behavior information.

Behavior information according to this embodiment will be explained with reference to FIGS. 7A to 7D. FIG. 7A schematically shows behavior information 700 represented by a two-dimensional mesh superimposed on a map. The behavior information 700 is information indicating, for each area (or point) of a predetermined size, whether or not the behavior of a traveler existing in that area (or point) is an unusual behavior. In this embodiment, the daily behavior determination unit 414 of the server 110 determines whether the behavior of the traveler is unusual for each area (point), and determines whether the behavior of the traveler is unusual for each area. Behavior information 700 indicating whether or not is created is created.

For example, the example in FIG. 7A shows that there is a traveler whose behavior is determined to be unusual in an area (point) 701. Area 702 indicates that the mover's behavior is not unusual. In other words, this area is an area (point) where there are no movers whose actions are determined to be daily activities, or where there are no movers.

For example, suppose that at a predetermined school, the school attendance time is set to be about two hours later than usual for one day due to an event or the like. In this case, it is assumed that the students arrive at school two hours late, and the machine learning model of the daily behavior determination unit 414 determines that the students who arrive at school two hours late are engaging in unusual behavior. In the example of FIG. 7A, area 701 indicates that the mover's (student's) behavior is unusual. In this example of a student whose school attendance time is set to be two hours late, this indicates that there are no people moving in area 702 (because if there is a student who is moving, it is determined that the behavior is unusual). (becomes area 701).

FIG. 7B shows an area 703 associated with an area where a plurality of travelers constituting a predetermined group simultaneously perform unusual actions. For example, the movers are children, and the predetermined group is composed of children who attend a predetermined school. The school route as an example of the area 703 may be an area estimated from, for example, position information and time information acquired from the communication devices 120 of a plurality of students, and a repeating pattern thereof.

FIG. 7C shows a case where a traveler who is determined to be acting in an unusual manner exists in area 704 in a part of area 703 that is estimated to be the school route shown in FIG. 7B. . When the daily behavior determination unit 414 detects the presence of a traveler who behaves in an unusual manner on a part of the school route, for example, as shown in FIG. is determined as an area 701 indicating that the mover's behavior is an unusual behavior. Then, the behavior information providing unit 415 provides behavior information as shown in FIG. 7D to vehicles traveling in the school route area or vehicles scheduled to travel in this area. In this way, it becomes possible to notify even vehicles traveling on the school route at a point different from the first detected area 704 as soon as possible after the unusual behavior is detected.

Assuming that the student's commuting time is two hours, after a predetermined period of time (for example, two hours) has elapsed since the area 704 was detected, the behavior of the person traveling is shown to be unusual. The flag may be returned to its original state. That is, the area 701 is canceled to indicate that the mover's behavior is not an unusual behavior. The predetermined time for correcting the flag may be set in advance depending on, for example, the time distribution of students commuting to school.

The behavior information providing unit 415 provides the vehicle with the behavior information generated to indicate whether or not the traveler's behavior is an unusual behavior. The behavior information providing unit 415 compares the information indicating whether the traveler's behavior is unusual for each point with the route setting information or route prediction information of the vehicle 100, and determines whether the behavior is unusual. It is also possible to identify vehicles that can travel through the specified locations. In this way, behavior information can be provided to a vehicle that is traveling at a location where it has been determined that there is an unusual behavior or a vehicle that is scheduled to travel at that location.

In this way, in this embodiment, by detecting abnormalities at each location using human behavior data acquired by the communication device 120 carried by children, etc., unusual situations at each location are extracted. The vehicle can be notified. In addition, if unusual behavior is detected in any one of the areas where multiple travelers constituting a predetermined group (such as a school route) simultaneously act in an unusual manner, the school route The entire area is determined as a point where unusual behavior is occurring. By doing so, it becomes possible to improve the safety of the entire group (children).

Note that, based on the statistical information regarding the driver's attributes, the behavior information providing unit 415 determines whether the traveler's behavior is a daily behavior if the driver is an elderly person or the like and the risk may increase statistically. Even if there is, the vehicle may notify the driver. For example, a flag may be provided in the behavior information to cause a notification to be made even when a person takes a daily action, and the behavior information providing unit 415 may set this flag to 1 (notify). In this way, in vehicles driven by drivers with attributes that are statistically at high risk, it is possible to always alert the driver, regardless of whether or not the traveler is acting in an unusual manner. Become. The behavior information providing unit 415 also provides the above-mentioned environmental information, that is, information related to the driving position (including, for example, information on the weather at each point where the vehicle travels, and information indicating sunrise and sunset times) and driving position information. A flag that causes the above-mentioned notification may be set using the driver's attribute information (including information such as the driver's gender, age, and place of residence). For example, if it is raining at the location where the vehicle is traveling, the flag may be set to 1, and the notification may be made even when the traveler takes daily actions. Further, even if the place where the traveler is traveling is at sunset and the environment may be dim, the flag may be set to 1, and the notification may be made even when the traveler performs daily activities. Furthermore, if it is determined that the driver is driving in an unfamiliar place far away from his/her place of residence, the flag is set to 1, and a notification is issued even when the traveler engages in daily activities. You can let them do it.

<Series of operations for behavior information provision processing on the server>
Next, a series of operations of the behavior information providing process in the server 110 will be described with reference to FIG. 6A. Note that this process is realized by the CPU 410 of the control unit 402 executing a program stored in the storage unit 403.

In S601, the control unit 402 acquires the above-mentioned vehicle-related information for a plurality of vehicles. Information regarding the vehicle may be transmitted from the vehicle 100 to the server 110 at regular intervals or at the timing of an arbitrary trigger such as when the vehicle stops.

In S602, the control unit 402 acquires position information of a plurality of communication devices. The location information of the communication device may include the above-described location information of the communication device 120, the moving direction of the communication device 120, the moving acceleration of the communication device 120, and the like. Furthermore, in the position information, time information may be associated with each position.

In S603, the control unit 402 determines the behavior of the traveler. For example, the control unit 402 inputs the location information and time information of the communication device 120 into the trained machine learning model described above to determine whether the behavior of the traveler is an unusual behavior. . Note that the machine learning model according to this embodiment previously learns the daily behavior of a moving person using samples of position information of a plurality of moving persons. In addition, when training a machine learning model, use a separate learning model that is trained for each category of mover, such as when the mover is a child, the elderly, or an office worker. It's okay. In this case, the learning model to be operated may be switched depending on the attributes of the traveler.

In S604, the control unit 402 determines the output from the machine learning model, and if the output indicates an unusual behavior, the process advances to S605; otherwise, the process ends. Although the present process is described as ending for the sake of simplicity, the process may be repeated until the process for all the movers is completed.

In S605, the control unit 402 determines that the area (point) where it is determined that the unusual behavior is occurring is an area where a plurality of travelers constituting the group simultaneously engage in unusual behavior (for example, on a school route). area). If the control unit 402 determines that the area (point) where the unusual behavior is occurring is part of the above area (for example, the area on the school route), the control unit 402 advances the process to S606 and determines whether If not, the process advances to S607.

In S606, for each area of the behavior information, the control unit 402 sets the entire area associated with the above area (for example, the area of the school route) as an area where the traveler's behavior is unusual. On the other hand, in S607, for each area of the behavior information, the control unit 402 selects areas (only) where it has been determined that the mover's behavior is an unusual behavior, and an area where the traveler's behavior is unusual. Set as .

In S608, the control unit 402 provides (sends) the set behavior information to the vehicle. After providing the behavior information to the vehicle, the control unit 402 ends this series of processing.

<Series of operations for notification control processing in the vehicle>
Next, a series of operations of the notification control process executed in vehicle 100 will be described with reference to FIG. 6B. Note that this process is realized by the CPU 210 of the control unit 208 executing a program stored in the storage unit 207.

In S621, the control unit 208 acquires the above-mentioned behavior information (indicating whether or not the behavior of the traveler in each area (point) is unusual) from the server 110. In S622, the control unit 208 acquires information on the travel route set by the host vehicle. The driving route is information indicating the points the vehicle is currently passing through or the points it will pass in the future.

In S623, the control unit 208 compares the behavior information with information indicating the point the traveler is currently passing or will pass in the future, and selects an area where the traveler's behavior is determined to be unusual. Determine whether to run. If the control unit 208 determines that the host vehicle will travel in an area where the traveler's behavior is determined to be an unusual behavior, the control unit 208 advances the process to S624, and otherwise advances the process to S625.

In S624, the control unit 208 gives a strong notification to the driver that the traveler's behavior is an unusual behavior. For example, this notification may be based on the operating frequency per unit time of the speaker, vibration element, and display panel, or the output intensity (volume, vibration intensity, display brightness), compared to the case where the traveler's behavior is daily behavior. This is a message with a heightened sense of security.

In S625, the control unit 208 gives a weak notification to the driver that the traveler's behavior is a daily behavior. For example, compared to the case where the traveler's behavior is unusual, this notification may be based on the operating frequency per unit time of the speaker, vibration element, and display panel, or the output intensity (volume, vibration intensity, display). This is a notification with reduced brightness. The control unit 208 may not issue the notification in response to determining that the mover's behavior is a daily behavior. By not giving notification, it is possible to reduce the possibility that notification will be given to the driver on a daily basis. In other words, notifications can be made only for unusual actions.

Note that even if the server 110 has set a flag in the behavior information that causes the notification to be made even if the behavior is a daily behavior, the control unit 208 controls the behavior of the traveler even if the behavior is a daily behavior. The vehicle may notify the driver. As described above, the flag is set based on statistical information regarding the driver's attributes in cases where the risk may increase statistically, such as when the driver is an elderly person. For this reason, drivers with statistically high risk attributes may be constantly notified to warn them.

Furthermore, the vehicle may control the notification depending on the attribute of the traveler indicated by the behavior information. In this case, for example, the server 110 may add information indicating that the mover is a person with a specific attribute to the behavior information. In this case, the control unit 208 of the vehicle determines whether the attribute of the traveler indicated in the behavior information is a child, and if the attribute of the traveler is a child, the behavior of the traveler is a daily behavior. Even in such a case, the driver may be notified. In this case, if the mover's behavior is unusual, the vehicle may strongly notify the driver.

As described above, in this embodiment, the server 110 of the information processing system acquires data related to the travel of the vehicle from the vehicle, and also acquires position information of the communication device carried by the moving person. Based on the position information from the communication device, the server 110 then determines whether or not the behavior of the traveler carrying the communication device is an unusual behavior. Behavior information indicating whether the behavior is appropriate or not is provided to the vehicle. Further, when the vehicle of the information processing system is provided with the behavioral information, the vehicle controls the notification means so as to call attention to the driver driving the vehicle based on the behavioral information. Specifically, if the behavior information indicates that the behavior of the traveler at a specific point is an unusual behavior, and the vehicle is traveling or planning to travel at a specific point, the vehicle is The notification is made in a stronger manner than when indicating that the mover's actions are routine actions.

By doing this, if a traveler is behaving in a way that is different from their daily behavior, be careful of vehicles surrounding the traveler (because the traveler's behavior tends to be unstable). Announcements can be made to raise awareness. That is, it becomes possible to appropriately notify the driver of the vehicle of a warning regarding the moving person.

In addition, as mentioned above, if a notification is issued after determining that the person moving is a child, the notification will be sent to surrounding vehicles even if the person is doing everyday activities. If the person is acting in an unusual manner, it is possible to notify the person that the person is at higher risk.

The invention is not limited to the above-described embodiments, and various modifications and changes can be made within the scope of the invention.

DESCRIPTION OF SYMBOLS 110... Information processing device, 412... Driving data acquisition part, 413... Position information acquisition part, 414... Daily behavior determination part, 415... Behavior information provision part, 215... Behavior information acquisition part, 216... Notification control part

Claims (16)

An information processing system including an information processing device and a vehicle,
The information processing device includes:
a first acquisition means for acquiring data related to the traveling of the vehicle from the vehicle;
a second acquisition means for acquiring location information of a communication device carried by a moving person;
determination means for determining whether the behavior of the traveler carrying the communication device is an unusual behavior based on the position information from the communication device;
providing means for providing the vehicle with behavioral information indicating whether or not the moving person's behavior is an unusual behavior;
The vehicle has a control means that controls a notification means to call attention to a driver driving the vehicle based on the behavior information when the vehicle is provided with the behavior information,
If the behavior information indicates that the behavior of the traveler at a specific point is an unusual behavior, and the vehicle is associated with the specific point, the control means may cause a driver of the vehicle to The information processing system is characterized in that the notification means is controlled so as to call attention to the movement in a manner different from the case where the movement indicates that the movement is a daily movement. When the behavior information indicates that the behavior of the traveler at the specific point is an unusual behavior and the vehicle is associated with the specific point, the control means may be configured to control the behavior of the traveler at the specific point to be unusual. 2. The information processing system according to claim 1, wherein the information processing system controls the notification means to call for more attention than when the action indicates a certain action. The control means controls the notification means so as not to alert the driver when the behavior information indicates that the behavior of the traveler at the specific point is a daily behavior. The information processing system according to claim 2, further comprising the following. The vehicle further includes attribute determining means for determining whether the moving person has a specific attribute,
The control means may be configured to control the control means so as to call the driver's attention even when the moving person has a specific attribute including a child, and even when the movement of the moving person indicates that it is a daily action. 3. The information processing system according to claim 2, further comprising: controlling a notification means. The control means controls at least one of the volume, frequency, and time of the notification to the driver by the notification means so as to call for more attention when the behavior of the traveler indicates that it is a daily behavior. The information processing system according to any one of claims 1 to 4, wherein the notifying means is controlled so that the amount of the information increases. According to any one of claims 1 to 5, the vehicle associated with the specific point is a vehicle that is passing through the specific point or a vehicle that will pass through the specific point in the future. information processing system. 7. The information processing system according to claim 6, wherein the providing means provides the behavior information to a vehicle associated with the specific point. 7. The providing means provides the vehicle with map information including information indicating whether the behavior of the traveler is an unusual behavior for each location as the behavior information. The information processing system according to item 1. If the determination means determines that the behavior of one of the plurality of travelers forming a predetermined group is an unusual behavior, the provision means may be configured to 9. The information processing system according to claim 8, wherein the map information indicating that the mover's behavior is unusual in a plurality of areas is provided to the vehicle as the behavior information. The providing means provides the map information indicating that the behavior of the traveler in the plurality of areas associated with the predetermined group is an unusual behavior to a vehicle associated with the plurality of areas. The information processing system according to claim 9, characterized by: 11. The information processing system according to claim 9, wherein the mover is a child, and the predetermined group is comprised of children who attend a predetermined school. The information processing system according to claim 11, wherein the area associated with the predetermined group corresponds to a school route. The determining means executes a machine learning model that uses the location information and time information of the communication device to classify whether or not the behavior of the traveler carrying the communication device is an unusual behavior. 13. The information processing system according to claim 1, wherein the information processing system determines whether or not the mover's behavior is an unusual behavior. An information processing method executed by an information processing system including an information processing device and a vehicle, the method comprising:
In the information processing device,
a first acquisition step of acquiring data related to the driving of the vehicle from the vehicle;
a second acquisition step of acquiring location information of a communication device carried by the moving person;
a determination step of determining whether the behavior of the traveler carrying the communication device is an unusual behavior based on the location information from the communication device;
providing a vehicle with behavior information indicating whether the traveler's behavior is an unusual behavior;
In the vehicle,
when the behavioral information is provided, executing a control step of controlling a notification means to call attention to a driver driving the vehicle based on the behavioral information;
In the control step, if the behavior information indicates that the behavior of the traveler at a specific point is an unusual behavior and the vehicle is associated with the specific point, the driver of the vehicle An information processing method, characterized in that the notification means is controlled so as to call for attention in a manner different from the case where the behavior of the traveler indicates that it is a daily behavior. A program for causing one or more computers to function as each means of the information processing system according to any one of claims 1 to 13. A storage medium storing a program for causing one or more computers to function as each means of the information processing system according to any one of claims 1 to 13.

Images