FR3067901B1 - METHOD FOR MANAGING MEDIA APPLICATIONS IN A VEHICLE WITH AN AUTOMATED DRIVING SYSTEM - Google Patents

Abstract

The present invention relates to a method for managing media applications in a vehicle equipped with an automated driving system, characterized in that it comprises the following steps: - detection, during an automated driving phase of the vehicle and while a media application is running on the infotainment system of said vehicle, the occurrence of an event causing an imminent return to manual driving mode (100); storing the media application running in a memory of said vehicle as well as its state (300); interrupting said media application (400); - detection of the return in an automated driving phase (500); and - restarting said media application in said stored state (900).

Description

METHOD FOR MANAGING MEDIA APPLICATIONS IN A VEHICLE WITH AN AUTOMATED DRIVING SYSTEM

Field of the invention

The present invention relates generally to motor vehicles having systems capable of providing fully automated driving.

It aims in particular the issue of the continuity of use of media applications in such a motor vehicle.

Background of the invention

Driver assistance systems are now widely used in recent motor vehicles and are growing rapidly.

Adaptive Cruise Control, better known by the acronym ACC (for "Adaptive Cruise Control" or "Autonomous Cruise Control"), has thus been known for a number of years. Such a mode of assistance automatically adjusts the speed to maintain a constant safety interval with the vehicle preceding the user from the information collected on this vehicle (including distance and approach speed) using one or more sensors of the radar, lidar or infrared type.

More recently, we have also seen the appearance of dynamic systems anti-crossing line involuntary. These are commonly referred to as ALKA (for Active Lane Keep Assist), LKAS (for Lane Keep Assistance System), ALA (for Active Lane Assist) or ALC (for Active Lane Control). lines of markings on the ground using sensors and / or optical cameras, and intervene dynamically on the vehicle when the latter deviates from its traffic sight. In such a case, the driver assistance system will then automatically correct the direction of the vehicle and / or activate the braking.

Recently appeared driver assistance devices capable of managing fully autonomously the longitudinal and transverse movement of the vehicle.

This is particularly the case of traffic jam assistants (better known by the acronym TJC for "Traffic Jam Chauffeur") intended to relieve the driver in situations of heavy traffic or traffic jams (speed less than 14/21 km / (h) on divided highways (motorways and expressways).

It may also be mentioned the highway driving assistants commonly referred to by the acronyms HC (for "Highway Chauffeur") and able to fully offload the driver in situations of fluid traffic (speed close to the regulatory limit) on paved roads separated.

In the event of a deterioration of the driving environmental context requiring a return to the manual driving mode, these devices are furthermore capable of maintaining fully automated guidance of the vehicle over a minimum transition period of around ten seconds.

Thus, during an automated driving phase, the driver is not required to keep his eyes fixed on the road and can go about other occupations (conversation with other passengers, reading a book or a magazine, launching a video game, movie or other media activity via the infotainment system of the vehicle, etc ...).

When the vehicle returns to manual driving mode (at the request of the driver or following a deterioration of the environmental context) it is known, in particular from the US application US 1115/0094896 to stop or automatically pause the media activity in course on the infotainment system.

Object and summary of the invention

The present invention aims to improve the continuity of use of media activities during a journey comprising a succession of automated driving phases and manual driving phases.

To this end, it proposes a method for managing media activities in a vehicle equipped with an automated driving system, characterized in that it comprises the following steps: detection during an automated driving phase of the vehicle and while a media application is running on the infotainment system of said vehicle, the occurrence of an event resulting in an imminent return to manual driving mode; storage of the media application running in a memory of said vehicle as well as its state; - interruption of said media application; - detection of the return in an automated driving phase; and - restarting said media application in said stored state.

The method according to the invention thus ensures for the driver a continuity of use of the media applications launched on the infotainment system of the vehicle during the alternating succession of phases of automated driving and manual driving, which is particularly advantageous in traffic situations in which these different phases can succeed in relatively short time intervals.

According to preferred features of the method according to the invention, taken alone or in combination: the restart of said application is implemented only when the time interval elapsed between the interruption of said media application and the return in a automated driving phase is less than or equal to a predetermined time; said predetermined delay corresponds to the remaining travel time to the programmed place of destination of said vehicle; when the interval of time elapsed between the interruption of said media application and the return to an automated driving phase is greater than said predetermined delay, the stored data relating to said application are deleted from said memory; said method comprises, before the step of restarting said application, a transmission step intended for the driver of a proposal to take up said application in said memorized state, the restarting step of said application not being implemented. in case of acceptance of this proposal by the said driver; when said application is hosted by a mobile terminal, the step of issuing a recovery proposal is implemented only if said application remains accessible to said infotainment system; the restarting step of said application is implemented automatically at the end of a predetermined lapse of time of a few seconds following the return to the automated driving phase and in the absence of refusal expressed by the driver; - In case of refusal said driver to resume said application in said stored state, the stored data relating to it are deleted from said memory; when said application is hosted by a mobile terminal, its state at the time of its interruption is also stored in a remote storage location of said vehicle and accessible to said terminal; and / or - said steps of storing and interrupting said application are implemented only if the latter is judged to be incompatible with the manual driving mode.

BRIEF DESCRIPTION OF THE DRAWINGS The description of the invention will now be continued by the detailed description of an exemplary embodiment, given below by way of illustration but without limitation, with reference to the appended drawings, in which: FIG. a functional diagram of an autonomous vehicle; and FIG. 2 represents a flowchart of the method according to the invention for managing media applications in a vehicle equipped with an automated driving system.

detailed description

With reference to FIG. 1, the vehicle 1 comprises an automated driving system 10 and an infotainment system 20 connected to each other.

The automated driving system 10 is able to completely unload the driver on roads with separate roads. It comprises a driving context evaluation module 11, a driver monitoring module 12, an actuating module 13 and a control unit 14.

The driving context evaluation module 11 comprises video acquisition means (for example, a CCD camera oriented towards the front of the vehicle) delivering images making it possible to determine the type of road taken (highway, expressway). or secondary road) from certain characteristic parameters such as track width, ground marking (color, width and line spacing) and the possible presence of a barrier or a central separation platform. between the two directions of circulation. The analysis of the images provided by these video acquisition means also makes it possible to establish the level of fluidity of the road traffic.

The module 11 also comprises a plurality of sensors measuring certain internal driving parameters such as the instantaneous speed of the vehicle and the steering angle of the steering wheel.

This module 11 further comprises a rain detector with a sensor of optical or capacitive type integrated for example at the upper part of the windshield, and a map of the road network providing a certain number of information on the next sections encountered by the vehicle (type of road, number of lanes, degree of sinuosity, speed limits, etc.).

The data received by this evaluation module of the driving context 11 are conveyed in real time to the control unit 14.

The driver monitoring module 12 comprises a sub-module 12A for detecting the presence of the driver's hands on the steering wheel, as well as a sub-module 12B for detecting that of its feet on the accelerator, braking pedals. and possibly clutch if the vehicle is equipped with a manual gearbox.

Sub-module 12A includes one or more sensors integrated inside the steering wheel and able to measure the local variation in pressure occurring when the driver positions his hands on this steering wheel or removes them. This detection can also be achieved by other means and in particular by means of a capacitive sensor integrated in the steering wheel and whose capacity varies depending on the presence or absence of hands on the steering wheel.

The submodule 12B comprises at least two sensors associated respectively with the acceleration and braking pedals (and a third sensor associated with the clutch pedal if the latter is present), these sensors being able to measure the level of pressure applied by one of the driver's feet on each of them.

The data collected by this driver monitoring module 12 thus allow the control unit 14 to which it is connected to detect a voluntary hand-over of the vehicle by the driver (that is to say in this case the simultaneous detection of at least one of his hands on the steering wheel and a sufficient pressure applied by one of his feet on one of the pedals), so as to inform the control unit to stop immediately the automated driving mode in progress.

Also connected to this control unit 14, the actuating module 13 comprises a plurality of actuators able to control certain vehicle components such as steering, acceleration, braking and gearbox to ensure the implementation. at least one fully automated driving mode.

Equipped with one or more interconnected computers, the control unit 14 is able to manage, according to the information received via the modules 11 and 12, the activation of the different modes of automated driving as well as their deactivation and the return to manual driving mode.

The infotainment system 20 comprises a central unit 21 as well as display and sound diffusion means comprising a touch screen 22 and speakers 23 connected thereto.

Conventionally, the central unit 21 manages, autonomously or via instructions transmitted by the user using the touch screen 22, the operation of a plurality of functional modules connected to the information device. entertainment 20 such as navigation modules, ventilation / air conditioning or the audio and multimedia module. The central unit 21 comprises a computer 21A provided with one or more interconnected microprocessors, as well as a memory module 21B comprising non-volatile memory of EEPROM or FLASH type as well as volatile memory.

The non-volatile memory is intended to store various types of data such as the configuration parameters of certain functional modules, the mapping of the road network or even the process of managing media applications according to the invention whose flowchart is represented on Figure 2.

The infotainment system 20 also advantageously comprises a telecommunication module 24 comprising a modem (or a modem / router) GSM / GPRS or UMTS associated with a SIM or USIM card and allowing the vehicle to access the network Internet.

This infotainment system 20 integrates a plurality of embedded media applications for the passengers of the vehicle.

For example, media applications include, for example and without limitation, audio file playback applications (such as by Deezer® or Spotify®), video file playback (such as YouTube® or VLC®), web browsing applications. (such as Google Chrome® or Firefox®), telephony, videoconferencing (such as Skype®), messaging, calendar consultation, games, or office applications, etc.

The system 20 may also include a connection module 25 for establishing a communication link with a mobile terminal via one or more wired (USB, IEEE1394, HDMI, etc.) and / or wireless connection protocols (Bluetooth, Wi-Fi, etc ...).

By "mobile terminal" is meant here a smartphone-type phone, a tablet, a PDA (Personal Digital Assistant), or any other mobile device with an operating system ("Android", "IOS", "Windows Phone" or other) and having a plurality of applications directly integrated into this operating system or downloaded and stored in a memory module.

This connection module 25 includes a duplication solution or mirroring in English (for example: Apple® CarPlay®, Google® Android Auto® or Mirrorlink®) allowing while driving, to reproduce in real time respectively on the screen. 12 (with a suitable visual interface) and on the speakers 13 the display and sound generated by certain applications hosted on the mobile terminal.

These applications accessible via this duplication solution will be associated in the remainder of this description with the adjective "disembarked", as opposed to the applications integrated in the system 20 of the vehicle which will be adorned with the adjective "embedded".

The various steps of the method for managing media applications according to the invention will now be described in detail and in support of the flowchart of FIG.

This is initiated when the central unit 21 detects, during an automated driving phase of the vehicle and while a media application is running on the infotainment system 20 of the vehicle, the occurrence of an event causing an imminent return to manual driving mode (initial step 100).

In practice, two different types of events can cause such an imminent return in this manual driving mode, namely: - the recovery in hand of the vehicle by the driver (the return to manual mode then being immediate or almost immediate); or - a deterioration of the driving context that no longer allows the continuation of the automated driving mode (the return to manual mode then taking place at the end of a predetermined transition phase of a few seconds).

Following this detection, the process will firstly check whether the media application (on-board or off-board) running on the infotainment system 20 is compatible with manual driving (step 200).

This verification will be carried out advantageously by consulting a predefined list of compatible applications stored in the memory module of the central unit 21.

Applications compatible with manual driving will for example be limited to those concerning the telephony and playback of audio files.

In the event that the application in progress is judged to be incompatible with manual driving, the central unit 21 memorizes it with its state in a non-volatile zone of its memory module 21B and interrupts it immediately (step 300) so that the driver is not distracted by the latter when the vehicle switches to manual driving mode (step 400), this passing producing instantly in case of recovery by the driver or at the end of the transition phase if the return is from to a change of driving context.

The storage of the state of a media application will consist, for example: for a video file playback application, in the backup of the file being played and its progress level, for a web browsing application, in the backup of the current tab or tabs, and - for a game application, in the backup of its progress level. As soon as the process detects that the vehicle returns to the automated driving mode (step 500), if it verifies the time interval since the interruption of the application is less than or equal to a predetermined time (step 600) .

If this is not the case, the CPU 21 believes that the continuity of use is no longer relevant and removes the stored data concerning this application from its memory (step 700).

This predetermined time is advantageously at least one hour (for example between 2 and 10 hours), but it may extend over a longer period (for example, one or more days or even one or more weeks). It could also advantageously correspond to the remaining journey time to the destination of the vehicle programmed in the navigation module.

When this interval is less than or equal to the predetermined time, the touch-sensitive display screen 22 of the infotainment system 20 automatically displays a message intended for the driver proposing him to resume the last application in its previously memorized state (step 800 ).

This message is for example in the form of a "pop-up" type window comprising touch buttons allowing the driver to accept the resumption proposal or on the contrary to refuse.

If the driver accepts this resumption proposal, the central unit 21 restarts the application in its previously stored state so as to ensure continuity of use (step 900).

Thus, for example for a video playback application, it will resume reading the last file read where it had previously stopped. Conversely, if the driver refuses the resumption proposal, the central unit 21 deletes the stored data concerning this application from its memory (step 1000).

According to alternative embodiments of the invention and in the case where the application in question is of landed type, the central unit 21 also stores the state of this application in a remote storage location accessible by the mobile terminal. hosting (for example, in the memory of this terminal or on a server), so as to allow the owner of this terminal a continuity of use when it will reuse the application outside the vehicle.

According to other embodiments of the invention and always in the case where the application in question is of landed type, the process will display the resumption proposal message only if the application remains accessible to the information system. entertainment (the accessibility of this type of application is indeed dependent on the connection of the mobile terminal hosting the infotainment system).

According to still other embodiments of the invention, the process automatically implements, after a predetermined period of time of a few seconds and in the absence of an explicit refusal of the driver, the revival of the last application in its previously memorized state. In general, it is recalled that the present invention is not limited to the embodiments described and shown, but encompasses any embodiment within the scope of those skilled in the art.

Claims (10)

A method for managing media applications in a vehicle equipped with an automated driving system (10), characterized in that it comprises the following steps: - detection, during an automated driving phase of the vehicle and while a media application is running on the infotainment system (20) of said vehicle, the occurrence of an event causing an imminent return to the manual driving mode (100); storing the media application running in a memory of said vehicle as well as its state (300); interrupting said media application (400); - detection of the return in an automated driving phase (500); and - restarting said media application in said stored state (900). Media activity management method according to claim 1, characterized in that the restart of said application is implemented only when the time interval between the interruption of said media application and the return in a automated driving phase is less than or equal to a predetermined time (600). Media activity management method according to claim 2, characterized in that said predetermined time period corresponds to the remaining travel time to the programmed destination of said vehicle. Media activity management method according to one of claims 2 or 3, characterized in that when the interval of time elapsed between the interruption of said media application and the return to an automated driving phase is greater than said predetermined time, the stored data relating to said application are deleted from said memory (700). 5. media activity management method according to one of claims 1 to 4, characterized in that it comprises before the restarting step of said application (900), a transmission step to the driver of a proposal to resume said application in said stored state (800), the restarting step of said application (900) being implemented only in case of acceptance of this proposal by said driver. Media activity management method according to claim 5, characterized in that, when said application is hosted by a mobile terminal, the step of issuing a recovery proposal (800) is not implemented. if said application remains accessible to said infotainment system (20). 7. Media activity management method according to one of claims 1 to 4, characterized in that the restarting step of said application is implemented automatically after a predetermined period of time of a few seconds following the return to the automated driving phase and in the absence of refusal expressed by the driver. 8. Media activity management method according to one of claims 5 to 7, characterized in that in case of refusal said driver to resume said application in said stored state, the stored data relating to it are deleted from said memory ( 1000). 9. Media activity management method according to one of claims 1 to 8, characterized in that, when said application is hosted by a mobile terminal, its state at the time of its interruption is also stored in a remote storage location said vehicle and accessible to said terminal. 10. Media activity management method according to one of claims 1 to 9, characterized in that said storing steps and interruption of said application (300, 400) are implemented only if the latter is judged incompatible with the manual driving mode.