Predicate-based explanation of a Reinforcement Learning agent via action importance evaluation - Inria - Institut national de recherche en sciences et technologies du numérique
Nothing Special   »   [go: up one dir, main page]

Communication Dans Un Congrès Année : 2023
Predicate-based explanation of a Reinforcement Learning agent via action importance evaluation
1 UT3 - Université Toulouse III - Paul Sabatier (118 route de Narbonne - 31062 Toulouse - France)
"> UT3 - Université Toulouse III - Paul Sabatier
2 IRIT-ADRIA - Argumentation, Décision, Raisonnement, Incertitude et Apprentissage (Institut de recherche en informatique de Toulouse - IRIT 118 Route de Narbonne 31062 Toulouse Cedex 9 - France)
"> IRIT-ADRIA - Argumentation, Décision, Raisonnement, Incertitude et Apprentissage

Résumé

For the purpose of understanding the impact of a Reinforcement Learning (RL) agent's decisions on the satisfaction of a given arbitrary predicate, we present a method based on the evaluation of the importance of actions. This highlights to the user the most important action(s) (relative to the predicate) in a history of the agent's interactions with the environment. Having shown that calculating the importance of an action for a predicate to hold is #W[1]-hard, we propose a timesaving approximation. To do so, we use the most likely transitions in the environment. Experiments confirm the relevance of this approach.
Fichier principal
Vignette du fichier
HXP_paper_for_AIMLAI_Workshop___Camera_Ready.pdf (2.46 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04170188 , version 1 (25-07-2023)
Identifiants
  • HAL Id : hal-04170188 , version 1

Citer

Léo Saulières, Martin Cooper, Florence Dupin de Saint-Cyr. Predicate-based explanation of a Reinforcement Learning agent via action importance evaluation. 4th workshop on Advances in Interpretable Machine Learning and Artificial Intelligence (AIMLAI 2023) @ ECML/PKDD conference, Sep 2023, Turin, Italy. à paraître. ⟨hal-04170188⟩
179 Consultations
119 Téléchargements

Partager

More