Analyzing App Store Comments and Quality Attributes for Defining an Inspection Checklist for Mobile Educational Games

To evaluate educational games, several techniques have been proposed considering different quality attributes. However, there are still several educational games for the mobile context that have low scores in the app stores. These stores allow users to make comments to evaluate the applications, as this data can be useful for the development team that aims to meet users' expectations. The analysis of comments made by users can help identify which attributes impact the use of mobile educational games. In this paper, an inspection checklist is proposed to evaluate mobile educational games. To complement the attributes identified in the analysis of comments, attributes from existing techniques for evaluating mobile educational games were also considered. The final evaluation form contains a total of 82 attributes distributed in evaluation categories, such as: user interface, mobility, pedagogy, gameplay, among others. To evaluate the proposed technique, an evaluation was carried out with the checklist in two mobile educational games available in the Google Play Store, different from those used to define the technique. The initial results indicate that the proposed checklist allows the identification of problems pointed out by users in the comments left in the app store.