Proposal and Preliminary Evaluation of a Learner Experience Evaluation Model in Information Systems

Context: Learner eXperience (LX) is defined as the perceptions, responses and performance of learners through interaction with Information Systems (ISs). The LX evaluation of ISs can be performed using different approaches and considering different elements. Problem: However, from a Systematic Mapping Study (SMS), it was noticed that there is no standardization of LX evaluation approaches and that consider as many elements as possible. In this way, it is important to evaluate LX holistically, considering the diversity of learners and their learning preferences so that all experience aspects are considered. Solution: Therefore, the Learner Experience Evaluation Model (LEEM) was proposed. LEEM aims to evaluate and improve the learner’s experience using technological resources considering different LX forms and elements. IS Theory: For the LEEM proposal, the Design Theory was followed, focusing on the design of IS artifacts. Method: The research methodology used was Design Science Research (DSR). In the DSR Knowledge Cycle, an SMS was carried out; in the Design Cycle, LEEM was proposed; and in the Relevance Cycle, a preliminary assessment of LEEM with 3 experts was conducted. Summary of Results: In SMS, 54 LX elements and 32 LX approaches were identified, which served as the basis for the LEEM construction. In the preliminary evaluation, experts suggest improvements, such as the replacement of the Likert scale with pairs of words in step 1 of the LEEM model. Contributions and Impact in the IS area: The LEEM model contributes to the IS area, as it allows considering non-technical aspects in the evaluation to promote new interactions and experiences by interested parts.