article

Methods and techniques for the evaluation of user-adaptive systems

Author:

Cristina GenaAuthors Info & Claims

The Knowledge Engineering Review, Volume 20, Issue 1

Pages 1 - 37

https://doi.org/10.1017/S0269888905000299

Published: 01 March 2005 Publication History

Abstract

This article presents a comprehensive overview of methods and techniques used for the evaluation of user-adaptive systems. It describes the methodologies derived both from the evaluation of human–computer interaction systems and from information retrieval and information filtering systems by giving examples of the application of these methodologies in the user-adaptive systems. The state of the art and the main results in the evaluation of these systems are reported. In particular, empirical evaluation and layered approaches are discussed in detail. Finally, focus on less explored methodologies, such as qualitative approaches (e.g. Grounded Theory), is proposed.

Cited By

View all

Belousov KBashirov RZelianskaia NLabutin IRyabinin KChumakov R(2023)Profiling of Conceptual Systems Based on a Complex of Methods of Psychosemantics and Machine LearningAutomatic Documentation and Mathematical Linguistics10.3103/S000510552304002757:4(193-205)Online publication date: 12-Oct-2023
https://dl.acm.org/doi/10.3103/S0005105523040027
Alghabban WHendley R(2022)Perceived Level of Usability as an Evaluation Metric in Adaptive E-learningSN Computer Science10.1007/s42979-022-01138-53:3Online publication date: 23-Apr-2022
https://dl.acm.org/doi/10.1007/s42979-022-01138-5
Dhouib AKolski CNeji M(2021)Toward a web-based multi-criteria decision support system for the layered evaluation of interactive adaptive systemsUniversal Access in the Information Society10.1007/s10209-021-00850-y22:2(415-443)Online publication date: 29-Nov-2021
https://dl.acm.org/doi/10.1007/s10209-021-00850-y
Show More Cited By

Recommendations

Towards a Multi-Modal Methodology for User-Centred Evaluation of Adaptive Systems
UMAP'19 Adjunct: Adjunct Publication of the 27th Conference on User Modeling, Adaptation and Personalization

This paper presents an approach and methodology for user-centred evaluation of adaptive systems. In contrast to layered evaluation approaches that decompose adaptation into its constituents, our approach conceptualises the quality and benefit for the ...
Evaluation of Adaptive Systems
UM '01: Proceedings of the 8th International Conference on User Modeling 2001

Unambiguously, adaptive systems have to be evaluated empirically to guarantee that the adaptivity really works. Nevertheless, only few of the existing adaptive systems have been evaluated. One of the most important reasons for this lack is, that ...
The evaluation of adaptive and personalised information retrieval systems: a review

A current problem with the research of adaptive systems is the inconsistency of evaluation applied to the adaptive systems. However, evaluating an adaptive system is a difficult task due to the complexity of such systems. Evaluators need to ensure ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image The Knowledge Engineering Review

The Knowledge Engineering Review Volume 20, Issue 1

March 2005

91 pages

ISSN:0269-8889

Issue’s Table of Contents

Publisher

Cambridge University Press

United States

Publication History

Published: 01 March 2005

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

31
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 01 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Belousov KBashirov RZelianskaia NLabutin IRyabinin KChumakov R(2023)Profiling of Conceptual Systems Based on a Complex of Methods of Psychosemantics and Machine LearningAutomatic Documentation and Mathematical Linguistics10.3103/S000510552304002757:4(193-205)Online publication date: 12-Oct-2023
https://dl.acm.org/doi/10.3103/S0005105523040027
Alghabban WHendley R(2022)Perceived Level of Usability as an Evaluation Metric in Adaptive E-learningSN Computer Science10.1007/s42979-022-01138-53:3Online publication date: 23-Apr-2022
https://dl.acm.org/doi/10.1007/s42979-022-01138-5
Dhouib AKolski CNeji M(2021)Toward a web-based multi-criteria decision support system for the layered evaluation of interactive adaptive systemsUniversal Access in the Information Society10.1007/s10209-021-00850-y22:2(415-443)Online publication date: 29-Nov-2021
https://dl.acm.org/doi/10.1007/s10209-021-00850-y
Soui MChouchane MMkaouer MKessentini MGhedira K(2020)Assessing the quality of mobile graphical user interfaces using multi-objective optimizationSoft Computing - A Fusion of Foundations, Methodologies and Applications10.1007/s00500-019-04391-824:10(7685-7714)Online publication date: 1-May-2020
https://dl.acm.org/doi/10.1007/s00500-019-04391-8
Figueroa HCostaguta RMenini MMissio D(2019)An Automatic Identification of Team Roles in ForumsProceedings of the XX International Conference on Human Computer Interaction10.1145/3335595.3335615(1-2)Online publication date: 25-Jun-2019
https://dl.acm.org/doi/10.1145/3335595.3335615
Berry PDonneau-Golencer TDuong KGervasio MPeintner BYorke-Smith N(2017)Evaluating intelligent knowledge systemsKnowledge and Information Systems10.1007/s10115-016-1011-352:2(379-409)Online publication date: 1-Aug-2017
https://dl.acm.org/doi/10.1007/s10115-016-1011-3
Lallé SConati CCarenini G(2016)Predicting confusion in information visualization from eye tracking and interaction dataProceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence10.5555/3060832.3060975(2529-2535)Online publication date: 9-Jul-2016
https://dl.acm.org/doi/10.5555/3060832.3060975
Chrysafiadi KVirvou M(2015)Fuzzy Logic for Adaptive Instruction in an E-learning Environment for Computer ProgrammingIEEE Transactions on Fuzzy Systems10.1109/TFUZZ.2014.231024223:1(164-177)Online publication date: 30-Jan-2015
https://dl.acm.org/doi/10.1109/TFUZZ.2014.2310242
Gaffney CStaikopoulos TO'Keeffe IConlan OWade V(2014)A Training Framework for Adaptive Educational Hypermedia Authoring ToolsProceedings of the 9th European Conference on Open Learning and Teaching in Educational Communities - Volume 871910.1007/978-3-319-11200-8_35(416-421)Online publication date: 16-Sep-2014
https://dl.acm.org/doi/10.1007/978-3-319-11200-8_35
Chrysafiadi KVirvou M(2013)PeRSIVAComputers & Education10.5555/2974070.297419768:C(322-333)Online publication date: 1-Oct-2013
https://dl.acm.org/doi/10.5555/2974070.2974197
Show More Cited By

Abstract

Cited By

Recommendations

Towards a Multi-Modal Methodology for User-Centred Evaluation of Adaptive Systems

Evaluation of Adaptive Systems

The evaluation of adaptive and personalised information retrieval systems: a review

Comments

Information

Published In

Publisher

Publication History

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations