research-article

Developing a framework to evaluate usability in m-learning systems: mapping study and proposal

Authors:

Christian Xavier Navarro Cota,

Ana Isabel Molina Díaz,

Miguel Ángel Redondo DuqueAuthors Info & Claims

TEEM '14: Proceedings of the Second International Conference on Technological Ecosystems for Enhancing Multiculturality

Pages 357 - 364

https://doi.org/10.1145/2669711.2669924

Published: 01 October 2014 Publication History

Get Access

Abstract

This paper presents the analysis of recent research on mobile learning and usability areas, applying a systematic mapping study. It also presents the main focus adopted by each publication, the types of mobile device and operative systems. The aim is also to understand the tendencies and needs in the fields of design and evaluation of the m-learning systems. Results demonstrate that research in the area has grown significantly since the 2012, and due to the recent boom of mobile devices in education, we believe that the number of studies will continue to grow in the following years. Also we identify a necessity when we see that not all the m-learning applications have used usability tests, we did not find guidelines or frameworks to evaluate them either. With this results and tendencies, we propose the creation of an evaluation framework for m-learning applications, considering pedagogical usability and user interface usability, to improve the quality of m-learning applications.

References

[1]

Cantillo, C., Redonde, M., y Sánchez, A. Tendencias actuales en el uso de dispositivos móviles en educación. La Educ@ción Digital Magazine, 147. 2012.

Google Scholar

[2]

Crompton, H. A Historical Overview of m-learning: Toward Learner-Centered Education. Handbook of In Mobile Learning, edited by Zane L Berge and Lin Y. Muilenburg, 2013.

Google Scholar

[3]

Cuadrat, C. Estudio sobre evaluación de la usabilidad móvil y propuesta de un método para tests de usabilidad cuantitativos basado en técnicas de eyetracking, 2012.

Google Scholar

[4]

Durall, E., Gros, B., Maina, M., Johnson, L. & Adams, S. Perspectivas tecnológicas: educación superior en Iberoamérica 2012-2017. Edited by Austin, The New Media Consortium, 2012.

Google Scholar

[5]

Johnson, L., Adams Becker, S., Cummins, M., Estrada, V., Freeman, A., & Ludgate, H. NMC Horizon Report: 2013 Higher Education Edition. Austin, Texas: The New Media Consortium.

Google Scholar

[6]

Kitchenham, B. Guidelines for performing Systematic Literature Reviews in Software Engineering. EBSE Technical Report EBSE-2007-01, 2007.

Google Scholar

[7]

Kukulska-Hulme, A. Mobile usability in educational contexts: what have we learnt? The International Review of Research in Open and Distance Learning, A refereed e-journal to advanced research, theory, and practice in open and distance learning worldwide, Vol. 8 No. 2, 2007.

Google Scholar

[8]

Marketresearchreports.Biz. Global Game-Based Learning Market 2012-201" StudyMode.com. Retrieved 03, 2013.

Google Scholar

[9]

Nielsen, J., Budiu R. Usabilidad en dispositivos móviles. Editorial ANAYA Multimedia. 2013.

Google Scholar

[10]

Nielsen, J. Usability 101: Introduction to Usability. Online article (2012, January).

Google Scholar

[11]

Nielsen, J. Usability Engineering. Boston: AP Professional, c1993, 1993, Vol. 1.

Digital Library

Google Scholar

[12]

O'Malley, C., Vavoula, G., Glew, J. P., Taylor, J., Sharples, M, Lefrere, P, Lonsdale, P., Naismith, L. & Waycott, J. Guidelines for Learning/Teaching/Tutoring in a Mobile Environment. MOBIlearn {UoN, UoB, OUF} WP4, march 2005.

Google Scholar

[13]

Quinn C. mLearning: Mobile, Wireless, In-Your-Pocket Learning. LiNE Zine. Fall 2000.

Google Scholar

[14]

Sharples, M., Taylor, J., &Vavoula, G. Towards a Theory of Mobile Learning. Proceedings of mLearn, Vol. 1, No. 1, p. 1--9. 2005.

Google Scholar

[15]

Unión Internacional de Telecomunicaciones (ITU). The World in 2013: ICT Facts and Figures.

Google Scholar

[16]

United Nations Educational, Scientific and Cultural Organization. The Future of mobile Learning: Implications for Policy Markers and Planners. 2013.

Google Scholar

[17]

University Embraces Bring-Your-Own-Device with Wireless Network. Costumer case study. USA, 2012.

Google Scholar

Cited By

View all

Navarro-Cota CMolina ARedondo MLacave C(2024)A Comprehensive Usability Measurement Tool for m-Learning ApplicationsIEEE Transactions on Education10.1109/TE.2023.334719167:2(209-223)Online publication date: 17-Jan-2024
https://dl.acm.org/doi/10.1109/TE.2023.3347191
Ntoa S(2024)Usability and User Experience Evaluation in Intelligent Environments: A Review and ReappraisalInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2394724(1-30)Online publication date: 12-Sep-2024
https://doi.org/10.1080/10447318.2024.2394724
Lepe-Salazar FCortes-Alvarez T(2023)FORTAGONO: A Model for the Technological Mediation of the Teaching and Learning ProcessesIEEE Access10.1109/ACCESS.2023.325444111(64294-64323)Online publication date: 2023
https://doi.org/10.1109/ACCESS.2023.3254441
Show More Cited By

Index Terms

Developing a framework to evaluate usability in m-learning systems: mapping study and proposal
1. Applied computing
  1. Computers in other domains
    1. Personal computers and PC applications
  2. Education
    1. Distance learning
    2. E-learning

Recommendations

The effects of web-based learning experience, perceived-initiative, and perceived-performance on learners' attitudes toward mobile learning

This study explored the effects of prior web-based learning experience, perceived-initiative, and perceived-performance on learners' attitudes toward a mobile learning system designed to enhance novices' reflective thinking and problem-solving through ...
Knowledge to go: using mobile technologies for mobile learning inside and outside university and school

This article presents the first experiences in utilising palm sized computers (PDAs) in university and school projects in Muenster, Germany. PDAs were used in combination with wireless transmission techniques, to be able to run web-based and offline ...
A framework for enabling on-demand personalised mobile learning

This paper discusses MobiGlam, a generic framework for interoperability with existing VLEs that provides a compact and easy to use implementation of learning activities on Java enabled mobile devices. The main objective of this work is to present a ...

Reviews

Reviewer: Stewart Mark Godwin

Mobile learning (m-learning) can be defined as “learning across multiple contexts, through social and content interactions, using personal electronic devices” [1]. The education sector is faced with a range of hardware technologies that are developed for a constantly changing consumer market. For these platforms, educators have a plethora of software applications to choose from. The question posed by this paper is: How can these technologies be evaluated from a usability perspective__?__ The authors' first question examines the state of m-learning and mobility usability research. The review of academic research suggests the number of published papers in this area has increased during the last few years. The second question revealed the aforementioned research used 16 different development frameworks and nine evaluation guidelines. The paper defines usability as the general acceptance of a system that includes social acceptability, and the practical aspects of reliability, cost, compatibility, and usefulness. This is a wide-ranging paper that proposes a framework for evaluating m-learning using two criteria: pedagogical usability and user interface usability. Within each of these two criteria, the paper comprehensively covers a range of factors that affect the learning experience. This would be of interest to educational professionals who are working with m-learning technologies and need a framework for evaluation purposes. Online Computing Reviews Service

Access critical reviews of Computing literature here

Become a reviewer for Computing Reviews.

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

TEEM '14: Proceedings of the Second International Conference on Technological Ecosystems for Enhancing Multiculturality

October 2014

711 pages

ISBN:9781450328968

DOI:10.1145/2669711

Conference Chair:
Francisco José García-Peñalvo
University of Salamanca, Spain

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 October 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

TEEM '14

TEEM '14: 2nd International Conference on Technological Ecosystems for Enhancing Multiculturality

October 1 - 3, 2014

Salamanca, Spain

Acceptance Rates

Overall Acceptance Rate 496 of 705 submissions, 70%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
328
Total Downloads

Downloads (Last 12 months)27
Downloads (Last 6 weeks)7

Reflects downloads up to 01 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Navarro-Cota CMolina ARedondo MLacave C(2024)A Comprehensive Usability Measurement Tool for m-Learning ApplicationsIEEE Transactions on Education10.1109/TE.2023.334719167:2(209-223)Online publication date: 17-Jan-2024
https://dl.acm.org/doi/10.1109/TE.2023.3347191
Ntoa S(2024)Usability and User Experience Evaluation in Intelligent Environments: A Review and ReappraisalInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2394724(1-30)Online publication date: 12-Sep-2024
https://doi.org/10.1080/10447318.2024.2394724
Lepe-Salazar FCortes-Alvarez T(2023)FORTAGONO: A Model for the Technological Mediation of the Teaching and Learning ProcessesIEEE Access10.1109/ACCESS.2023.325444111(64294-64323)Online publication date: 2023
https://doi.org/10.1109/ACCESS.2023.3254441
Ahmad WErmawati IAstuti SKurniasih MHassan M(2021)Comparative study on the readiness of Mobile Learning Application in Learning2021 International Conference on Computer & Information Sciences (ICCOINS)10.1109/ICCOINS49721.2021.9497173(191-194)Online publication date: 13-Jul-2021
https://doi.org/10.1109/ICCOINS49721.2021.9497173
Ahmad NRextin AKulsoom U(2018)Perspectives on usability guidelines for smartphone applicationsInformation and Software Technology10.1016/j.infsof.2017.10.00594:C(130-149)Online publication date: 1-Feb-2018
https://dl.acm.org/doi/10.1016/j.infsof.2017.10.005
Murphy AFarley H(2017)Introduction: Supporting the Sustainable Implementation of Mobile Learning for Higher Education in the Asia-Pacific RegionMobile Learning in Higher Education in the Asia-Pacific Region10.1007/978-981-10-4944-6_1(3-23)Online publication date: 7-Jul-2017
https://doi.org/10.1007/978-981-10-4944-6_1
Navarro CMolina ARedondo MJuarez-Ramirez R(2016)Framework to Evaluate M-Learning Systems: A Technological and Pedagogical ApproachIEEE Revista Iberoamericana de Tecnologias del Aprendizaje10.1109/RITA.2016.251845911:1(33-40)Online publication date: Feb-2016
https://doi.org/10.1109/RITA.2016.2518459
Ibrahim NAhmad WShafe A(2016)Practitioners' validation on effectiveness of multimedia Mobile Learning Application for children2016 3rd International Conference on Computer and Information Sciences (ICCOINS)10.1109/ICCOINS.2016.7783197(103-108)Online publication date: Aug-2016
https://doi.org/10.1109/ICCOINS.2016.7783197

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

The effects of web-based learning experience, perceived-initiative, and perceived-performance on learners' attitudes toward mobile learning

Knowledge to go: using mobile technologies for mobile learning inside and outside university and school

A framework for enabling on-demand personalised mobile learning

Reviews

Access critical reviews of Computing literature here