Abstract
This study used the partial least squares (PLS) and structural equation modeling (SEM) tool to examine evaluation constructs that are appropriate to evaluate educational computer games (ECG) by real users. The focus of the evaluation constructs are for evaluating ECG that still in the development process. There are five constructs that being derived from heuristic evaluation for ECG known as Playability Heuristic Evaluation for Educational Computer Games (PHEG) that being developed to evaluate ECG by expert evaluators. The constructs are interface (10), educational element (6), content (6), playability (7) and multimedia (8). Total numbers of items for the five constructs are 37. Statistical results confirm that all of the five constructs and 29 items are important to be included in evaluating ECG. The results, besides indicating the suitability of the PLS in statistical analysis, has also contributed to a better understanding of constructs needed in evaluating ECG that still in the development process that has not been tested. Findings are useful for game developers and educational technologist to have a validated model and questionnaire that can be used to evaluate ECG. The result of the evaluation using the proposed model can be used to enhance the ECG before it can be released. Limitations and suggestions for future research are also included.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Yee Leng, E., et al.: Computer games development and appreciative learning approach in enhancing students’ creative perception. Computers & Education 54(1), 146–161 (2010)
Kato, P.M.: Video games in health care: Closing the gap. Review of General Psychology 14(2), 113 (2010)
Robertson, J., Howells, C.: Computer game design: Opportunities for successful learning. Computers & Education 50(2), 559–578 (2008)
Papastergiou, M.: Exploring the potential of computer and video games for health and physical education: A literature review. Computers & Education 53(3), 603–622 (2009)
Mohamed, H., Jaafar, A.: Challenges in the evaluation of educational computer games. In: 2010 International Symposium on Information Technology (ITSim). IEEE (2010)
Hasiah, M.O., Azizah, J.: Heuristics evaluation in computer games. In: 2010 International Conference on Information Retrieval & Knowledge Management (CAMP). IEEE (2010)
Prensky, M.: Students as designers and creators of educational computer games: Who else? British Journal of Educational Technology 39(6), 1004–1019 (2008)
Oblinger, D.G.: The next generation of educational engagement. Journal of Interactive Media in Education (2004)
Hogle, J.G.: Considering games as cognitive tools: in search of effective “edutainment”. ERIC Clearinghouse (1996)
Barab, S., et al.: Making learning fun: Quest Atlantis, a game without guns. Educational Technology Research and Development 53(1), 86–107 (2005)
Kiili, K.: Content creation challenges and flow experience in educational games: The IT-Emperor case. The Internet and Higher Education 8(3), 183–198 (2005)
Van Eck, R.: Digital game-based learning: It’s not just the digital natives who are restless. EDUCAUSE Review 41(2), 16 (2006)
Prensky, M.: Digital game-based learning. McGraw-Hill, New York (2001)
Pohl, M., et al.: Designing game based learning-a participatory approach. In: World Conference on Educational Multimedia, Hypermedia and Telecommunications (2008)
Dondlinger, M.J.: Educational video game design: A review of the literature. Journal of Applied Educational Technology 4(1), 21–31 (2007)
Gee, J.P.: What video games have to teach us about learning and literacy. Palgrave Macmillan, New York (2003)
Gee, J.P.: Are video games good for learning? (2006), http://cmslive.curriculum.edu.au/leader/default.asp?id=16866&issueID=10696 (cited Oktober 18, 2008)
Cordova, D.I., Lepper, M.R.: Intrinsic motivation and the process of learning: Beneficial effects of contextualization, personalization, and choice. Journal of Educational Psychology 88, 715–730 (1996)
Lopez-Morteo, G., López, G.: Computer support for learning mathematics: A learning environment based on recreational learning objects. Computers & Education 48(4), 618–641 (2007)
Tüzün, H., et al.: The effects of computer games on primary school students’ achievement and motivation in geography learning. Computers & Education 52(1), 68–77 (2009)
von der Heiden, B., et al.: Learning by Playing: Potential of Serious Games to Increase Intellectual Capital. In: Enabling Innovation, pp. 375–388. Springer (2011)
Hillen, S.A., Breuer, K.U., Tennyson, R.D.: Gaming and learning: Theory, research, and practice. In: Challenges Facing Contemporary Didactics: Diversity of Students and the Role of New Media in Teaching and Learning, p. 185 (2011)
Thomas, P.J., Meech, J.F., Macredie, R.D.: A framework for the development of information appliances. ACM SIGICE Bulletin 21(1), 15–19 (1995)
Amory, A., et al.: Computer games as a learning resource. In: World Conference on Educational Multimedia, Hypermedia and Telecommunications (1998)
Garris, R., Ahlers, R., Driskell, J.E.: Games, motivation, and learning: A research and practice model. Simulation & Gaming 33(4), 441–467 (2002)
Malone, T.W., Lepper, M.R.: Making learning fun: A taxonomy of intrinsic motivations for learning. Aptitude, Learning, and Instruction 3, 223–253 (1987)
Nielsen, J., Molich, R.: Heuristic evaluation of user interfaces. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems: Empowering People. ACM (1990)
Nielsen, J.: Heuristic evaluation. In: Nielsen, J., Mark, R.L. (eds.) Usability Inspection Methods. John Wiley & Sons, New York (1994)
Hvannberg, E.T., Law, E.L.-C., Lárusdóttir, M.K.: Heuristic evaluation: Comparing ways of finding and reporting usability problems. Interacting with Computers 19(2), 225–240 (2007)
Desurvire, H., Wiberg, C.: Master of the game: assessing approachability in future game design. In: Proceedings of ACM CHI 2008 Conference on Human Factors in Computing Systems (2008)
Ling, C., Salvendy, G.: Optimizing Heuristic Evaluation Process in E-Commerce: Use of the Taguchi Method. International Journal of Human-Computer Interaction 22(3), 271–287 (2007)
Ling, C., Salvendy, G.: Effect of evaluators’ cognitive style on heuristic evaluation: Field dependent and field independent evaluators. International Journal of Human-Computer Studies 67(4), 382–393 (2009)
Nielsen, J., Molich, R.: Heuristics Evaluation of User Interfaces. In: Proceedings of Human Computer Interaction (1994)
Squires, D., Preece, J.: Usability and learning: Evaluating the potential of educational software. Computers & Education 27(1), 15–22 (1996)
Squires, D.: Usability and Educational Software Design: Special Issue of Interacting with Computers. Interacting with Computers 11(5), 463–466 (1999)
Squires, D., Preece, J.: Predicting quality in educational software: Evaluating for learning, usability and the synergy between them. Interacting with Computers 11(5), 467–483 (1999)
Reeves, T., et al.: Usability and instructional design heuristics for e-learning evaluation. In: World Conference on Educational Multimedia, Hypermedia and Telecommunications. AACE, Charlottesville (2002)
Evans, C., Sabry, K.: Evaluation of the interactivity of web-based learning systems: Principles and process. Innovations in Education and Teaching International 40(1), 89–99 (2003)
Albion, P.: Heuristic evaluation of educational multimedia: from theory to practice. In: Proceedings ASCILITE 1999: 16th Annual Conference of the Australasian Society for Computers in Learning in Tertiary Education: Responding to Diversity. Australasian Society for Computers in Learning in Tertiary Education, ASCILITE (1999)
Ssemugabi, S., de Villiers, R.: A comparative study of two usability evaluation methods using a web-based e-learning application (2007)
Shee, D.Y., Wang, Y.-S.: Multi-criteria evaluation of the web-based e-learning system: A methodology based on learner satisfaction and its applications. Computers & Education 50(3), 894–905 (2008)
Hsu, S.H., Wen, M.-H., Wu, M.-C.: Exploring user experiences as predictors of MMORPG addiction. Computers & Education 53(3), 990–999 (2009)
Malone, T.W.: Heuristics for designing enjoyable user interfaces: Lessons from computer games. In: Thomas, J.C., Schneider, M.L. (eds.) Human Factors in Computing Systems. Ablex Publishing Corporation, Norwood (1982)
Federoff, M.A.: Heuristics and Usability Guidelines for the Creation and Evaluation of Fun in Video Games. Indiana University (2002)
Desurvire, H., Caplan, M., Toth, J.A.: Using heuristics to evaluate the playability of games. In: Computer Human Interaction (CHI 2004), Vienna, Austria (2004)
Rieber, L.P., et al.: The role of meaning in interpreting graphical and textual feedback during a computer-based simulation. Computers & Education 27(1), 45–58 (1996)
Mayer, R.E., Moreno, R.: A cognitive theory of multimedia learning: Implications for design principles. In: Annual Meeting of the ACM SIGCHI Conference on Human Factors in Computing Systems, Los Angeles, CA (1998)
Barr, P., Noble, J., Biddle, R.: Video game values: Human-computer interaction and games. Interacting with Computers 19(2), 180–195 (2007)
Sekaran, U., Bougie, R.: Research methods for business: a skill building approach. Wiley, UK (2010)
Hair, J., Babin, B.J., Anderson, R.E.: Multivariate Data Analysis: A global perspective. Pearson, Upper Saddle River (2010)
Barclay, D., Higgins, C., Thompson, R.: The partial least squares (PLS) approach to causal modeling: personal computer adoption and use as an illustration. Technology Studies 2(2), 285–309 (1995)
Fornell, C., Larcker, D.F.: Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 39–50 (1981)
Nunnally, J.: Psychometric theory. McGraw-Hill, New York (1978)
Churchill Jr., G.A.: A paradigm for developing better measures of marketing constructs. Journal of Marketing Research, 64–73 (1979)
Compeau, D.R., Higgins, C.A.: Computer self-efficacy: Development of a measure and initial test. Mis Quarterly, 189–211 (1995)
Hair, J.F., et al.: Multivariate data analysis. Prentice Hall, Upper Saddle River (1998)
Nunnally, J.C., Bernstein, I.H.: Psychometric theory. McGraw, New York (1991, 1994)
Gefen, D., Straub, D.W., Boudreau, M.-C.: Structural equation modeling and regression: Guidelines for research practice. In: Communications of the Association for Information Systems. Citeseer (2000)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer International Publishing Switzerland
About this paper
Cite this paper
Mohamed, H., Jaafar, A. (2013). Playability Assessment for Educational Computer Games: Pilot Study for Model Development. In: Zaman, H.B., Robinson, P., Olivier, P., Shih, T.K., Velastin, S. (eds) Advances in Visual Informatics. IVIC 2013. Lecture Notes in Computer Science, vol 8237. Springer, Cham. https://doi.org/10.1007/978-3-319-02958-0_36
Download citation
DOI: https://doi.org/10.1007/978-3-319-02958-0_36
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-02957-3
Online ISBN: 978-3-319-02958-0
eBook Packages: Computer ScienceComputer Science (R0)