research-article

Cognitive walkthrough of a learning management system with gendered personas

Authors:

Nicola MarsdenAuthors Info & Claims

GenderIT '18: Proceedings of the 4th Conference on Gender & IT

Pages 191 - 198

https://doi.org/10.1145/3196839.3196869

Published: 14 May 2018 Publication History

Abstract

The GenderMag cognitive walkthrough with gendered personas has been developed as an inspection method to improve the usability of software artefacts for diverse user groups. It can be used by design teams to evaluate their software and find usability issues. We studied the effectiveness of this method in 49 sessions with IT professionals and software engineering students. They used the method to find usability issues with a learning management system - some of them working with the persona displaying characteristics that are more commonly found in females ("Sarah"), the others with the persona that had attributes more typical for males ("Tim"). Quantitative and qualitative analyses were conducted and showed the effectiveness of the method when using the persona Sarah, with participants finding more usability issues and invoking the persona more often.

References

[1]

Tamara Adlin and John Pruitt. 2010. The Essential Persona Lifecycle: Your Guide to Building and Using Personas. Morgan Kaufmann Publishers Inc.,

Digital Library

[2]

Corinna Bath. 2009. Searching for Methodology: Feminist Technology Design in Computer Science.

[3]

Laura Beckwith, Margaret Burnett, Susan Wiedenbeck, Curtis Cook, Shraddha Sorte and Michelle Hastings. 2005. Effectiveness of End-User Debugging Software Features: Are There Gender Issues? In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, Portland, Oregon, USA, 869--878.

Digital Library

[4]

Laura Beckwith, Cory Kissinger, Margaret Burnett, Susan Wiedenbeck, Joseph Lawrance, Alan Blackwell and Curtis Cook. 2006. Tinkering and Gender in End-User Programmers' Debugging. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, Montréal, Québec, Canada, 231--240.

Digital Library

[5]

Margaret M. Burnett, Laura Beckwith, Susan Wiedenbeck, Scott D. Fleming, Jill Cao, Thomas H. Park, Valentina Grigoreanu and Kyle Rector. 2011. Gender Pluralism in Problem-Solving Software. Interact. Comput. 23, 5, 450--460.

Digital Library

[6]

Margaret Burnett, Anicia Peters, Charles Hill and Noha Elarief. 2016. Finding Gender-Inclusiveness Software Issues with Gendermag: A Field Investigation. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, San Jose, California, USA, 2586--2598.

Digital Library

[7]

Margaret Burnett, Simone Stumpf, Jamie Macbeth, Stephann Makri, Laura Beckwith, Irwin Kwan, Anicia Peters and William Jernigan. 2016. Gendermag: A Method for Evaluating Software's Gender Inclusiveness. Interacting with Computers 28, 6, 760--787.

[8]

Alan Cooper. 1999. The Inmates Are Running the Asylum. Macmillan Publishing Co., Inc.,

Digital Library

[9]

Thomas Dohmen, David Huffman, J. Schupp, xfc, rgen, Armin Falk, Uwe Sunde and Gert G. Wagner. 2011. Individual Risk Attitudes: Measurement, Determinants, and Behavioral Consequences. Journal of the European Economic Association 9, 3, 522--550.

[10]

Susan Fiske. 2000. Stereotyping, Prejudice, and Discrimination at the Seam between the Centuries: Evolution, Culture, Mind, and Brain.

[11]

Ingbert R Floyd, M Cameron Jones and Michael B Twidale. 2008. Resolving Incommensurable Debates: A Preliminary Identification of Persona Kinds, Attributes, and Characteristics. Artifact 2, 1, 12--26.

[12]

Erin Friess. 2012. Personas and Decision Making in the Design Process: An Ethnographic Case Study. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, Austin, Texas, USA, 1209--1218.

Digital Library

[13]

Kim Goodwin. 2009. Designing for the Digital Age: How to Create Human-Centered Products and Services. Wiley Publishing,

Digital Library

[14]

Valentina Grigoreanu, Jill Cao, Todd Kulesza, Christopher Bogart, Kyle Rector, Margaret Burnett and Susan Wiedenbeck. 2008. Can Feature Design Reduce the Gender Gap in End-User Software Development Environments? In Proceedings of Proceedings of the 2008 IEEE Symposium on Visual Languages and Human-Centric Computing. IEEE Computer Society, 149--156.

Digital Library

[15]

Morten Hertzum and Niels Ebbe Jacobsen. 1999. The Evaluator Effect During First-Time Use of the Cognitive Walkthrough Technique. In Proceedings of HCI International (the 8th International Conference on Human-Computer Interaction) on Human-Computer Interaction: Ergonomics and User Interfaces-Volume I - Volume I. L. Erlbaum Associates Inc., 1063--1067.

Digital Library

[16]

Charles G. Hill, Maren Haag, Alannah Oleson, Chris Mendez, Nicola Marsden, Anita Sarma and Margaret Burnett. 2017. Gender-Inclusiveness Personas Vs. Stereotyping: Can We Have It Both Ways? In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, Denver, Colorado, USA, 6658--6671.

Digital Library

[17]

Karen Holtzblatt, Jessamyn Burns Wendell and Shelley Wood. 2005. Rapid Contextual Design: A How-to Guide to Key Techniques for User-Centered Design. Ubiquity 2005, March, 3-3.

Digital Library

[18]

Will Jerigan, Amber Horvath, Michael Lee, Margaret Burnett, Cuilty Taylor, Sandeep Kuttal, Anicia Peters, Irwin Kwan, Faezeh Bahmani and Andrew Ko. 2015. A Principled Evaluation for a Principled Idea Garden.

[19]

Clayton Lewis, Peter G. Polson, Cathleen Wharton and John Rieman. 1990. Testing a Walkthrough Methodology for Theory-Based Design of Walk-up-and-Use Interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, Seattle, Washington, USA, 235--242.

Digital Library

[20]

Clayton Lewis and John Rieman. 2011. Task-Centered User Interface Design.

[21]

Thomas Mahatody, Mouldi Sagar and Christophe Kolski. 2010. State of the Art on the Cognitive Walkthrough Method, Its Variants and Evolutions.

[22]

Simone Stumpf, Margaret Burnett, Laura Beckwith, and Anicia Peters. Nov. 14, 2016. The GenderMag Kit: How to Use the Gendermag Method to Find Inclusiveness Issues through a Gender Lens. http://gendermag.org

[23]

Nicola Marsden. 2014. Gender-Useit - HCI, Usability Und UX Unter Gendergesichtspunkten. München: De Gruyter Oldenbourg

[24]

Nicola Marsden and Maren Haag. 2016. Stereotypes and Politics: Reflections on Personas. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, Santa Clara, California, USA, 4017--4031.

Digital Library

[25]

Adrienne L. Massanari. 2010. Designing for Imaginary Friends: Information Architecture, Personas and the Politics of User-Centered Design. New Media & Society 12, 3, 401--416. http://dx.doi.org/

[26]

Joan Meyers-Levy and Durairaj Maheswaran. 1991. Exploring Differences in Males' and Females' Processing Strategies. Journal of Consumer Research 18, 1, 63--70.

[27]

Tomasz Miaskiewicz and Kenneth A. Kozar. 2011. Personas and User-Centered Design: How Can Personas Benefit Product Design Processes?

[28]

Lene Nielsen and Kira Storgaard Hansen. 2014. Personas Is Applicable: A Study on the Use of Personas in Denmark. In Proceedings of Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, Toronto, Ontario, Canada, 1665--1674.

Digital Library

[29]

Peter G. Polson, Clayton Lewis, John Rieman and Cathleen Wharton. 1992. Cognitive Walkthroughs: A Method for Theory-Based Evaluation of User Interfaces. Int. J. Man-Mach. Stud. 36, 5, 741--773.

Digital Library

[30]

Desney S. Tan, Mary Czerwinski and George Robertson. 2003. Women Go with the (Optical) Flow. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, Ft. Lauderdale, Florida, USA, 209--215.

Digital Library

[31]

Cathleen Wharton, Janice Bradford, Robin Jeffries and Marita Franzke. 1992. Applying Cognitive Walkthroughs to More Complex User Interfaces: Experiences, Issues, and Recommendations. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, Monterey, California, USA, 381--388.

Digital Library

[32]

Cathleen Wharton, John Rieman, Clayton Lewis and Peter Polson. 1994. The Cognitive Walkthrough Method: A Practitioner's Guide. In Usability Inspection Methods, Nielsen Jakob and L. Mack Robert Eds. John Wiley & Sons, Inc., 105--140.

Digital Library

[33]

Gayna Williams. 2014. Are You Sure Your Software Is Gender-Neutral? interactions 21, 1, 36--39.

Digital Library

Cited By

D'Agustino S(2024)Social Reproduction and Equity Challenges in Learning Management Systems (LMS) Within Online EducationDigital Literacy at the Intersection of Equity, Inclusion, and Technology10.4018/979-8-3693-2591-9.ch002(20-48)Online publication date: 28-Jun-2024
https://doi.org/10.4018/979-8-3693-2591-9.ch002
Anderson AGuevara JMoussaoui FLi TVorvoreanu MBurnett M(2024)Measuring User Experience Inclusivity in Human-AI Interaction via Five User Problem-Solving StylesACM Transactions on Interactive Intelligent Systems10.1145/366374014:3(1-90)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1145/3663740
Şengün SSalminen JJung SAldous KJansen B(2024)“There’s Something About Noura”: Exploring Think-Aloud Reasonings for Users’ Persona Choice in a Design TaskProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661512(1234-1247)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661512
Show More Cited By

Index Terms

Cognitive walkthrough of a learning management system with gendered personas
1. Applied computing
  1. Law, social and behavioral sciences
    1. Psychology
2. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Gender-Inclusiveness Personas vs. Stereotyping: Can We Have it Both Ways?
CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

Personas often aim to improve product designers' ability to "see through the eyes of" target users through the empathy personas can inspire - but personas are also known to promote stereotyping. This tension can be particularly problematic when personas ...
Design and Evaluation of Intelligent Menu Interface through Cognitive Walkthrough Procedure and Automated Logging for Management Information System
Computer Supported Cooperative Work in Design IV

One of the critcal issues in Managment Information System (MIS) is the information overload from complicated hierachical menu. Novice users easily get lost when an important and frequently used menu item is rooted and hidden in a deeper level of a ...
Designing with Only Four People in Mind? --- A Case Study of Using Personas to Redesign a Work-Integrated Learning Support System
INTERACT '09: Proceedings of the 12th IFIP TC 13 International Conference on Human-Computer Interaction: Part II

In this paper we describe and reflect on the use of personas to redesign the 3^rd prototype of APOSDLE --- a system to support informal learning and knowledge transfer in the workplace. Based on the results of a formative evaluation of the 2^nd prototype ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

GenderIT '18: Proceedings of the 4th Conference on Gender & IT

May 2018

253 pages

ISBN:9781450353465

DOI:10.1145/3196839

General Chairs:
Nicola Marsden
Heilbronn University
,
Volker Wulf
University of Siegen
,
Program Chairs:
Jennifer Rode
University College London
,
Anne Weibert
University of Siegen

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 May 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

German Federal Ministry of Education and Research (BMBF)

Conference

GenderIT '18

GenderIT '18: Gender & IT 2018

May 14 - 15, 2018

Heilbronn, Germany

Acceptance Rates

GenderIT '18 Paper Acceptance Rate 39 of 55 submissions, 71%;

Overall Acceptance Rate 39 of 55 submissions, 71%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

33
Total Citations
View Citations
531
Total Downloads

Downloads (Last 12 months)38
Downloads (Last 6 weeks)12

Reflects downloads up to 14 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

D'Agustino S(2024)Social Reproduction and Equity Challenges in Learning Management Systems (LMS) Within Online EducationDigital Literacy at the Intersection of Equity, Inclusion, and Technology10.4018/979-8-3693-2591-9.ch002(20-48)Online publication date: 28-Jun-2024
https://doi.org/10.4018/979-8-3693-2591-9.ch002
Anderson AGuevara JMoussaoui FLi TVorvoreanu MBurnett M(2024)Measuring User Experience Inclusivity in Human-AI Interaction via Five User Problem-Solving StylesACM Transactions on Interactive Intelligent Systems10.1145/366374014:3(1-90)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1145/3663740
Şengün SSalminen JJung SAldous KJansen B(2024)“There’s Something About Noura”: Exploring Think-Aloud Reasonings for Users’ Persona Choice in a Design TaskProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661512(1234-1247)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661512
Garcia RMorreale PPatel PGuevara JMoz-Ruiz DSatish Kumar SVelhal PBusteed ABurnett M(2024)Beyond “Awareness”: If We Teach Inclusive Design, Will Students Act On It?Proceedings of the 2024 ACM Conference on International Computing Education Research - Volume 110.1145/3632620.3671101(434-451)Online publication date: 12-Aug-2024
https://dl.acm.org/doi/10.1145/3632620.3671101
Kaate ISalminen JJung SSantos JHäyhänen EXuan TAzem JJansen BBoratto LGena CMarras MGermanakos PPopescus E(2024)Modeling the New Modalities of Personas: How Do Users' Attributes Influence Their Perceptions and Use of Interactive Personas?Adjunct Proceedings of the 32nd ACM Conference on User Modeling, Adaptation and Personalization10.1145/3631700.3664882(164-169)Online publication date: 27-Jun-2024
https://dl.acm.org/doi/10.1145/3631700.3664882
Garcia RMorreale PVerdi GGarcia HNoa GMadsen SAlzugaray-Orellana MLi EBurnett M(2024)The Matchmaker Inclusive Design Curriculum: A Faculty-Enabling Curriculum to Teach Inclusive Design Throughout Undergraduate CSProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642475(1-22)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642475
Murphy-Hill EElizondo AMurillo AHarbach MVasilescu BCarlson DDessloch FRoychoudhury APaiva AAbreu RStorey M(2024)GenderMag Improves Discoverability in the Field, Especially for WomenProceedings of the IEEE/ACM 46th International Conference on Software Engineering10.1145/3597503.3639097(1-12)Online publication date: 20-May-2024
https://dl.acm.org/doi/10.1145/3597503.3639097
Khan TRashid UKhan A(2024)End-to-end pseudo relevance feedback based vertical web search queries recommendationMultimedia Tools and Applications10.1007/s11042-024-18559-4Online publication date: 21-Feb-2024
https://doi.org/10.1007/s11042-024-18559-4
Hamid MChatterjee AGuizani MAnderson AMoussaoui FYang SEscobar ISarma ABurnett M(2024)How to Measure Diversity Actionably in TechnologyEquity, Diversity, and Inclusion in Software Engineering10.1007/978-1-4842-9651-6_27(469-485)Online publication date: 21-Sep-2024
https://doi.org/10.1007/978-1-4842-9651-6_27
Yildirim-Erbasli SBulut ODemmans Epp CCui Y(2023)Conversation-Based Assessments in Education: Design, Implementation, and Cognitive Walkthroughs for Usability TestingJournal of Educational Technology Systems10.1177/0047239523117894352:1(27-51)Online publication date: 5-Jun-2023
https://doi.org/10.1177/00472395231178943
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents