research-article

Collecting cross-cultural user data with internationalized storyboard survey

Authors:

Jari Varsaluoma,

Sara BeltAuthors Info & Claims

OzCHI '11: Proceedings of the 23rd Australian Computer-Human Interaction Conference

Pages 301 - 310

https://doi.org/10.1145/2071536.2071584

Published: 28 November 2011 Publication History

Abstract

Globalization and the search for experiential aspects of technology products and services have increased the demand for cross-cultural user feedback. Remote methods would suit agile global data collection, but only few common practices yet exist. Thus, the goal of the present study was to determine ways in which common visual stimulus material (internationalized storyboards) are perceived similarly and differently by cross-cultural respondents. An internationalized remote online storyboard survey was designed to collect cross-cultural user data of 252 respondents, from the USA, Brazil, India, Italy and Finland -- around the topic of mobile content sharing concepts. It was found that, for the majority of situations and details, storyboards supported a similar interpretation by users from different cultural backgrounds; and internationalized pictures assisted respondents in providing rich answers to a long survey because of a sound understanding of the intended situations and ease of imagining themselves in different usage situations.

References

[1]

Aykin, N.: Overview: Where to Start and What to Consider? In: Aykin, N. (Ed.) Usability and Internationalization of Information Technology. New Jersey, US: Lawrence Erlbaum, 2005.

[2]

Aykin, N. & Milewski, A. E. Practical issues and Guidelines for International Information Displays. In Aykin, N. (Ed.) Usability and Internationalization of Information Technology. New Jersey, US: Lawrence Erlbaum, 2005.

[3]

Choi, B., Lee, I., Kim, J. and Jeon, Y. A Qualitative Cross-National Study of Cultural Influences on Mobile Data Service Design. Proc. CHI 2005, ACM (2005), 661--670.

Digital Library

[4]

Clemmensen, T. & Roese, K. An overview of a decade of journal publications about Culture and HumanComputer Interaction (HCI). Workingpaper nr.3 Copenhagen Business School (2009).

[5]

Couper, M., Conrad, F. & Tourangeau, R. Visual Context Effects in Web Surveys. Public Opinion Quarterly, Vol.71, No. 4 (2007), 623--634.

[6]

Del Galdo, E. (1996) Culture and Design. In Del Galdo, E. & Nielsen J. (Eds.), International User Interfaces. New York, USA: John Wiley & Sons.

Digital Library

[7]

Evans, J. R. & Mathur, A. The value of online surveys. Internet Research, Vol. 15 No. 2 (2005), 195--219.

[8]

Hart, J. The Art of the Storyboard: Storyboarding for Film, TV, and Animation. Focal Press, 1998.

[9]

Hartson, H., R. Castillo, J., C., Kelso, J. & Neale, W., C. Remote evaluation: the network as an extension of the usability laboratory. Proc. CHI 1996, ACM (1996), 228--235.

Digital Library

[10]

Holzblatt, K. Wendell, J. & Wood, S. Rapid Contextual Design. A How to Guide to Key Techniques for User-Centered Design. San Francisco, USA: Elsevier, 2005.

[11]

Honold, P. Learning How to Use a Cellular Phone: Comparison Between German and Chinese Users. Technical Communication, 46(2) (1999). 196--205.

[12]

Horton, W. Graphics: The Not Quite Universal Language. In Aykin, N. (Ed.) Usability and Internationalization of Information Technology. New Jersey, US: Lawrence Erlbaum, 2005.

[13]

Ito, M. & Nakakoji, K. (1996) Impact of Culture on User Interface Design. In: Del Galdo, E. & Nielsen J. (Eds.) International User Interfaces. New York, USA: John Wiley & Sons.

Digital Library

[14]

Jones, S., Kenelly, C., Mueller, C., Sweezy, M., Thomas, B., & Velez, L. Developing International User Information. Bedford, MA: Digital Press, 1992.

Digital Library

[15]

Karat, J., Karat, C-M., & Vergo, J. Experiences People Value: The New Frontier of Task Analysis. In: Stanton, A. & Diaper, D. (Eds.) The Handbook of Task Analysis for Human-Computer Interaction, pp. 585--603. Lawrence Erlbaum Associates, Mahwah, USA, 2004.

[16]

Keesing, R. M. & Strathern, A. J. (1998) Cultural Anthropology: A Contemporary Perspective. Forth Worth; Harcourt Brace College.

[17]

LISA (Localisation Industry Standards Association). The Globalization Industry Primer. Retrieved February 2011 from http://www.lisa.org/Globalization-indust.468.0.html

[18]

Madden, T. J., Hewett, K. & Roth, M. S. Managing Images in Different Cultures: Cross-National Study on Color Meanings and Preferences. Journal of International Marketing, Vol. 8. No. 4. (2000), 90--107.

[19]

Marcus, A. (2006) Cross-Cultural User Experience Design. In: (Barker-Plummer, O. et al. Eds.) Diagrams 2006, LNAI 4045. Berlin Heidelberg: Springer Verlag, pp. 16--24.

Digital Library

[20]

Marzano, S. New Values for New Millenium. Philips Corporate Design. V+K Publishing, Eindhoven, Netherlands, 2000.

[21]

Monahan, K., Lähteenmäki, M., McDonald, S. & Cockton, G. An Investigation into the Use of Field Methods in the Design and Evaluation of Interactive Systems. Proc. British HCI 2008, ACM (2008), 99--108.

Digital Library

[22]

Nielsen, J. Paper versus computer implementations as mockup scenarios for heuristic evaluation. Proc. IFIP INTERACT 1990, 315--320.

Digital Library

[23]

Oyugi, C., Dunckley L. & Smith A. Evaluation methods and cultural differences: studies across three continents. Proc. NordiCHI 2008, ACM (2008), 318--325.

Digital Library

[24]

Putnam, C, Rode, E, Johnson, E. J. & Kolko, B.: Adapting User-Centered Methods to Design for Diverse Populations. Information Technologies and International Development (2009), 51--73.

[25]

Roto, V., Rantavuo, H. & Vääänänen-Vainio-Mattila, K. Evaluating User Experience of Early Product Concepts. Proc. DPPI 2009, (2009), 199--208.

[26]

Smith, A., Gulliksen, J., and Bannon, L. 2005. Building usability in India: Reflections from the Indo European Systems Usability Partnership. Proc. HCI 2005, Springer, 219--232.

[27]

Van den Hende, E., Schoormans, J., Morel, K., Lashina, T., van Loenen, E. & de Boevere, E. Using early concept narratives to collect valid customer input about breakthrough technologies: The effect of application visualization on transportation. Technological Forecasting and Social Change 74--9 (2007), 1773--1787.

[28]

Vermeeren, A., Law, E., Roto, V., Obrist, M., Hoonhout, J. & Vääänänen-Vainio-Mattila, K. User experience evaluation methods: current state and development needs. Proc. NordiCHI 2010, ACM (2010), 521--530.

Digital Library

[29]

Väänänen-Vainio-Mattila, K., Roto, V., & Hassenzahl, M.: Now Let's Do It in Practice: User Experience Evaluation Methods in Product Development. Ext. Abstracts CHI 2008, ACM (2008), 3961--39.

Digital Library

Cited By

Chambers J(2020)Visualizing Ancient Culture Through the Design of Intermodal Extended Reality ExperiencesHCI International 2020 – Late Breaking Posters10.1007/978-3-030-60703-6_44(343-351)Online publication date: 8-Nov-2020
https://doi.org/10.1007/978-3-030-60703-6_44
(2019)Basics to Branching Logic in Self-Administered Online SurveysOnline Survey Design and Data Analytics10.4018/978-1-5225-8563-3.ch001(1-16)Online publication date: 2019
https://doi.org/10.4018/978-1-5225-8563-3.ch001
Liu SXu S(2018)Conducting Cost-Effective User Research in China RemotelyHCI in Business, Government, and Organizations10.1007/978-3-319-91716-0_9(106-114)Online publication date: 5-Jun-2018
https://doi.org/10.1007/978-3-319-91716-0_9
Show More Cited By

Index Terms

Collecting cross-cultural user data with internationalized storyboard survey
1. Human-centered computing

Recommendations

A Study on User Experience of COVID-19 Emergency Communication Platform from Cross-cultural Perspective of View
Cross-Cultural Design. Applications in Arts, Learning, Well-being, and Social Development
Abstract
From certain point of view, the emergency communication platform plays an important role in fighting against COVID-19. This research aims to explore the user experience of the COVID-19 emergency communication platform in a cross-cultural ...
A cross-cultural analysis of the end-user computing satisfaction instrument: A multi-group invariance analysis

IT managers in global firms often rely on user evaluations to guide their decision-making in adopting, implementing, and monitoring the effectiveness of enterprise systems across national cultures. In these decisions, managers need instruments that ...
Website Design Based on Cultures: An Investigation of Saudis, Filipinos, and Indians Government Websites' Attributes
Proceedings of the Third International Conference on Design, User Experience, and Usability. User Experience Design for Diverse Interaction Platforms and Environments - Volume 8518

Saudi Arabia as a country that attracts foreign workers especially from Asia needs to take into consideration the requirements of multinational cultures when providing its government e-services. This paper investigates the user interface design of top ...

Reviews

Reviewer: George Popescu

This study uses a storyboard survey as a method for collecting the cultural information of users from five countries-US, Brazil, India, Italy, and Finland-to try to understand the perceived understanding of storyboards across different cultural backgrounds. User feedback is often very useful in minimizing product failure risk in a given market. The paper offers a solid presentation of related methods for collecting cross-cultural user feedback. The authors opt for a remote online survey to obtain user responses concerning the usage of five storyboards about five different mobile content-sharing situations. The cross-cultural data collected identifies main categories that most users focus on, as well as some specific ones. The main result states that users from different cultural backgrounds interpret storyboards in similar ways. However, given the specificity of a certain scenario, users would consider a new action given the external environment: for example, users would share news only if that would be considered important by others. The main insights help to reveal how users share photos and other media and how these actions may be further developed in the future. Online Computing Reviews Service

Access critical reviews of Computing literature here

Become a reviewer for Computing Reviews.

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

OzCHI '11: Proceedings of the 23rd Australian Computer-Human Interaction Conference

November 2011

363 pages

ISBN:9781450310901

DOI:10.1145/2071536

Conference Chair:
Duncan Stevenson
Australian National University

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Human Factors & Ergonomics Soc: Human Factors & Ergonomics Soc

In-Cooperation

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 November 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

OzCHI '11

Sponsor:

Human Factors & Ergonomics Soc

OzCHI '11: The Annual Meeting of the Australian Special Interest Group for Computer Human Interaction

November 28 - December 2, 2011

Canberra, Australia

Acceptance Rates

Overall Acceptance Rate 362 of 729 submissions, 50%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

13
Total Citations
View Citations
368
Total Downloads

Downloads (Last 12 months)18
Downloads (Last 6 weeks)0

Reflects downloads up to 19 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Chambers J(2020)Visualizing Ancient Culture Through the Design of Intermodal Extended Reality ExperiencesHCI International 2020 – Late Breaking Posters10.1007/978-3-030-60703-6_44(343-351)Online publication date: 8-Nov-2020
https://doi.org/10.1007/978-3-030-60703-6_44
(2019)Basics to Branching Logic in Self-Administered Online SurveysOnline Survey Design and Data Analytics10.4018/978-1-5225-8563-3.ch001(1-16)Online publication date: 2019
https://doi.org/10.4018/978-1-5225-8563-3.ch001
Liu SXu S(2018)Conducting Cost-Effective User Research in China RemotelyHCI in Business, Government, and Organizations10.1007/978-3-319-91716-0_9(106-114)Online publication date: 5-Jun-2018
https://doi.org/10.1007/978-3-319-91716-0_9
Heimgärtner RSolanki AWindl H(2017)Cultural User Experience in the Car—Toward a Standardized Systematic Intercultural Agile Automotive UI/UX Design ProcessAutomotive User Interfaces10.1007/978-3-319-49448-7_6(143-184)Online publication date: 28-Feb-2017
https://doi.org/10.1007/978-3-319-49448-7_6
Appel ACandello HGandour F(2017)Cognitive Computing: Where Big Data Is Driving UsHandbook of Big Data Technologies10.1007/978-3-319-49340-4_24(807-850)Online publication date: 26-Feb-2017
https://doi.org/10.1007/978-3-319-49340-4_24
Walsh TPetrie HZhang AHolzmann CMayrhofer RHäkkilä JRukzio ERoland M(2015)Localization of storyboards for cross-cultural user studiesProceedings of the 14th International Conference on Mobile and Ubiquitous Multimedia10.1145/2836041.2836061(200-209)Online publication date: 30-Nov-2015
https://dl.acm.org/doi/10.1145/2836041.2836061
Walsh TPetrie HOdutola OLeong T(2014)Developing interactive systems for different culturesProceedings of the 26th Australian Computer-Human Interaction Conference on Designing Futures: the Future of Design10.1145/2686612.2686687(470-479)Online publication date: 2-Dec-2014
https://dl.acm.org/doi/10.1145/2686612.2686687
Rosmani AMazlan UAhmad SMohd Kharul Apendi A(2014)Developing an architectural visualization using 3D for photo tourism2014 International Conference on Computer, Communications, and Control Technology (I4CT)10.1109/I4CT.2014.6914220(429-433)Online publication date: Sep-2014
https://doi.org/10.1109/I4CT.2014.6914220
Brown MCoughlan TBlum JLawson GHoughton RMortier RGoulden MArunachalam U(2014)Tailored Scenarios: A Low-Cost Online Method to Elicit Perceptions of Home Technologies Using Participant-Specific Contextual InformationInteracting with Computers10.1093/iwc/iwu02827:1(60-71)Online publication date: 25-Jul-2014
https://doi.org/10.1093/iwc/iwu028
Petrie HWalsh TOdutola OAng L(2014)Cross-Cultural Issues in Working with Users in the Design of Interactive SystemsICoRD’15 – Research into Design Across Boundaries Volume 110.1007/978-81-322-2232-3_45(515-525)Online publication date: 24-Dec-2014
https://doi.org/10.1007/978-81-322-2232-3_45
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents