Mobile Screen-based User Interface Design Guideline for Panoramic VR in Shopping Scene
MobileHCI '21: Proceedings of the 23rd International Conference on Mobile Human-Computer Interaction
Article No.: 34, Pages 1 - 14
Abstract
The pandemic has shifted people’s shopping behavior towards online resources. Mobile screen-based panoramic virtual reality (VR) appears to be a promising form for future online shopping. However, the existing user interface (UI) design of panoramic VR shopping needs more natural interactions based on a rational standard design guideline. In this article, we first conducted a heuristic study to compare six representative virtual store apps. This revealed a gap between users’ requirements and the current design attempts. Thus, a UI design guideline for panoramic VR in the shopping scene was presented. Then, we conducted a verification study with a demo optimized according to our design guideline. Both user experience and interactive efficiency improved as a result of the design guideline. Our design guidelines and discoveries derived from user studies provided references for the design, development, and potential use of dynamic panoramic VR in shopping scene.
References
[1]
Véronique Aubert-Gamet and Bernard Cova. 1999. Servicescapes: From Modern Non-Places to Postmodern Common Places. Journal of Business Research 44, 1 (1999), 37–45. https://doi.org/10.1016/S0148-2963(97)00176-8
[2]
Barry J Babin, William R Darden, and Mitch Griffin. 1994. Work and/or fun: measuring hedonic and utilitarian shopping value. Journal of consumer research 20, 4 (03 1994), 644–656. https://doi.org/10.1086/209376
[3]
Julie Baker, Albert Parasuraman, Dhruv Grewal, and Glenn B Voss. 2002. The influence of multiple store environment cues on perceived merchandise value and patronage intentions. Journal of marketing 66, 2 (2002), 120–141. https://doi.org/10.1509/jmkg.66.2.120.18470
[4]
Doug A Bowman, Ernst Kruijff, Joseph J LaViola Jr, and Ivan Poupyrev. 2001. An introduction to 3-D user interface design. Presence: Teleoperators & Virtual Environments 10, 1 (02 2001), 96–108. https://doi.org/10.1162/105474601750182342
[5]
Laura Busse, Steffen Katzner, and Stefan Treue. 2006. Spatial and feature-based effects of exogenous cueing on visual motion processing. Vision research 46, 13 (2006), 2019–2027. https://doi.org/10.1016/j.visres.2005.12.016
[6]
Huiwen Chang and Michael F. Cohen. 2017. Panning and Zooming High-Resolution Panoramas in Virtual Reality Devices. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology(Québec City, QC, Canada) (UIST ’17). Association for Computing Machinery, New York, NY, USA, 279–288. https://doi.org/10.1145/3126594.3126617
[7]
Nameirakpam Dhanachandra, Khumanthem Manglem, and Yambem Jina Chanu. 2015. Image segmentation using K-means clustering algorithm and subtractive clustering algorithm. Procedia Computer Science 54 (2015), 764–771. https://doi.org/10.1016/j.procs.2015.06.090
[8]
Mark H Draper, Erik S Viirre, Thomas A Furness, and Valerie J Gawron. 2001. Effects of image scale and system time delay on simulator sickness within head-coupled virtual environments. Human factors 43, 1 (2001), 129–146. https://doi.org/10.1518/001872001775992552 11474759.
[9]
Ricardo Eiris, Masoud Gheisari, and Behzad Esmaeili. 2020. Desktop-based safety training using 360-degree panorama and static virtual reality techniques: A comparative experimental study. Automation in Construction 109 (2020), 102969. https://doi.org/10.1016/j.autcon.2019.102969
[10]
Donald L Fisher, Jeff K Caird, Matthew Rizzo, and John D Lee. 2011. Handbook of driving simulation for engineering, medicine and psychology: an overview. Handbook of driving simulation for engineering, medicine, and psychology (1 Jan. 2011), 1–1–1—16. https://api.taylorfrancis.com/content/books/mono/download?identifierName=doi&identifierValue=10.1201/b10836&type=googlepdf#page=20
[11]
Linda L Golden and Keren A Johnson. 1983. The impact of sensory preference and thinking versus feeling appeals on advertising effectiveness. ACR North American Advances 10 (1983), 203–208. https://www.acrwebsite.org/volumes/6113/volumes/v10/NA-10
[12]
Jun Gong, Peter Tarasewich, 2004. Guidelines for handheld mobile device interface design. In Proceedings of DSI 2004 Annual Meeting. Citeseer, 3751–3756. https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.87.5230&rep=rep1&type=pdf
[13]
Shahrbanoo Hamel, Nathalie Guyader, Denis Pellerin, and Dominique Houzet. 2014. Color Information in a Model of Saliency. In EUSIPCO 2014 - 22th European Signal Processing Conference (Lisbonne, Portugal). IEEE, Los Alamitos, CA, 1–5. https://hal.archives-ouvertes.fr/hal-01068276
[14]
Aija Hangland and Richard S Cimbalo. 1997. Human ethology: age and sex differences in mall walking. Perceptual and Motor Skills 85, 3 (1997), 845–846. https://doi.org/10.2466/pms.1997.85.3.845
[15]
Robert Hardy and Enrico Rukzio. 2008. Touch & Interact: Touch-Based Interaction of Mobile Phones with Displays. In Proceedings of the 10th International Conference on Human Computer Interaction with Mobile Devices and Services (Amsterdam, The Netherlands) (MobileHCI ’08). Association for Computing Machinery, New York, NY, USA, 245–254. https://doi.org/10.1145/1409240.1409267
[16]
Riitta Hellman. 2007. Universal design and mobile devices. In International Conference on Universal Access in Human-Computer Interaction. Springer, Berlin, Heidelberg, 147–156. https://link.springer.com/chapter/10.1007/978-3-540-73279-2_17
[17]
Andrew Howes, Gareth E Miles, Stephen J Payne, Christabel D Mitchell, and Anthony J Davies. 2001. Incidental memory and navigation in panoramic virtual reality for electronic commerce. Human factors 43, 2 (2001), 239–254. https://doi.org/10.1518/001872001775900869
[18]
Tai-Hsiang Huang, Su-Ling Yeh, Yung-Hao Yang, Hsin-I Liao, Ya-Yeh Tsai, Pai-Ju Chang, and Homer H Chen. 2015. Method and experiments of subliminal cueing for real-world images. Multimedia Tools and Applications 74, 22 (2015), 10111–10135. https://doi.org/10.1007/s11042-015-2804-1
[19]
Corp IBM. 2011. IBM SPSS Statistics for Windows. Retrieved February 3, 2021 from https://www.ibm.com/br-pt/marketplace/spss-statistics
[20]
IKEA. 2021. We create interactive experiences. Retrieved February 3, 2021 from https://demodern.com/projects
[21]
Lina Jansen, Selim Onat, and Peter König. 2009. Influence of disparity on fixation and saccades in free viewing of natural scenes. Journal of Vision 9, 1 (2009), 29–29. https://doi.org/10.1167/9.1.29
[22]
Liu Juan, Ge Yan, Sun Xiang-hong, Wang Xin, Ning Li, and Zhang Kan. 2011. Can Subliminal Signal Affect Human’s Judgment and Decision-making? A Helpful Study for Designing Computerized Decision Support Systems. In 2011 Fourth International Conference on Intelligent Computation Technology and Automation, Vol. 1. IEEE, Los Alamitos, CA, 1026–1029. https://doi.org/10.1109/ICICTA.2011.257
[23]
Brian Kehrer. 2016. VR Distortion Correction Using Vertex Displacement.Retrieved February 3, 2021 from https://www.gamasutra.com/blogs/BrianKehrer/20160125/264161/VR_Distortion_Correction_using_Vertex_Displacement.php
[24]
Congyan Lang, Tam V Nguyen, Harish Katti, Karthik Yadati, Mohan Kankanhalli, and Shuicheng Yan. 2012. Depth matters: Influence of depth cues on visual saliency. In European conference on computer vision. Springer, Berlin, Heidelberg, 101–115.
[25]
George H Lewis. 1990. Community through exclusion and illusion: The creation of social worlds in an American shopping mall. The Journal of Popular Culture 24, 2 (1990), 121–136. https://doi.org/10.1111/j.0022-3840.1990.2402_121.x
[26]
Junxiong Li, Alan G Hallsworth, and J Andres Coca-Stefaniak. 2020. Changing grocery shopping behaviours among Chinese consumers at the outset of the COVID-19 outbreak. Tijdschrift voor economische en sociale geografie 111, 3(2020), 574–583. https://doi.org/10.1111/tesg.12420
[27]
Han X Lin, Yee-Yin Choong, and Gavriel Salvendy. 1997. A proposed index of usability: a method for comparing the relative usability of different software systems. Behaviour & information technology 16, 4-5 (1997), 267–277. https://doi.org/10.1080/014492997119833
[28]
MartinJenkins. 2019. Beyond the tech babble: How Ikea, KFC, Adidas and others are using VR/AR. Retrieved February 3, 2021 from https://medium.com/from-the-exosphere/beyond-the-tech-babble-how-ikea-kfc-adidas-and-others-are-using-vr-ar-4b0426ad9bcc
[29]
Mastercard. 2017. Mastercard And Swarovski Launch Virtual Reality Shopping Experience. Retrieved February 3, 2021 from https://newsroom.mastercard.com/press-releases/mastercard-and-swarovski-launch-virtual-reality-shopping-experience/
[30]
Chris McKenzie and Adam Glazier. 2017. Designing Screen Interfaces for VR (Google I/O ’17). Video. Retrieved February 3, 2021 from https://youtu.be/ES9jArHRFHQ
[31]
Gabriele Meiselwitz, Brian Wentz, and Jonathan Lazar. 2010. . Now Publishers Inc., Boston, USA. https://doi.org/10.1561/9781601983770
[32]
Robert Mohl. 1981. Cognitive space in the interactive movie map: an investigation of spatial learning in virtual environments. Ph.D. Dissertation. Department of Architecture, Massachusetts Institute of Technology.
[33]
Jorge I. Mora Fernández. 2015. Interactive Digital Storytelling and HCI Techniques Applied for Edutainment in Interactive Health Projects: Analysis of Two USC’s Labyrinth Projects. In Design, User Experience, and Usability: Design Discourse, Aaron Marcus (Ed.). Springer International Publishing, Cham, 621–633. https://doi.org/10.1007/978-3-319-20886-2_58
[34]
Jana Mänz and Susan Brooks-Dammann. 2015. The Magic of the Bokeh. GD Publishing, Berlin, Germany.
[35]
Masaya Ohta, Shunsuke Nagano, Seiya Takahashi, Hiroki Abe, and Katsumi Yamashita. 2015. Mixed-Reality Shopping System Using HMD and Smartwatch. In Adjunct Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2015 ACM International Symposium on Wearable Computers(Osaka, Japan) (UbiComp/ISWC’15 Adjunct). Association for Computing Machinery, New York, NY, USA, 125–128. https://doi.org/10.1145/2800835.2800888
[36]
Jiseob Park, Junho Choi, and Cheul Rhee. 2020. Futuristic VR image presentation technique for better mobile commerce effectiveness. Virtual Reality (2020), 1–16. https://doi.org/10.1007/s10055-020-00459-1
[37]
Randy Pausch, Thomas Crea, and Matthew Conway. 1992. A literature survey for virtual environments: Military flight simulator visual systems and simulator sickness. Presence: Teleoperators & Virtual Environments 1, 3(1992), 344–363. https://doi.org/10.1162/pres.1992.1.3.344
[38]
Sarah Perez. 2015. Google’s New Street View App Lets You Browse 360-Degree Imagery, Share Your Own Panoramic Photos. Retrieved February 3, 2021 from https://techcrunch.com/2015/09/03/googles-new-street-view-app-less-you-browse-360-degree-imagery-shareyour-own-panoramic-photos/
[39]
Gabriele Pizzi, Daniele Scarpi, Marco Pichierri, and Virginia Vannucci. 2019. Virtual reality, real reactions?: Comparing consumers’ perceptions and shopping orientation across physical and virtual-reality retail stores. Computers in Human Behavior 96 (2019), 1–12. https://doi.org/10.1016/j.chb.2019.02.008
[40]
Jiehui Qian, Ke Zhang, Kaiyue Wang, Jiaofeng Li, and Quan Lei. 2018. Saturation and brightness modulate the effect of depth on visual working memory. Journal of vision 18, 9 (2018), 16–16. https://doi.org/10.1167/18.9.16
[41]
Jaziar Radianti, Tim A Majchrzak, Jennifer Fromm, and Isabell Wohlgenannt. 2020. A systematic review of immersive virtual reality applications for higher education: Design elements, lessons learned, and research agenda. Computers & Education 147 (2020), 103778. https://doi.org/10.1016/j.compedu.2019.103778
[42]
Robert E Roth. 2015. Interactivity and cartography: A contemporary perspective on user interface and user experience design from geospatial professionals. Cartographica: The International Journal for Geographic Information and Geovisualization 50, 2 (2015), 94–115. https://doi.org/10.3138/cart.50.2.2427
[43]
Sylvia Rothe, Boris Kegeles, and Heinrich Hussmann. 2019. Camera Heights in Cinematic Virtual Reality: How Viewers Perceive Mismatches Between Camera and Eye Height. In Proceedings of the 2019 ACM International Conference on Interactive Experiences for TV and Online Video (Salford (Manchester), United Kingdom) (TVX ’19). Association for Computing Machinery, New York, NY, USA, 25–34. https://doi.org/10.1145/3317697.3323362
[44]
Abhik Roy. 1994. Correlates of mall visit frequency. Journal of Retailing 70, 2 (1994), 139–161. https://doi.org/10.1016/0022-4359(94)90012-4
[45]
Rodica Schileru-Key. 2003. Graph-based visual navigation through store environments. US Patent 6,580,441.
[46]
Ann E Schlosser. 1998. Applying the functional theory of attitudes to understanding the influence of store atmosphere on store inferences. Journal of Consumer Psychology 7, 4 (1998), 345–369. https://doi.org/10.1207/s15327663jcp0704_03
[47]
Jagdish Sheth. 2020. Impact of Covid-19 on consumer behavior: Will the old habits return or die?Journal of Business Research 117 (2020), 280–283. https://doi.org/10.1016/j.jbusres.2020.05.059
[48]
Soyeon Shim and Mary Ann Eastlick. 1998. The hierarchical influence of personal values on mall shopping attitute and behavior. Journal of Retailing 74, 1 (1998), 139–160. https://doi.org/10.1016/S0022-4359(99)80091-8
[49]
Ben Shneiderman. 1998. Designing the user interface: strategies for effective human-computer. Interaction 3(1998).
[50]
Wanda J Smith. 1996. ISO and ANSI ergonomic standards for computer products: A guide to implementation and compliance. Prentice-Hall, Inc., Upper Saddle River, NJ.
[51]
Marco Speicher, Sebastian Cucerca, and Antonio Krüger. 2017. VRShop: A Mobile Interactive Virtual Reality Shopping Environment Combining the Benefits of On- and Offline Shopping. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 3, Article 102 (Sept. 2017), 31 pages. https://doi.org/10.1145/3130967
[52]
Norbert Streitz, Carsten Röcker, Thorsten Prante, Richard Stenzel, and Daniel Van Alphen. 2003. Situated interaction with ambient information: Facilitating awareness and communication in ubiquitous work environments. Human-Centred Computing: Cognitive, Social, and Ergonomic Aspects (2003), 133–137.
[53]
Seth Thompson. 2015. VR Panoramic Photography and Hypermedia: Drawing from the Panorama’s Past. International Symposium on Electronic Art, Vancouver, Canada. https://dspace.aus.edu/xmlui/handle/11073/8793
[54]
Walmart. 2021. VR Virtual Shopping Experience. Retrieved February 3, 2021 from https://mutualmobile.com/work/walmart
[55]
Matthias Wölfel and Anna Reinhardt. 2019. Immersive Shopping Presentation of Goods in Virtual Reality. In CERC. CERC, Prague, Czech, 119–130. https://www.researchgate.net/profile/Matthias_Woelfel/publication/333998361_Immersive_Shopping_-_Presentation_of_Goods_in_Virtual_Reality/links/5d121faf458515c11cf6fac8/Immersive-Shopping-Presentation-of-Goods-in-Virtual-Reality.pdf
Recommendations
Mixed-reality shopping system using HMD and smartwatch
UbiComp/ISWC'15 Adjunct: Adjunct Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2015 ACM International Symposium on Wearable ComputersThis research proposes a mixed-reality shopping system to assist disadvantaged shoppers. Using a smartwatch as a controller, the user can move freely around the store while viewing the panoramic photo image of the store displayed on a head mounted ...
SCReen adjusted panoramic effect: SCRAPE
MM '13: Proceedings of the 21st ACM international conference on MultimediaA Cave Automatic Virtual Environment (CAVE) is an enclosed virtual reality room that uses multiple projectors to display images across its surfaces. It uses one or more computers to synchronise and combine the images and allows users to control virtual ...
VR user interface: closed world interaction
VRST '00: Proceedings of the ACM symposium on Virtual reality software and technologyIn this paper, we describe a user interface technique that uses a bounding box as a m taphor to facilitate interaction in a Virtual Reality (VR) environment. Because this technique is based on the observation that some of the VR application fields are ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
September 2021
637 pages
ISBN:9781450383288
DOI:10.1145/3447526
Copyright © 2021 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 27 September 2021
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Funding Sources
- The National Key Research and Development Program of China
- Alibaba Group.
Conference
MobileHCI '21
Sponsor:
MobileHCI '21: 23rd International Conference on Mobile Human-Computer Interaction
September 27 - October 1, 2021
Toulouse & Virtual, France
Acceptance Rates
Overall Acceptance Rate 202 of 906 submissions, 22%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 478Total Downloads
- Downloads (Last 12 months)143
- Downloads (Last 6 weeks)12
Reflects downloads up to 18 Nov 2024
Other Metrics
Citations
Cited By
View allView Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in