Work in Progress

Shop-i: Gaze based Interaction in the Physical World for In-Store Social Shopping Experience

Authors:

Mirae Kim,

Min Kyung Lee,

Laura DabbishAuthors Info & Claims

CHI EA '15: Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems

Pages 1253 - 1258

https://doi.org/10.1145/2702613.2732797

Published: 18 April 2015 Publication History

Get Access

Abstract

Gaze-based interaction has several benefits: naturalism, remote controllability, and easy accessibility. However, it has been mostly used for screen-based interaction with static information. In this paper, we propose a concept of gaze-based interaction that augments the physical world with social information. We demonstrate this interaction in a shopping scenario. In-store shopping is a setting where social information can augment the physical environment to better support a user's purchase decision. Based on the user's ocular point, we project the following information on the product and its surrounding surface: collective in-store gazes and purchase data, product comparison information, animation expressing ingredient of product, and online social comments. This paper presents the design of the system, the results and discussion of an informal user study, and future work.

References

[1]

Black, D., Clemmensen, N. J., & Skov, M. B. (2009). Supporting the supermarket shopping experience through a context-aware shopping trolley. In Proc. of the Australian CHI SIG, 33--40.

Digital Library

Google Scholar

[2]

Bonanni, L., Lee, C. H., & Selker, T. (2005). Counter Intelligence: Augmented reality kitchen. In Proc. of CHI'05, 44.

Google Scholar

[3]

Chen, M. C., Wu, K. Y., & Huang, Y. C. (2014). Scopophobic kitties in wonderland: stories behind the scene of a gaze contingent environment. In CHI'14 EA, 391--394.

Digital Library

Google Scholar

[4]

Garcia-Perate, G., Dalton, N., Conroy-Dalton, R., & Wilson, D. (2013). Ambient recommendations in the pop-up shop. In Proc. of Ubicomp'13, 773--776

Digital Library

Google Scholar

[5]

Jacob, R. J., & Karn, K. S. (2003). Eye tracking in human-computer interaction and usability research. Mind, 2(3), 4.

Google Scholar

[6]

Morris, M. R., Inkpen, K., & Venolia, G. (2014). Remote shopping advice: enhancing in-store shopping with social technologies. In Proc. of CSCW, 662--673.

Digital Library

Google Scholar

[7]

Sarcar, S., Panwar, P., & Chakraborty, T. (2013). EyeK: an efficient dwell-free eye gaze-based text entry system. In Proc. of the AP CHI, 215--220.

Digital Library

Google Scholar

[8]

Selker, T. (2004). Visual attentive interfaces. BT Technology Journal, 22(4), 146--150.

Digital Library

Google Scholar

[9]

Tamura, H., Sugasaka, T., & Ueda, K. (2008). Enhancing grocery shopping experience. In Proc. of ICEMU, 114--116

Digital Library

Google Scholar

[10]

Vertegaal, R. (2003). Attentive user interfaces. Communications of the ACM, 46(3), 30--33.

Digital Library

Google Scholar

[11]

Vickers, S., Istance, H., & Smalley, M. (2010). EyeGuitar: making rhythm based music video games accessible using only eye movements. In Proc. of ICACET, 36--39.

Digital Library

Google Scholar

[12]

Zhang, Y., Bulling, A., & Gellersen, H. (2013). Sideways: A gaze interface for spontaneous interaction with situated displays. In Proc. of CHI'13, 851--860.

Digital Library

Google Scholar

[13]

How Mobile Is Transforming the Shopping Experience in Stores. https://www.thinkwithgoogle.com/researchstudies/mobile-in-store.html

Google Scholar

[14]

Tobii. http://www.tobii.com

Google Scholar

Cited By

View all

Xu SWu LLiao WFujimura S(2024)Enhancing Collaborative Shopping Experience Through Interactive Personalized Avatars and Shared Gaze in a Multi-User Augmented Reality EnvironmentInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2381923(1-22)Online publication date: 29-Jul-2024
https://doi.org/10.1080/10447318.2024.2381923
Asish SKulshreshth ABorst C(2023)Internal Distraction Detection Utilizing EEG Data in an Educational VR EnvironmentACM Symposium on Applied Perception 202310.1145/3605495.3605790(1-10)Online publication date: 5-Aug-2023
https://dl.acm.org/doi/10.1145/3605495.3605790
Tokunaga TMotomatsu HSugihara KOzaki HYasuda MNakamura YArakawa Y(2023)System to Induce Accepting Unconsidered Information by Connecting Current InterestsPersuasive Technology10.1007/978-3-031-30933-5_8(105-119)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1007/978-3-031-30933-5_8
Show More Cited By

Index Terms

Shop-i: Gaze based Interaction in the Physical World for In-Store Social Shopping Experience
1. Human-centered computing

Recommendations

Gaze and voice controlled drawing
NGCA '11: Proceedings of the 1st Conference on Novel Gaze-Controlled Applications

Eye tracking is a process that allows an observers gaze to be determined in real time by measuring their eye movements. Recent work has examined the possibility of using gaze control as an alternative input modality in interactive applications. ...
Single stroke gaze gestures
CHI EA '09: CHI '09 Extended Abstracts on Human Factors in Computing Systems

This paper introduces and explains the concept of single stroke gaze gestures. Some preliminary results are presented which indicate the potential efficiency of this interaction method and we show how the method could be implemented for the benefit of ...
Scopophobic kitties in wonderland: stories behind the scene of a gaze contingent environment
CHI EA '14: CHI '14 Extended Abstracts on Human Factors in Computing Systems

This installation showcases an office desk, an imaginary wonderland, where a group of diligent kitties live happily and work industriously to make artifacts react to users' eye gaze. Kitties are shy about being seen, but determined to keep everything in ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

CHI EA '15: Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems

April 2015

2546 pages

ISBN:9781450331463

DOI:10.1145/2702613

General Chairs:
Bo Begole
Huawei, USA
,
Jinwoo Kim
Yonsei University, Korea
,
Program Chairs:
Kori Inkpen
Microsoft Research, USA
,
Woontack Woo
KAIST, Korea

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 April 2015

Check for updates

Author Tags

Qualifiers

Work in progress

Funding Sources

Conference

CHI '15

Sponsor:

SIGCHI

CHI '15: CHI Conference on Human Factors in Computing Systems

April 18 - 23, 2015

Seoul, Republic of Korea

Acceptance Rates

CHI EA '15 Paper Acceptance Rate 379 of 1,520 submissions, 25%;

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI '25

Sponsor:
sigchi

CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

15
Total Citations
View Citations
411
Total Downloads

Downloads (Last 12 months)20
Downloads (Last 6 weeks)3

Reflects downloads up to 21 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Xu SWu LLiao WFujimura S(2024)Enhancing Collaborative Shopping Experience Through Interactive Personalized Avatars and Shared Gaze in a Multi-User Augmented Reality EnvironmentInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2381923(1-22)Online publication date: 29-Jul-2024
https://doi.org/10.1080/10447318.2024.2381923
Asish SKulshreshth ABorst C(2023)Internal Distraction Detection Utilizing EEG Data in an Educational VR EnvironmentACM Symposium on Applied Perception 202310.1145/3605495.3605790(1-10)Online publication date: 5-Aug-2023
https://dl.acm.org/doi/10.1145/3605495.3605790
Tokunaga TMotomatsu HSugihara KOzaki HYasuda MNakamura YArakawa Y(2023)System to Induce Accepting Unconsidered Information by Connecting Current InterestsPersuasive Technology10.1007/978-3-031-30933-5_8(105-119)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1007/978-3-031-30933-5_8
Asish SKulshreshth ABorst C(2022)User Identification Utilizing Minimal Eye-Gaze Features in Virtual Reality ApplicationsVirtual Worlds10.3390/virtualworlds10100041:1(42-61)Online publication date: 6-Sep-2022
https://doi.org/10.3390/virtualworlds1010004
Porta MCaminiti ADondi P(2022)GazeScale: Towards General Gaze-Based Interaction in Public PlacesProceedings of the 2022 International Conference on Multimodal Interaction10.1145/3536221.3556588(591-596)Online publication date: 7-Nov-2022
https://dl.acm.org/doi/10.1145/3536221.3556588
Asish SKulshreshth ABorst C(2022)Detecting distracted students in educational VR environments using machine learning on eye gaze dataComputers & Graphics10.1016/j.cag.2022.10.007109(75-87)Online publication date: Dec-2022
https://doi.org/10.1016/j.cag.2022.10.007
Pfeuffer KAbdrabou YEsteves ARivu RAbdelrahman YMeitner SSaadi AAlt F(2021)ARtention: A design space for gaze-adaptive user interfaces in augmented realityComputers & Graphics10.1016/j.cag.2021.01.00195(1-12)Online publication date: Apr-2021
https://doi.org/10.1016/j.cag.2021.01.001
Piening RPfeuffer KEsteves AMittermeier TPrange SSchröder PAlt F(2021)Looking for Info: Evaluation of Gaze Based Information Retrieval in Augmented RealityHuman-Computer Interaction – INTERACT 202110.1007/978-3-030-85623-6_32(544-565)Online publication date: 30-Aug-2021
https://dl.acm.org/doi/10.1007/978-3-030-85623-6_32
Ludwig THoffmann SJasche FRuhrmann MPreim BNürnberger AHansen C(2020)VacuumCleanARProceedings of Mensch und Computer 202010.1145/3404983.3405526(291-302)Online publication date: 6-Sep-2020
https://dl.acm.org/doi/10.1145/3404983.3405526
Rivu RAbdrabou YPfeuffer KEsteves AMeitner SAlt F(2020)StARe: Gaze-Assisted Face-to-Face Communication in Augmented RealityACM Symposium on Eye Tracking Research and Applications10.1145/3379157.3388930(1-5)Online publication date: 2-Jun-2020
https://dl.acm.org/doi/10.1145/3379157.3388930
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Gaze and voice controlled drawing

Single stroke gaze gestures

Scopophobic kitties in wonderland: stories behind the scene of a gaze contingent environment