poster

Designing Product Descriptions for Supporting Independent Grocery Shopping of People with Visual Impairments

Authors:

Uran OhAuthors Info & Claims

CHI EA '21: Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems

Article No.: 425, Pages 1 - 6

https://doi.org/10.1145/3411763.3451806

Published: 08 May 2021 Publication History

Abstract

It is difficult for people with visual impairments to have balanced nutrition, and one of the reasons is because it is challenging for them to shop for grocery items. In this study, we focused on designing descriptions on grocery items to people with visual impairments to help them with making purchase decisions independently. To identify types of information to be provided, we first conducted an online survey with 73 participants with visual impairments. Then we conducted an in-depth phone interview with eight participants to understand how to better design descriptions for different grocery items. Based on the findings, we provide implications for a camera-based wearable grocery shopping assistance system, which is currently in the prototype stage. This system will help taking the next step in providing effective assistance for people with visual impairments when shopping for groceries.

Supplemental Material

MP4 File

Supplemental video

Transcript for: Supplemental video

References

[1]

Jeffrey P Bigham, Chandrika Jayant, Andrew Miller, Brandyn White, and Tom Yeh. 2010. VizWiz:: LocateIt-enabling blind people to locate objects in their environment. In 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition-Workshops. IEEE, 65–72.

[2]

Marie Claire Bilyk, Jessica M Sontrop, Gwen E Chapman, Susan I Barr, and Linda Mamer. 2009. Food experiences and eating patterns of visually impaired and blind people. Canadian Journal of Dietetic practice and research 70, 1 (2009), 13–18.

[3]

Roger Boldu, Alexandru Dancu, Denys JC Matthies, Thisum Buddhika, Shamane Siriwardhana, and Suranga Nanayakkara. 2018. FingerReader2. 0: Designing and Evaluating a Wearable Finger-Worn Camera to Assist People with Visual Impairments while Shopping. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 3 (2018), 1–19.

Digital Library

[4]

Erin Brady, Meredith Ringel Morris, Yu Zhong, Samuel White, and Jeffrey P Bigham. 2013. Visual challenges in the everyday lives of blind people. In Proceedings of the SIGCHI conference on human factors in computing systems. 2117–2126.

Digital Library

[5]

Stefany Cárdenas-Pérez, Jorge Chanona-Pérez, Juan V Méndez-Méndez, Georgina Calderón-Domínguez, Rubén López-Santiago, María J Perea-Flores, and Israel Arzate-Vázquez. 2017. Evaluation of the ripening stages of apple (Golden Delicious) by means of computer vision system. biosystems engineering 159 (2017), 46–58.

[6]

Vladimir Kulyukin, John Nicholson, and Daniel Coster. 2008. Shoptalk: Toward independent shopping by people with visual impairments. In Proceedings of the 10th international ACM SIGACCESS conference on Computers and accessibility. 241–242.

Digital Library

[7]

Vladimir Kulyukin, Tanwir Zaman, Abhishek Andhavarapu, and Aliasgar Kutiyanawala. 2012. Eyesight sharing in blind grocery shopping: remote P2P caregiving through cloud computing. In International Conference on Computers for Handicapped Persons. Springer, 75–82.

Digital Library

[8]

Patrick E Lanigan, Aaron M Paulos, Andrew W Williams, Dan Rossi, and Priya Narasimhan. 2006. Trinetra: Assistive Technologies for Grocery Shopping for the Blind. In ISWC. 147–148.

[9]

Richard M Leach, Ailsa Brotherton, Michael Stroud, and Richard Thompson. 2013. Nutrition and fluid balance must be taken seriously. Bmj 346(2013), f801.

[10]

Jihyun Lee, Jinsol Kim, and Hyunggu Jung. 2020. Challenges and Design Opportunities for Easy, Economical, and Accessible Offline Shoppers with Visual Impairments. In Proceedings of the 2020 Symposium on Emerging Research from Asia and on Asian Contexts and Cultures. 69–72.

Digital Library

[11]

Diego López-de Ipiña, Tania Lorido, and Unai López. 2011. Blindshopping: enabling accessible shopping for visually impaired people through mobile technologies. In International Conference on Smart Homes and Health Telematics. Springer, 266–270.

[12]

Diego López-de Ipiña, Tania Lorido, and Unai López. 2011. Indoor navigation and product recognition for blind people assisted shopping. In International Workshop on Ambient Assisted Living. Springer, 33–40.

[13]

Luiz Fernando Santos Pereira, Sylvio Barbon Jr, Nektarios A Valous, and Douglas Fernandes Barbin. 2018. Predicting the ripening of papaya fruit with digital imaging and random forests. Computers and Electronics in Agriculture 145 (2018), 76–82.

Digital Library

[14]

Daisuke Sato, Uran Oh, Kakuya Naito, Hironobu Takagi, Kris Kitani, and Chieko Asakawa. 2017. Navcog3: An evaluation of a smartphone-based blind indoor navigation assistant with semantic features in a large-scale environment. In Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility. 270–279.

Digital Library

[15]

Sarit Szpiro, Yuhang Zhao, and Shiri Azenkot. 2016. Finding a store, searching for a product: a study of daily challenges of low vision people. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing. 61–72.

Digital Library

[16]

Z Vági, Kitti Deé, Zsuzsanna Lelovics, and É Lakatos. 2012. Nutritional status of blind and visually impaired patients. Zeitschrift für Gastroenterologie 50, 05 (2012), A82.

[17]

Yuhang Zhao, Sarit Szpiro, Jonathan Knighten, and Shiri Azenkot. 2016. CueSee: exploring visual cues for people with low vision to facilitate a visual search task. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing. 73–84.

Digital Library

Cited By

Jin SHyun K(2024)Enhancing the Interior Design Process with Crowdsourced Furnishing Pairing RecommendationsArchives of Design Research10.15187/adr.2024.05.37.2.7937:2(79-101)Online publication date: 31-May-2024
https://doi.org/10.15187/adr.2024.05.37.2.79
Jain GTeng YCho DXing YAziz MSmith B(2023)"I Want to Figure Things Out": Supporting Exploration in Navigation for People with Visual ImpairmentsProceedings of the ACM on Human-Computer Interaction10.1145/35794967:CSCW1(1-28)Online publication date: 16-Apr-2023
https://dl.acm.org/doi/10.1145/3579496

Recommendations

Improving mealtime experiences of people with visual impairments
W4A '21: Proceedings of the 18th International Web for All Conference

A number of studies have been conducted to understand the accessibility issues that people with visual impairments experience. However, most of these are limited to navigation and object recognition tasks. In this study, we focused on providing mealtime ...
Understanding Curators' Practices and Challenge of Making Exhibitions More Accessible for People with Visual Impairments
ASSETS '23: Proceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility

Assistive technologies are increasingly developed and applied in exhibition environments to help blind and low vision (BLV) people deal with the challenges they face when visiting exhibitions. While studies have examined the experiences of BLV people ...
On the independent and sustainable mobility of people with visual impairments
W4A '23: Proceedings of the 20th International Web for All Conference

People with blindness or visual impairments (BVI) use public transport to be independent in daily travel. The lack of this autonomy in travel can have an impact on sustainable mobility. This study investigates the independent mobility of people with ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI EA '21: Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems

May 2021

2965 pages

ISBN:9781450380959

DOI:10.1145/3411763

Editors:
Yoshifumi Kitamura
Tohoku University, Japan
,
Aaron Quigley
University of New South Wales, Australia
,
Katherine Isbister
University of California Santa Cruz, USA
,
Takeo Igarashi
The University of Tokyo, Japan

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 May 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Poster
Research
Refereed limited

Funding Sources

IITP

Conference

CHI '21

Sponsor:

SIGCHI

CHI '21: CHI Conference on Human Factors in Computing Systems

May 8 - 13, 2021

Yokohama, Japan

Acceptance Rates

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
289
Total Downloads

Downloads (Last 12 months)57
Downloads (Last 6 weeks)1

Reflects downloads up to 02 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Jin SHyun K(2024)Enhancing the Interior Design Process with Crowdsourced Furnishing Pairing RecommendationsArchives of Design Research10.15187/adr.2024.05.37.2.7937:2(79-101)Online publication date: 31-May-2024
https://doi.org/10.15187/adr.2024.05.37.2.79
Jain GTeng YCho DXing YAziz MSmith B(2023)"I Want to Figure Things Out": Supporting Exploration in Navigation for People with Visual ImpairmentsProceedings of the ACM on Human-Computer Interaction10.1145/35794967:CSCW1(1-28)Online publication date: 16-Apr-2023
https://dl.acm.org/doi/10.1145/3579496

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents