Cited By
View all- Zulkarnain AMoskowitz HKókai ZGere A(2024)Enhancing Consumer Sensory Science Approach Through Augmented VirtualityCurrent Research in Food Science10.1016/j.crfs.2024.100834(100834)Online publication date: Aug-2024
ShoppingCoach: Using Diminished Reality to Prevent Unhealthy Food Choices in an Offline Supermarket Scenario
Article No.: 288, Pages 1 - 8
Abstract
Non-communicable diseases, such as obesity and diabetes, have a significant global impact on health outcomes. While governments worldwide focus on promoting healthy eating, individuals still struggle to follow dietary recommendations. Augmented Reality (AR) might be a useful tool to emphasize specific food products at the point of purchase. However, AR may also add visual clutter to an already complex supermarket environment. Instead, reducing the visual prevalence of unhealthy food products through Diminished Reality (DR) could be a viable alternative: We present ShoppingCoach, a DR prototype that identifies supermarket food products and visually diminishes them dependent on the deviation of the target product’s composition from dietary recommendations. In a study with 12 participants, we found that ShoppingCoach increased compliance with dietary recommendations from 75% to 100% and reduced decision time by 41%. These results demonstrate the promising potential of DR in promoting healthier food choices and thus enhancing public health.
Supplemental Material
- Download
- 8.56 MB
- Transcript
- Download
- 66.24 MB
- Transcript
References
[1]
Jaehyun Ahn, Haifa Gaza, Jincheol Oh, Klaus Fuchs, Jing Wu, Simon Mayer, and Jaewook Byun. 2022. MR-FoodCoach: Enabling a convenience store on mixed reality space for healthier purchases. In 2022 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). 891–892. https://doi.org/10.1109/ISMAR-Adjunct57072.2022.00191
[2]
Junho Ahn, James Williamson, Mike Gartrell, Richard Han, Qin Lv, and Shivakant Mishra. 2015. Supporting Healthy Grocery Shopping via Mobile Augmented Reality. ACM Transactions on Multimedia Computing, Communications, and Applications 12, 1s (Oct. 2015), 1–24. https://doi.org/10.1145/2808207
[3]
Aaron Bangor, Philip Kortum, and James Miller. 2009. Determining what individual SUS scores mean: Adding an adjective rating scale. Journal of Usability Studies 4, 3 (2009), 114–123.
[4]
Sophie Baumann, Ulla Toft, Mette Aadahl, Torben Jørgensen, and Charlotta Pisinger. 2015. The long-term effect of screening and lifestyle counseling on changes in physical activity and diet: the Inter99 Study–a randomized controlled trial. International Journal of Behavioral Nutrition and Physical Activity 12, 1 (2015), 1–10. https://doi.org/10.1186/s12966-015-0195-3
[5]
Kenan Bektaş, Arzu Çöltekin, Jens Krüger, Andrew T. Duchowski, and Sara Irina Fabrikant. 2019. GeoGCD: improved visual search via gaze-contingent display. In Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications (Denver, Colorado) (ETRA ’19). Association for Computing Machinery, New York, NY, USA, Article 84, 10 pages. https://doi.org/10.1145/3317959.3321488
[6]
Kenan Bektas, Arzu Cöltekin, Jens Krüger, and Andrew T. Duchowski. 2015. A Testbed Combining Visual Perception Models for Geographic Gaze Contingent Displays. Eurographics Conference on Visualization (EuroVis) - Short Papers (2015). https://doi.org/10.2312/EUROVISSHORT.20151127
[7]
Svetlana Bialkova, Klaus G. Grunert, and Hans van Trijp. 2013. Standing out in the Crowd: The Effect of Information Clutter on Consumer Attention for Front-of-Pack Nutrition Labels. Food Policy 41 (Aug. 2013), 65–74. https://doi.org/10.1016/j.foodpol.2013.04.010
[8]
Eric A. Bier, Maureen C. Stone, Ken Pier, William Buxton, and Tony D. DeRose. 1993. Toolglass and magic lenses: the see-through interface. In Proceedings of the 20th Annual Conference on Computer Graphics and Interactive Techniques (Anaheim, CA) (SIGGRAPH ’93). Association for Computing Machinery, New York, NY, USA, 73–80. https://doi.org/10.1145/166117.166126
[9]
John Brooke. 1996. SUS: A ’Quick and Dirty’ Usability Scale. In Usability Evaluation In Industry. CRC Press.
[10]
Romain Cadario and Pierre Chandon. 2020. Which Healthy Eating Nudges Work Best? A Meta-Analysis of Field Experiments. Marketing Science 39, 3 (2020), 465–486. https://doi.org/10.1287/mksc.2018.1128
[11]
Adrian J Cameron, Emma Charlton, Winsfred W Ngan, and Gary Sacks. 2016. A systematic review of the effectiveness of supermarket-based interventions involving product, promotion, or place on the healthiness of consumer purchases. Current Nutrition Reports 5 (2016), 129–138. https://doi.org/10.1038/s41591-022-02077-7
[12]
Jasmine Chan, Emma McMahon, and Julie Brimblecombe. 2021. Point-of-sale nutrition information interventions in food retail stores to promote healthier food purchase and intake: A systematic review. Obesity Reviews 22, 10 (2021), e13311. https://doi.org/10.1111/obr.13311
[13]
Samantha W. T. Chan, Bektur Ryskeldiev, and Suranga Nanayakkara. 2022. DeclutterAR: Mobile Diminished Reality and Augmented Reality to Address Hoarding by Motivating Decluttering and Selling on Online Marketplace. In 2022 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). 870–874. https://doi.org/10.1109/ISMAR-Adjunct57072.2022.00187
[14]
Julia Chantal, Serge Hercberg, World Health Organization, 2017. Development of a new front-of-pack nutrition label in France: the five-colour Nutri-Score. Public health panorama 3, 04 (2017), 712–725.
[15]
Yi Fei Cheng, Hang Yin, Yukang Yan, Jan Gugenheimer, and David Lindlbauer. 2022. Towards Understanding Diminished Reality. In CHI Conference on Human Factors in Computing Systems. ACM, New Orleans LA USA, 1–16. https://doi.org/10.1145/3491102.3517452
[16]
Daisy de Abreu, Idris Guessous, Julien Vaucher, Martin Preisig, Gérard Waeber, Peter Vollenweider, and Pedro Marques-Vidal. 2013. Low compliance with dietary recommendations for food intake among adults. Clinical nutrition 32, 5 (2013), 783–788. https://doi.org/10.1016/j.clnu.2012.11.022
[17]
Pierre Dubois, Paulo Albuquerque, Olivier Allais, Céline Bonnet, Patrice Bertail, Pierre Combris, Saadi Lahlou, Natalie Rigal, Bernard Ruffieux, and Pierre Chandon. 2021. Effects of front-of-pack labels on the nutritional quality of supermarket food purchases: evidence from a large-scale randomized controlled trial. Journal of the Academy of Marketing Science 49, 1 (2021), 119–138. https://doi.org/10.1007/s11747-019-00663-9
[18]
Klaus Fuchs, Mirella Haldimann, Tobias Grundmann, and Elgar Fleisch. 2020. Supporting Food Choices in the Internet of People: Automatic Detection of Diet-Related Activities and Display of Real-Time Interventions via Mixed Reality Headsets. Future Generation Computer Systems 113 (Dec. 2020), 343–362. https://doi.org/10.1016/j.future.2020.07.014
[19]
Klaus L Fuchs, Jie Lian, Leonard Michels, Simon Mayer, Enrico Toniato, and Verena Tiefenbeck. 2022. Effects of Digital Food Labels on Healthy Food Choices in Online Grocery Shopping. Nutrients 14, 10 (2022), 2044. https://doi.org/10.3390/nu14102044
[20]
Chiara Gelli, Mirko Tarocchi, Ludovico Abenavoli, Laura Di Renzo, Andrea Galli, and Antonino De Lorenzo. 2017. Effect of a counseling-supported treatment with the Mediterranean diet and physical activity on the severity of the non-alcoholic fatty liver disease. World journal of gastroenterology 23, 17 (2017), 3150. https://doi.org/10.3748/wjg.v23.i17.3150
[21]
Dan. J. Graham, Charles Heidrick, and Katie Hodgin. 2015. Nutrition Label Viewing during a Food-Selection Task: Front-of-Package Labels vs Nutrition Facts Labels. Journal of the Academy of Nutrition and Dietetics 115, 10 (Oct. 2015), 1636–1646. https://doi.org/10.1016/j.jand.2015.02.019
[22]
GS1. 2024. Global Trade Item Number (GTIN). Retrieved March 5, 2024 from https://www.gs1.org/standards/id-keys/gtin.
[23]
Francisco Gutiérrez, Nyi Nyi Htun, Sven Charleer, Robin De Croon, and Katrien Verbert. 2019. Designing Augmented Reality Applications for Personal Health Decision-Making. In Proceedings of the 52nd Hawaii International Conference on System Sciences.
[24]
Nicolas Henchoz, Emily Groves, Andreas Sonderegger, and Delphine Ribes. 2019. Food Talks: Visual and Interaction Principles for Representing Environmental and Nutritional Food Information in Augmented Reality. In 2019 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). IEEE, Beijing, China, 98–103. https://doi.org/10.1109/ISMAR-Adjunct.2019.00040
[25]
Serge Hercberg, Mathilde Touvier, and Jordi Salas-Salvado. 2022. The Nutri-Score Nutrition Label. International Journal for Vitamin and Nutrition Research 92, 3-4 (July 2022), 147–157. https://doi.org/10.1024/0300-9831/a000722
[26]
Anna Herforth, Mary Arimond, Cristina Álvarez-Sánchez, Jennifer Coates, Karin Christianson, and Ellen Muehlhoff. 2019. A global review of food-based dietary guidelines. Advances in Nutrition 10, 4 (2019), 590–605. https://doi.org/10.1093/advances/nmy130
[27]
Betsy B. Holli, Richard J. Calabrese, and Julie O’Sullivan Maillet. 2003. Communication and Education Skills for Dietetics Professionals (4th ed.). Lippincott Williams & Wilkins, Philadelphia.
[28]
M.-Carmen Juan, Jorge L. Charco, Inmaculada García-García, and Ramón Mollá. 2019. An Augmented Reality App to Learn to Interpret the Nutritional Information on Labels of Real Packaged Foods. Frontiers in Computer Science 1 (2019). https://doi.org/10.3389/fcomp.2019.00001
[29]
Barbara E. Kahn. 2017. Using Visual Design to Improve Customer Perceptions of Online Assortments. Journal of Retailing 93, 1 (March 2017), 29–42. https://doi.org/10.1016/j.jretai.2016.11.004
[30]
R. Kosara, S. Miksch, and H. Hauser. 2001. Semantic depth of field. In IEEE Symposium on Information Visualization, 2001. INFOVIS 2001.97–104. https://doi.org/10.1109/INFVIS.2001.963286
[31]
Dimitrios A Koutoukidis, Susan A Jebb, José M Ordóñez-Mena, Michaela Noreik, Melina Tsiountsioura, Sarah Kennedy, Sarah Payne-Riches, Paul Aveyard, and Carmen Piernas. 2019. Prominent positioning and food swaps are effective interventions to reduce the saturated fat content of the shopping basket in an experimental online supermarket: a randomized controlled trial. International Journal of Behavioral Nutrition and Physical Activity 16 (2019), 1–14. https://doi.org/10.1186/ISRCTN13729526
[32]
Selma C Liberato, Ross Bailie, and Julie Brimblecombe. 2014. Nutrition interventions at point-of-sale to encourage healthier food purchasing: a systematic review. BMC public health 14, 1 (2014), 1–14. https://doi.org/10.1186/1471-2458-14-919
[33]
Steve Mann and James Fung. 2002. EyeTap devices for augmented, deliberately diminished, or otherwise altered visual perception of rigid planar patches of real-world scenes. Presence 11, 2 (2002), 158–175. https://doi.org/10.1162/1054746021470603
[34]
Simon Mayer, Klaus Fuchs, Dominic Jan Brügger, Jie Lian, and Andrei Ciortea. 2021. Improving customer decisions in web-based e-commerce through guerrilla modding. Nature Machine Intelligence 3 (2021), 1008–1010. https://doi.org/10.1038/s42256-021-00424-w
[35]
Jared T. McGuirt, Natalie K. Cooke, Marissa Burgermaster, Basheerah Enahora, Grace Huebner, Yu Meng, Gina Tripicchio, Omari Dyson, Virginia C. Stage, and Siew Sun Wong. 2020. Extended Reality Technologies in Nutrition Education and Behavior: Comprehensive Scoping Review and Future Directions. Nutrients 12, 9 (2020). https://doi.org/10.3390/nu12092899
[36]
Microsoft. 2022. Device Portal API Reference - Mixed Reality. Retrieved March 5, 2024 from https://learn.microsoft.com/en-us/windows/mixed-reality/develop/advanced-concepts/device-portal-api-reference.
[37]
Microsoft. 2022. Spatial Awareness Getting Started - MRTK 2. Retrieved March 5, 2024 from https://learn.microsoft.com/en-us/windows/mixed-reality/mrtk-unity/mrtk2/features/spatial-awareness/spatial-awareness-getting-started.
[38]
Microsoft. 2022. Spatial Mapping in Unity - Mixed Reality. Retrieved March 5, 2024 from https://learn.microsoft.com/en-us/windows/mixed-reality/develop/unity/spatial-mapping-in-unity.
[39]
Microsoft. 2024. MixedRealityToolkit-Unity. https://github.com/microsoft/MixedRealityToolkit-Unity/.
[40]
Shohei Mori, Sei Ikeda, and Hideo Saito. 2017. A Survey of Diminished Reality: Techniques for Visually Concealing, Eliminating, and Seeing through Real Objects. IPSJ Transactions on Computer Vision and Applications 9, 1 (Dec. 2017), 17. https://doi.org/10.1186/s41074-017-0028-1
[41]
Christopher J L Murray, Aleksandr Y Aravkin, Peng Zheng, Cristiana Abbafati, Kaja M Abbas, Mohsen Abbasi-Kangevari, Foad Abd-Allah, Ahmed Abdelalim, Mohammad Abdollahi, Ibrahim Abdollahpour, 2020. Global Burden of 87 Risk Factors in 204 Countries and Territories, 1990–2019: A Systematic Analysis for the Global Burden of Disease Study 2019. The Lancet 396, 10258 (Oct. 2020), 1223–1249. https://doi.org/10.1016/S0140-6736(20)30752-2
[42]
U.S. Departments of Agriculture (USDA), of Health, and Human Services (HHS). 2020. Dietary Guidelines for Americans, 2020-2025. Retrieved January 23, 2024 from https://www.dietaryguidelines.gov/resources/2020-2025-dietary-guidelines-online-materials
[43]
World Health Organization. 2023. Noncommunicable diseases. Retrieved January 19, 2024 from https://www.who.int/news-room/fact-sheets/detail/noncommunicable-diseases.
[44]
Valentina Pini, Valeria Orso, Patrik Pluchino, and Luciano Gamberini. 2023. Augmented Grocery Shopping: Fostering Healthier Food Purchases through AR. Virtual Reality 27, 3 (Sept. 2023), 2117–2128. https://doi.org/10.1007/s10055-023-00792-1
[45]
Jie Qiao, Xiling Lin, Yiwen Wu, Xin Huang, Xiaowen Pan, Jingya Xu, JunYun Wu, Yuezhong Ren, and Peng-Fei Shan. 2022. Global burden of non-communicable diseases attributable to dietary risks in 1990–2019. Journal of Human Nutrition and Dietetics 35, 1 (2022), 202–213. https://doi.org/10.1111/jhn.12904
[46]
Sarah Payne Riches, Paul Aveyard, Carmen Piernas, Mike Rayner, and Susan A Jebb. 2019. Optimising swaps to reduce the salt content of food purchases in a virtual online supermarket: A randomised controlled trial. Appetite 133 (2019), 378–386. https://doi.org/10.1016/j.appet.2018.11.028
[47]
Elena Rodríguez-Rodríguez, Aránzazu Aparicio, Javier Aranceta-Bartrina, Ángel Gil, Marcela González-Gross, Lluis Serra-Majem, Gregorio Varela-Moreiras, and Rosa M Ortega. 2017. Low adherence to dietary guidelines in Spain, especially in the overweight/obese population: The ANIBES Study. Journal of the American College of Nutrition 36, 4 (2017), 240–247. https://doi.org/10.1080/07315724.2016.1248246
[48]
Ruth Rosenholtz, Yuanzhen Li, and Lisa Nakano. 2007. Measuring Visual Clutter. Journal of Vision 7, 2 (Aug. 2007), 17. https://doi.org/10.1167/7.2.17
[49]
Katja A Schönenberger, Luca Cossu, Francesco Prendin, Giacomo Cappon, Jing Wu, Klaus L Fuchs, Simon Mayer, David Herzig, Andrea Facchinetti, and Lia Bally. 2022. Digital solutions to diagnose and manage postbariatric hypoglycemia. Frontiers in Nutrition 9 (2022), 855223. https://doi.org/10.3389/fnut.2022.855223
[50]
Linda G Snetselaar, Janet M de Jesus, Dana M DeSilva, and Eve E Stoody. 2021. Dietary guidelines for Americans, 2020–2025: understanding the scientific process, guidelines, and key recommendations. Nutrition today 56, 6 (2021), 287. https://doi.org/10.1097/NT.0000000000000512
[51]
Norman J Temple. 2020. Front-of-package food labels: A narrative review. Appetite 144 (2020), 104485. https://doi.org/10.1016/j.appet.2019.104485
[52]
Chien-Yao Wang, Alexey Bochkovskiy, and Hong-Yuan Mark Liao. 2023. YOLOv7: Trainable Bag-of-Freebies Sets New State-of-the-Art for Real-Time Object Detectors. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 7464–7475. https://doi.org/10.1109/CVPR52729.2023.00721
[53]
Kaito Yokoro, Monica Perusquia-Hernandez, Naoya Isoyama, Hideaki Uchiyama, and Kiyoshi Kiyokawa. 2023. DecluttAR: An Interactive Visual Clutter Dimming System to Help Focus on Work. In Proceedings of the Augmented Humans International Conference 2023 (Glasgow, United Kingdom) (AHs ’23). Association for Computing Machinery, New York, NY, USA, 159–170. https://doi.org/10.1145/3582700.3582718
Index Terms
- ShoppingCoach: Using Diminished Reality to Prevent Unhealthy Food Choices in an Offline Supermarket Scenario
Recommendations
Virtual Food Court: A VR environment to Assess People's Food Choices
OzCHI '15: Proceedings of the Annual Meeting of the Australian Special Interest Group for Computer Human InteractionImmersive virtual reality environments can provide users with realistic experiences of worlds that do not exist or would be hard to reach. The ability to manipulate these environments and influence experiences can be used to understand decision making ...
Understanding the Comorbidity of Multiple Chronic Diseases Using a Network Approach
ACSW '19: Proceedings of the Australasian Computer Science Week MulticonferenceChronic diseases and associated conditions are the leading causes of death in most of the countries worldwide. Due to this, governments all over the world are concerned about the burden of chronic diseases. These diseases often pose severe health risks ...
A Study of Health Informatics Scenario in Pune
ICETET '12: Proceedings of the 2012 Fifth International Conference on Emerging Trends in Engineering and TechnologyThe researcher has following objectives in mind. a) To generate an awareness about the concept of health informatics. b) To highlight the career opportunities and academic courses available c) To demonstrate a typical Hospital Information System (HIS) ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
May 2024
4761 pages
ISBN:9798400703317
DOI:10.1145/3613905
Copyright © 2024 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 11 May 2024
Check for updates
Author Tags
Qualifiers
- Work in progress
- Research
- Refereed limited
Funding Sources
Conference
Acceptance Rates
Overall Acceptance Rate 6,164 of 23,696 submissions, 26%
Upcoming Conference
CHI 2025
- Sponsor:
- sigchi
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 423Total Downloads
- Downloads (Last 12 months)423
- Downloads (Last 6 weeks)69
Reflects downloads up to 14 Feb 2025
Other Metrics
Citations
Cited By
View all- Zulkarnain AMoskowitz HKókai ZGere A(2024)Enhancing Consumer Sensory Science Approach Through Augmented VirtualityCurrent Research in Food Science10.1016/j.crfs.2024.100834(100834)Online publication date: Aug-2024
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderFull Text
View this article in Full Text.
Full TextHTML Format
View this article in HTML Format.
HTML Format