research-article

Open access

Modalities of Expression: Capturing Embodied Knowledge in Cooking

Authors:

Sharon Baurley,

Martin FlinthamAuthors Info & Claims

TEI '20: Proceedings of the Fourteenth International Conference on Tangible, Embedded, and Embodied Interaction

Pages 785 - 797

https://doi.org/10.1145/3374920.3375005

Published: 09 February 2020 Publication History

Abstract

When cooking we negotiate between instructions in recipes and personal preferences to make in-the-moment creative decisions. This process represents moments of creativity that utilise and reveal our embodied knowledge. This paper focuses on the capture of expressions of embodied knowledge by digitally-networked utensils. We present a design process investigating the design of tangible interfaces to capture and communicate embodied knowledge as a proposition for recipe authoring tools for open innovation in food. We reflect upon this process to discuss lessons about the individual nature of embodied knowledge and its expression, and the context of capturing it to make design recommendations.

References

[1]

Maria Busse & Rosemarie Siebert. (2017). The role of consumers in food innovation processes. European Journal of Innovation Management. 10.1108/EJIM-03--2017-0023

[2]

Bill Buxton. 2007. Sketching User Experiences: Getting the Design Right and the Right Design. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA

Digital Library

[3]

Mary Cadogan. Chicken Noodle Soup. Online. Available at: https://www.bbcgoodfood.com/recipes/1869/chicken-noodle-soup. Last Accessed: 06/12/2019

[4]

Minsuk Chang, Léonore V. Guillain, Hyeungshik Jung, Vivian M. Hare, Juho Kim, Maneesh Agrawala. (2018). RecipeScape: An Interactive Tool for Analyzing Cooking Instructions at Scale. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. Paper No. 451

Digital Library

[5]

Crossing Over: The Art & Science of Multisensory Perception: https://www.rca.ac.uk/news-and-events/events/crossing-over-art-science-multisensory-perception/ Last Accessed: 06/12/2019

[6]

http://www.designkit.org/methods/46 Last Accessed: 06/12/2019

[7]

Jonathan Edelman, Larry Leifer, Barmy Banerjee, Neeraj Sonalkar, Malte Jung, & Micah Lande. (2009). Hidden in plain sight: affordances of shared models in team based design. In DS 58--2: Proceedings of ICED 09, the 17th International Conference on Engineering Design, Vol. 2, Design Theory and Research Methodology, Palo Alto, CA, USA, 24.-27.08. 2009

[8]

Shaun Gallagher. 2005. How the body shapes the mind (pp. 173--178). Oxford: Clarendon Press

[9]

Charles Goodwin. 1994. Professional vision. American anthropologist, 96(3), pp.606--633

[10]

Andrea Grimes & Richard Harper. (2008). Celebratory technology: new directions for food research in HCI, Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, April 05--10, 2008, Florence, Italy

Digital Library

[11]

Alexandra Juhasz & Anne Balsamo. Online. FemTechNet -- A Distributed Online Collaborative Course (DOCC). Available at: https://adanewmedia.org/2012/11/issue1-juhasz/. Last Accessed: 06/12/2019

[12]

Sarah Kemp. 2013. Consumers as part of food and beverage industry innovation, in Open Innovation in the Food and Beverage Industry. Ed Marian Garcia Martinez. Woodhead Publishing

[13]

David Kirsh. (2013). "Embodied cognition and the magical future of interaction design." ACM Transactions on Computer-Human Interaction (TOCHI) 20, no. 1 (2013): 3

Digital Library

[14]

David Kirsh (2009). Knowledge, Explicit vs Implicit. Oxford Companion to Consciousness:397--402

[15]

Moran Mizrahi, Amos Golan, Ariel Bezaleli Mizrahi, Rotem Gruber, Alexander Zoonder Lachnise, Amit Zoran. (2016). Digital Gastronomy: Methods & Recipes for Hybrid Cooking, Proceedings of the 29th Annual Symposium on User Interface Software and Technology, October 16--19, 2016, Tokyo, Japan

Digital Library

[16]

Joshua Palay & Newman. (2009). SuChef: An in-kitchen display to assist with "everyday" cooking. In CHI '09 Extended Abstracts on Human Factors in Computing Systems, April 04-09, 2009, Boston, MA, USA

Digital Library

[17]

Michael Polanyi. (1967). The Tacit Dimension. London: Routledge & Kegan Paul

[18]

Merleau-Ponty, M. 2012. Phenomenology of Perception. Trans. D. A. Landes. New York: Routledge

[19]

David Sutton. 2006. Cooking, Skill, the Senses, and Memory: The Fate of Practical Knowledge. In: Elizabeth Edwards, Chris Gosden, Ruth Phillips. Eds. Sensible Objects: Colonialism, Museums and Material Culture

Cited By

Buono RNygren MBianchi-Berthouze N(2025)Touch, communication and affect: a systematic review on the use of touch in healthcare professionsSystematic Reviews10.1186/s13643-025-02769-414:1Online publication date: 14-Feb-2025
https://doi.org/10.1186/s13643-025-02769-4
Wu SCorr XGao XDe Koninck SBowers RDevendorf LCiolfi LHogan TDöring TJenkins Tvan Dijk JHuron SLi ZCoyle DSigner B(2024)Loom Pedals: Retooling Jacquard Weaving for Improvisational Design WorkflowsProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3633358(1-16)Online publication date: 11-Feb-2024
https://dl.acm.org/doi/10.1145/3623509.3633358
Ye HWu TKim LFan MTong X(2023)WooGu: Exploring an Embodied Tangible User Interface for Supporting Children to Learn Farm-to-Table Food KnowledgeProceedings of the 22nd Annual ACM Interaction Design and Children Conference10.1145/3585088.3593876(681-687)Online publication date: 19-Jun-2023
https://dl.acm.org/doi/10.1145/3585088.3593876
Show More Cited By

Index Terms

Modalities of Expression: Capturing Embodied Knowledge in Cooking
1. Human-centered computing
  1. Human computer interaction (HCI)
  2. Interaction design
    1. Interaction design process and methods

Recommendations

Communicative modalities for mobile device interaction

An investigation of communicative modalities in relation to mobile device interaction while walking is presented. A user evaluation compared three communicative modality conditions: Auditory, Visual, and Mixed (a redundant audio-visual modality). ...
Salience modeling based on non-verbal modalities for spoken language understanding
ICMI '06: Proceedings of the 8th international conference on Multimodal interfaces

Previous studies have shown that, in multimodal conversational systems, fusing information from multiple modalities together can improve the overall input interpretation through mutual disambiguation. Inspired by these findings, this paper investigates ...
Incorporating non-verbal modalities in spoken language understanding for multimodal conversational systems

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

TEI '20: Proceedings of the Fourteenth International Conference on Tangible, Embedded, and Embodied Interaction

February 2020

978 pages

ISBN:9781450361071

DOI:10.1145/3374920

General Chairs:
Elise van den Hoven
University of Technology Sydney (Australia) & Eindhoven University of Technology (the Netherlands)
,
Lian Loke
University of Sydney (Australia)
,
Program Chairs:
Orit Shaer
Wellesley College (USA)
,
Jelle van Dijk
University of Twente (Netherlands)
,
Andrew Kun
University of New Hampshire (USA)

Copyright © 2020 Owner/Author.

This work is licensed under a Creative Commons Attribution International 4.0 License.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 February 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Engineering and Physical Sciences Research Council

Conference

TEI '20

Sponsor:

SIGCHI

TEI '20: Fourteenth International Conference on Tangible, Embedded, and Embodied Interaction

February 9 - 12, 2020

Sydney NSW, Australia

Acceptance Rates

TEI '20 Paper Acceptance Rate 37 of 132 submissions, 28%;

Overall Acceptance Rate 393 of 1,367 submissions, 29%

Upcoming Conference

TEI '25

Sponsor:
sigchi

Nineteenth International Conference on Tangible, Embedded, and Embodied Interaction

March 4 - 7, 2025

Bordeaux / Talence , France

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
909
Total Downloads

Downloads (Last 12 months)264
Downloads (Last 6 weeks)40

Reflects downloads up to 13 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Buono RNygren MBianchi-Berthouze N(2025)Touch, communication and affect: a systematic review on the use of touch in healthcare professionsSystematic Reviews10.1186/s13643-025-02769-414:1Online publication date: 14-Feb-2025
https://doi.org/10.1186/s13643-025-02769-4
Wu SCorr XGao XDe Koninck SBowers RDevendorf LCiolfi LHogan TDöring TJenkins Tvan Dijk JHuron SLi ZCoyle DSigner B(2024)Loom Pedals: Retooling Jacquard Weaving for Improvisational Design WorkflowsProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3633358(1-16)Online publication date: 11-Feb-2024
https://dl.acm.org/doi/10.1145/3623509.3633358
Ye HWu TKim LFan MTong X(2023)WooGu: Exploring an Embodied Tangible User Interface for Supporting Children to Learn Farm-to-Table Food KnowledgeProceedings of the 22nd Annual ACM Interaction Design and Children Conference10.1145/3585088.3593876(681-687)Online publication date: 19-Jun-2023
https://dl.acm.org/doi/10.1145/3585088.3593876
Khot RYi JAggarwal D(2023)Designing Stardust: Reimagining Self-care through Everyday Latte ArtProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3596049(1915-1929)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1145/3563657.3596049
Weber JEsau-Held MSchiller MThaden EManstetten DStevens G(2023)Designing an Interaction Concept for Assisted Cooking in Smart Kitchens: Focus on Human Agency, Proactivity, and MultimodalityProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3595975(1128-1144)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1145/3563657.3595975
Li YKothiyal AWeber TRossmy BMayer SHussmann H(2022)Designing Tangible as an Orchestration Tool for Collaborative ActivitiesMultimodal Technologies and Interaction10.3390/mti60500306:5(30)Online publication date: 19-Apr-2022
https://doi.org/10.3390/mti6050030
Kuznetsov SRodriguez Vega ALong E(2022)A Study of Solar Cooking: Exploring Climate-Resilient Food Preparation and Opportunities for HCIProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517557(1-8)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3517557
Chen ACo D(2022)Workshops in TEI: Development, Evaluation, Exploration, and ImplementationProceedings of the Sixteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3490149.3505562(1-9)Online publication date: 13-Feb-2022
https://dl.acm.org/doi/10.1145/3490149.3505562

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Figures

Tables

Media

View Table of Conten