research-article

Open access

Conversational Composites: A Method for Illustration Layering

Authors:

Mafalda Gamboa,

Sara Ljungblad,

Miriam SturdeeAuthors Info & Claims

TEI '23: Proceedings of the Seventeenth International Conference on Tangible, Embedded, and Embodied Interaction

Article No.: 22, Pages 1 - 13

https://doi.org/10.1145/3569009.3572793

Published: 26 February 2023 Publication History

Abstract

The conversational nature of sketches is a widespread topic of research. Understanding drawing as a cognitive activity is commonly accepted, and many of the most extensively used methods within Human-Computer Interaction recruit sketching as a technique for ideation, explanation, documentation, and conversation. To further develop the use of this illustration process as a tool of knowledge production, we suggest a novel sketching method. We present Conversational Composites: a flexible method grounded in the material and tangible qualities of sketching in different forms and media, creating physical and digital layers of conversation between participants. We present and reflect on the proposed method through an applied case of a conversation between a PhD student and her supervisor, and offer suggestions on how it may be adapted and appropriated by other researchers in the HCI community.

References

[1]

Eli Blevis, Sabrina Hauser, and William Odom. 2015. Sharing the hidden treasure in pictorials. Interactions 22, 3 (apr 2015), 32–43. https://doi.org/10.1145/2755534

Digital Library

[2]

Bill Buxton. 2007. Sketching User Experiences: Getting the Design Right and the Right Design. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA.

Digital Library

[3]

Justin Cheng, Laewoo Kang, and Dan Cosley. 2013. Storeys: designing collaborative storytelling interfaces. In CHI ’13 Extended Abstracts on Human Factors in Computing Systems (CHI EA ’13). Association for Computing Machinery, New York, NY, USA, 3031–3034. https://doi.org/10.1145/2468356.2479603

Digital Library

[4]

Brock Craft and Paul Cairns. 2009. Sketching Sketching: Outlines of a Collaborative Design Method. In Proceedings of the 23rd British HCI Group Annual Conference on People and Computers: Celebrating People and Technology (Cambridge, United Kingdom) (BCS-HCI ’09). BCS Learning & Development Ltd., Swindon, GBR, 65–72.

[5]

Audrey Desjardins, Ron Wakkary, and Xiao Zhang. 2012. Exquisite Corpses That Explore Interactions. In CHI ’12 Extended Abstracts on Human Factors in Computing Systems (Austin, Texas, USA) (CHI EA ’12). Association for Computing Machinery, New York, NY, USA, 1517–1522. https://doi.org/10.1145/2212776.2223665

Digital Library

[6]

Susan Finley and J Gary Knowles. 1995. Researcher as artist/ artist as researcher. Qualitative inquiry 1, 1 (1995), 110–142.

[7]

Mafalda Gamboa. 2022. Conversations with Myself: Sketching Workshop Experiences in Design Epistemology. In Creativity and Cognition. ACM, New York, NY, USA, 71–82. https://doi.org/10.1145/3527927.3531450

Digital Library

[8]

William Gaver. 2011. Making spaces: how design workbooks work. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’11). Association for Computing Machinery, New York, NY, USA, 1551–1560. https://.doi.org/10.1145/1978942.1979169

Digital Library

[9]

William W. Gaver, Jacob Beaver, and Steve Benford. 2003. Ambiguity as a resource for design. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’03). Association for Computing Machinery, New York, NY, USA, 233–240. https://doi.org/10.1145/642611.642653

Digital Library

[10]

Gabriela Goldschmidt. 1991. The dialectics of sketching. Creativity Research Journal 4, 2 (jan 1991), 123–143. https://doi.org/10.1080/10400419109534381

[11]

Julie Heiser, Barbara Tversky, and Mia Silverman. 2004. Sketches for and from collaboration. Visual and spatial reasoning in design III 3 (2004), 69–78.

[12]

Alma R. Hoffmann. 2019. Sketching as Design Thinking. Routledge, London; New York: Routledge. https://doi.org/10.4324/9780429508042

[13]

Nantia Koulidou, Jayne Wallace, Miriam Sturdee, and Abigail Durrant. 2020. Drawing on experiences of self: Dialogical sketching. In DIS 2020 - Proceedings of the 2020 ACM Designing Interactive Systems Conference. ACM, New York, NY, USA, 255–267. https://doi.org/10.1145/3357236.3395513

Digital Library

[14]

Makayla Lewis, Miriam Sturdee, Jason Alexander, Jelle Van Dijk, Majken Kirkegård Rasmussen, and Thuong Hoang. 2017. SketchingDIS: Hand-drawn Sketching in HCI. In Proceedings of the 2017 ACM Conference Companion Publication on Designing Interactive Systems (DIS ’17 Companion). Association for Computing Machinery, New York, NY, USA, 356–359. https://doi.org/10.1145/3064857.3064863

Digital Library

[15]

Giorgia Lupi and Stefanie Posavec. 2016. Dear data. Chronicle books.

[16]

William Odom, Siân Lindley, Larissa Pschetz, Vasiliki Tsaknaki, Sara Vallgårda, Mikael Wiberg, and Daisy Yoo. 2018. Time, Temporality, and Slowness. In Proceedings of the 2018 ACM Conference Companion Publication on Designing Interactive Systems. ACM, New York, NY, USA, 383–386. https://doi.org/10.1145/3197391.3197392

Digital Library

[17]

Warunika Ranaweera, Parmit Chilana, Daniel Cohen-Or, and Hao Zhang. 2017. ExquiMo: an exquisite corpse tool for collaborative 3D shape design. Journal of Computer Science and Technology 32, 6 (2017), 1138–1149. https://doi.org/10.1007/s11390-017-1789-9

[18]

Erik Stolterman. 2008. The nature of design practice and implications for interaction design research. International Journal of Design 2, 1 (2008), 55–65.

[19]

Miriam Sturdee, Makayla Lewis, Angelika Strohmayer, Katta Spiel, Nantia Koulidou, Sarah Fdili Alaoui, and Josh Urban Davis. 2021. A Plurality of Practices: Artistic Narratives in HCI Research. In Creativity and Cognition. ACM, New York, NY, USA, 1–1. https://doi.org/10.1145/3450741.3466771

Digital Library

[20]

Miriam Sturdee and Joseph Lindley. 2019. Sketching & Drawing as Future Inquiry in HCI. In Proceedings of the Halfway to the Future Symposium 2019 (HTTF 2019). Association for Computing Machinery, New York, NY, USA, Article 18, 1–10. https://doi.org/10.1145/3363384.3363402

Digital Library

[21]

Paulina Yurman. 2021. Fluid Speculations: Drawing Artefacts in Watercolour as Experimentation in Research Through Design. In Creativity and Cognition. ACM, New York, NY, USA, 1–1. https://doi.org/10.1145/3450741.3466777

Digital Library

[22]

Paulina Yurman, Marie Louise Juul Søndergaard, James Pierce, Nadia CampoWoytuk, Anuradha Venugopal Reddy, and Matt Malpass. 2022. Venetian Drawing Conversations. In Creativity and Cognition. ACM, New York, NY, USA, 457–461. https://doi.org/10.1145/3527927.3531207

Digital Library

Cited By

Uyanto SBalasubramaniam AReidsma DPostma DHeylen D(2024)Promoting Transformative Reflection to Support Running Experience Through a Dashboard DesignProceedings of the 12th International Conference on Human-Agent Interaction10.1145/3687272.3690874(338-340)Online publication date: 24-Nov-2024
https://dl.acm.org/doi/10.1145/3687272.3690874
Vasconcelos EAndersen KWakkary R(2024)The table: considering sketching as collective makingProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685490(1-15)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685490
Vasconcelos EAndersen KWakkary R(2024)Who is holding the pen? Annotating collaborative processesProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685401(1-12)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685401
Show More Cited By

Index Terms

Conversational Composites: A Method for Illustration Layering
1. Human-centered computing
  1. Human computer interaction (HCI)

Index terms have been assigned to the content through auto-classification.

Recommendations

Conversational Agents: Acting on the Wave of Research and Development
CHI EA '19: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems

In the last five years, work on software that interacts with people via typed or spoken natural language, called chatbots, intelligent assistants, social bots, virtual companions, non-human players, and so on, increased dramatically. Chatbots burst into ...
Conversational Information Seeking: Theory and Application
SIGIR '22: Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval

Conversational information seeking (CIS) involves interaction sequences between one or more users and an information system. Interactions in CIS are primarily based on natural language dialogue, while they may include other types of interactions, such ...
Embodied conversational agents: computing and rendering realistic gaze patterns
PCM'06: Proceedings of the 7th Pacific Rim conference on Advances in Multimedia Information Processing

We describe here our efforts for modeling multimodal signals exchanged by interlocutors when interacting face-to-face. This data is then used to control embodied conversational agents able to engage into a realistic face-to-face interaction with human ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

TEI '23: Proceedings of the Seventeenth International Conference on Tangible, Embedded, and Embodied Interaction

February 2023

709 pages

ISBN:9781450399777

DOI:10.1145/3569009

Copyright © 2023 Owner/Author.

This work is licensed under a Creative Commons Attribution International 4.0 License.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 February 2023

Check for updates

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

Marcus och Amalia Wallenbergs minnesfond

Conference

TEI '23

Sponsor:

SIGCHI

TEI '23: Seventeenth International Conference on Tangible, Embedded, and Embodied Interaction

February 26 - March 1, 2023

Warsaw, Poland

Acceptance Rates

Overall Acceptance Rate 393 of 1,367 submissions, 29%

Upcoming Conference

TEI '25

Sponsor:
sigchi

Nineteenth International Conference on Tangible, Embedded, and Embodied Interaction

March 4 - 7, 2025

Bordeaux / Talence , France

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
661
Total Downloads

Downloads (Last 12 months)279
Downloads (Last 6 weeks)27

Reflects downloads up to 20 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Uyanto SBalasubramaniam AReidsma DPostma DHeylen D(2024)Promoting Transformative Reflection to Support Running Experience Through a Dashboard DesignProceedings of the 12th International Conference on Human-Agent Interaction10.1145/3687272.3690874(338-340)Online publication date: 24-Nov-2024
https://dl.acm.org/doi/10.1145/3687272.3690874
Vasconcelos EAndersen KWakkary R(2024)The table: considering sketching as collective makingProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685490(1-15)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685490
Vasconcelos EAndersen KWakkary R(2024)Who is holding the pen? Annotating collaborative processesProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685401(1-12)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685401
Bønlykke SMadsen KJenkins T(2024)Taking the bizarre seriously: dreams as a material for interaction designProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661562(699-713)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661562
Kaneko MLustig CRosner DDesjardins A(2024)Care Layering: Complicating Design PatternsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660740(1533-1546)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3660740
Gamboa MLjungblad SJohal WMubin OObaid M(2023)Championing Design Knowledge in Human-Drone Interaction ResearchProceedings of the 11th International Conference on Human-Agent Interaction10.1145/3623809.3623927(365-368)Online publication date: 4-Dec-2023
https://dl.acm.org/doi/10.1145/3623809.3623927
Benabdallah GKaneko MDesjardins A(2023)A Notebook of Data ImaginariesProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3596025(431-445)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1145/3563657.3596025

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents