research-article

Crafting Interactive Decoration

Authors:

Boriana Koleva,

Emily-Clare Thorn,

William Preston,

Adrian Hazzard,

Stefan Rennick-Egglestone,

Chris Greenhalgh,

Richard MortierAuthors Info & Claims

ACM Transactions on Computer-Human Interaction (TOCHI), Volume 24, Issue 4

Article No.: 26, Pages 1 - 39

https://doi.org/10.1145/3058552

Published: 11 August 2017 Publication History

Abstract

We explore the crafting of interactive decoration for everyday artefacts. This involves adorning them with decorative patterns that enhance their beauty while triggering digital interactions when scanned with cameras. These are realized using an existing augmented reality technique that embeds computer readable codes into the topological structures of hand-drawn patterns. We describe a research through design process that engaged artisans to craft a portfolio of interactive artefacts, including ceramic bowls, embroidered gift cards, fabric souvenirs, and an acoustic guitar. We annotate this portfolio with reflections on the crafting process, revealing how artisans addressed pattern, materials, form and function, and digital mappings throughout their craft process. Further reflection on our portfolio reveals how they bridged between human and system perceptions of visual patterns and engaged in a deep embedding of digital interactions into physical materials. Our findings demonstrate the potential for interactive decoration, distilling the craft knowledge involved in creating aesthetic and functional decoration, highlight the need for transparent computer vision technologies, and raise wider issues for HCI’s growing engagement with craft.

References

[1]

Barcode Revolution. 2013. Barcode Revolution Website. Retrieved January 1, 2013 from http://www.barcoderevolution.com

[2]

Louise Barkhuus, Matthew Chalmers, Paul Tennent, Malcolm Hall, Marek Bell, Scott Sherwood, and Barry Brown. 2005. Picking Pockets on the Lawn: The Development of Tactics and Strategies in a Mobile Game. Springer, Berlin, 358--374.

Digital Library

[3]

Victoria Bellotti, Maribeth Back, W. Keith Edwards, Rebecca E. Grinter, Austin Henderson, and Cristina Lopes. 2002. Making sense of sensing systems: Five questions for designers and researchers. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’02). ACM, New York, NY, 415--422.

Digital Library

[4]

Ross Bencina, Martin Kaltenbrunner, and Sergi Jorda. 2005. Improved topological fiducial tracking in the reacTIVision system. In Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05) - Workshops Volume 03 (CVPR’05). IEEE Computer Society, Washington, DC, 99.

Digital Library

[5]

Steve Benford, Adrian Hazzard, Alan Chamberlain, Kevin Glover, Chris Greenhalgh, Liming Xu, Michaela Hoare, and Dimitrios Darzentas. 2016. Accountable artefacts: The case of the carolan guitar. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI’16). ACM, New York, NY, 1163--1175.

Digital Library

[6]

Steve Benford, Adrian Hazzard, Alan Chamberlain, and Liming Xu. 2015. Augmenting a guitar with its digital footprint. In Proceedings of the International Conference on New Interfaces for Musical Expression (NIME 2015). The School of Music and the Center for Computation and Technology (CCT), Louisiana State University, Baton Rouge, Louisiana, 303--306. http://dl.acm.org/citation.cfm?id=2993778.2993853

Digital Library

[7]

Steve Benford, Holger Schnädelbach, Boriana Koleva, Rob Anastasi, Chris Greenhalgh, Tom Rodden, Jonathan Green, Ahmed Ghali, Tony Pridmore, Bill Gaver, Andy Boucher, Brendan Walker, Sarah Pennington, Albrecht Schmidt, Hans Gellersen, and Anthony Steed. 2005. Expected, sensed, and desired: A framework for designing sensing-based interaction. ACM Trans. Comput.-Hum. Interact. 12, 1 (March 2005), 3--30.

Digital Library

[8]

Blippar. 2013. Blippar Website. (January 2013). Retrieved January 1, 2013 from http://blippar.com/

[9]

Margaret A. Boden. 1990. The Creative Mind: Myths and Mechanisms. George Weidenfeld and Nicolson Ltd.

[10]

Blaine Erickson Brownell. 2006. Transmaterial: A Catalog of Materials That Redefine Our Physical Environment. Number bk. 1. Princeton Architectural Press.

[11]

Matthew Chalmers and Areti Galani. 2004. Seamful interweaving: Heterogeneity in the theory and design of interactive systems. In Proceedings of the 5th Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques (DIS’04). ACM, New York, NY, 243--252.

Digital Library

[12]

Amy Cheatle and Steven J. Jackson. 2015. Digital entanglements: Craft, computation and collaboration in fine art furniture production. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing (CSCW’15). ACM, New York, NY, 958--968.

Digital Library

[13]

Enrico Costanza and Jeffrey Huang. 2009. Designable visual markers. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’09). ACM, New York, NY, 1879--1888.

Digital Library

[14]

Enrico Costanza and John Robinson. 2003. A region adjacency tree approach to the detection and design of fiducials. In Proceedings ofVideo Vision and Graphics Conference. 63--69.

[15]

D-Barcode. 2013. D-Barcode Website. Retrieved January 1, 2013 from http://www.d-barcode.com/

[16]

Peter Dormer. 1997. The Culture of Craft. Manchester University Press.

[17]

Mark Fiala. 2004. Artag Revision 1, A Fiducial Marker System Using Uigital Uechniques. National Research Council Publication 47419, 1--47.

[18]

George W. Fitzmaurice, Hiroshi Ishii, and William A. S. Buxton. 1995. Bricks: Laying the foundations for graspable user interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’95). ACM/Addison-Wesley Publishing Co., New York, NY, 442--449.

Digital Library

[19]

Christopher Frayling. 1993. Research in art and design. Royal College of Art Research Papers 1, 1 (1993), 1--5.

[20]

William Gaver. 2012. What should we expect from research through design? In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’12). ACM, New York, NY, 937--946.

Digital Library

[21]

William W. Gaver, Jacob Beaver, and Steve Benford. 2003. Ambiguity as a resource for design. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’03). ACM, New York, NY, 233--240.

Digital Library

[22]

Google. 2013. Goggles Website. (January 2013). Retrieved January 1, 2013 from http://www.google.co.uk/mobile/goggles/.

[23]

Chris Greenhalgh, Steve Benford, and Adrian Hazzard. 2016. muzicode&dollar;: Composing and performing musical codes. In Proceedings of Audio Mostly 2016. 1--8.

[24]

Shad Gross, Jeffrey Bardzell, and Shaowen Bardzell. 2014. Structures, forms, and stuff: The materiality and medium of interaction. Pers. Ubiquitous Comput.18, 3 (2014), 637--649.

Digital Library

[25]

Michael Gurevich, Adnan Marquez-Borbon, and Paul Stapleton. 2012. Playing with constraints: Stylistic variation with a simple electronic instrument. Comput. Music J. 36, 1 (March 2012), 23--41.

Digital Library

[26]

Tim Ingold. 2013. Making: Anthropology, Archaeology, Art and Architecture. Taylor & Francis.

[27]

Hiroshi Ishii and Brygg Ullmer. 1997. Tangible bits: Towards seamless interfaces between people, bits and atoms. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI’97). ACM, New York, NY, 234--241.

Digital Library

[28]

ISO. 2000. ISO/IEC 18004:2000 Information technology -- Automatic identification and data capture techniques -- Bar code symbology -- QR Code. Standard. International Organization for Standardization, Geneva, CH.

[29]

Heekyoung Jung and Erik Stolterman. 2011. Material probe: Exploring materiality of digital artifacts. In Proceedings of the 5TH International Conference on Tangible, Embedded, and Embodied Interaction (TEI’11). ACM, New York, NY, 153--156.

Digital Library

[30]

Qiong Liu, Chunyuan Liao, Lynn Wilcox, Anthony Dunnigan, and Bee Liew. 2010. Embedded media markers: Marks on paper that signify associated media. In Proceedings of the 15th International Conference on Intelligent User Interfaces (IUI’10). ACM, New York, NY, 149--158.

Digital Library

[31]

Thor Magnusson. 2010. Designing constraints: Composing and performing with digital musical systems. Comput. Music J.34, 4 (Dec. 2010), 62--73.

[32]

Malcolm McCullough. 1998. Abstracting Craft: The Practiced Digital Hand. MIT Press.

Digital Library

[33]

Rupert Meese, Shakir Ali, Emily-Clare Thorne, Steve D. Benford, Anthony Quinn, Richard Mortier, Boriana N. Koleva, Tony Pridmore, and Sharon L. Baurley. 2013. From codes to patterns: Designing interactive decoration for tableware. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’13). ACM, New York, NY, 931--940.

Digital Library

[34]

Cecily Morrison, Neil Smyth, Robert Corish, Kenton O’Hara, and Abigail Sellen. 2014. Collaborating with computer vision systems: An exploration of audio feedback. In Proceedings of the 2014 Conference on Designing Interactive Systems (DIS’14). ACM, New York, NY, 229--238.

Digital Library

[35]

Powered by String. 2013. Powered by String Website. (January 2013). Retrieved January 1, 2013 from http://poweredbystring.com.

[36]

Rick Poynor. 1995. The hand that rocks the cradle. ID Magazine May/June (1995), 60--65. Also known as C.G. Smith 1995 The marble answering machine.

[37]

Erica Robles and Mikael Wiberg. 2010. Texturing the “material turn” in interaction design. In Proceedings of the 4th International Conference on Tangible, Embedded, and Embodied Interaction (TEI’10). ACM, New York, NY, 137--144.

Digital Library

[38]

Daniela Rosner, Jean-François Blanchette, Leah Buechley, Paul Dourish, and Melissa Mazmanian. 2012. From materials to materiality: Connecting practice and theory in Hc. In Proceedings of the CHI’12 Extended Abstracts on Human Factors in Computing Systems (CHI EA’12). ACM, 2787--2790.

Digital Library

[39]

Daniela K. Rosner, Miwa Ikemiya, and Tim Regan. 2015. Resisting alignment: Code and clay. In Proceedings of the 9th International Conference on Tangible, Embedded, and Embodied Interaction (TEI’15). ACM, New York, NY, 181--188.

Digital Library

[40]

Daniela K. Rosner and Kimiko Ryokai. 2009. Reflections on craft: Probing the creative process of everyday knitters. In Proceedings of the 7th ACM Conference on Creativity and Cognition (C&C’’09). ACM, New York, NY, 195--204.

Digital Library

[41]

Daniela K. Rosner and Alex S. Taylor. 2011. Antiquarian answers: Book restoration as a resource for design. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’11). ACM, New York, NY, 2665--2668.

Digital Library

[42]

Vasiliki Tsaknaki, Ylva Fernaeus, and Mischa Schaub. 2014. Leather as a material for crafting interactive and physical artifacts. In Proceedings of the 2014 Conference on Designing Interactive Systems (DIS’14). ACM, New York, NY, 5--14.

Digital Library

[43]

Anna Vallgårda and Johan Redström. 2007. Computational composites. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’07). ACM, New York, NY, 513--522.

Digital Library

[44]

Norman J. Woodland and Silver Bernard. 1952. Classifying apparatus and method. (Oct. 1952). US Patent 2,612,994. Issued Oct. 7, 1952.

[45]

Richard D. Zakia. 2002. Perception and Imaging (2nd ed.). Focal Press.

[46]

John Zimmerman, Jodi Forlizzi, and Shelley Evenson. 2007. Research through design as a method for interaction design research in HCI. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’07). ACM, New York, NY, 493--502.

Digital Library

Cited By

Lakier MVogel D(2024)Digital Knick-Knacks: Standalone Audiovisual Digital Possessions or Embellishments in Digital EnvironmentsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642695(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642695
Thorn ESpence JKoleva BBenford S(2024)Insights Into Legacy: Issues of Handover from a Partner-Initiated ProjectProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642620(1-15)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642620
Schneiders EBenford SChamberlain AMancini CCastle-Green SNgo VRow Farr JAdams MTandavanitj NFischer J(2024)Designing Multispecies Worlds for Robots, Cats, and HumansProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642115(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642115
Show More Cited By

Index Terms

Crafting Interactive Decoration
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Mixed / augmented reality

Recommendations

Reflections on craft: probing the creative process of everyday knitters
C&C '09: Proceedings of the seventh ACM conference on Creativity and cognition

Crafters today blend age-old techniques such as weaving and pottery with new information and communication technologies such as podcasts, online instructions, and blogs. This intersection of tradition and modernity provides an interesting site for ...
Crafting technology: Reimagining the processes, materials, and cultures of electronics

This article examines the practice of electronics building in the context of other crafts. We compare the experience of making electronics with the experiences of carving, sewing, and painting. Our investigation is grounded in a survey of 40 practicing ...
Democratizing technology: pleasure, utility and expressiveness in DIY and maker practice
CHI '13: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

DIY, hacking, and craft have recently drawn attention in HCI and CSCW, largely as a collaborative and creative hobbyist practice. We shift the focus from the recreational elements of this practice to the ways in which it democratizes design and ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Computer-Human Interaction

ACM Transactions on Computer-Human Interaction Volume 24, Issue 4

August 2017

182 pages

ISSN:1073-0516

EISSN:1557-7325

DOI:10.1145/3132166

Editor:
Ken Hinckley
Microsoft Research

Issue’s Table of Contents

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 August 2017

Accepted: 01 February 2017

Revised: 01 January 2017

Received: 01 January 2016

Published in TOCHI Volume 24, Issue 4

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

Engineering and Physical Sciences Research Council

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

22
Total Citations
View Citations
859
Total Downloads

Downloads (Last 12 months)102
Downloads (Last 6 weeks)14

Reflects downloads up to 21 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Lakier MVogel D(2024)Digital Knick-Knacks: Standalone Audiovisual Digital Possessions or Embellishments in Digital EnvironmentsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642695(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642695
Thorn ESpence JKoleva BBenford S(2024)Insights Into Legacy: Issues of Handover from a Partner-Initiated ProjectProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642620(1-15)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642620
Schneiders EBenford SChamberlain AMancini CCastle-Green SNgo VRow Farr JAdams MTandavanitj NFischer J(2024)Designing Multispecies Worlds for Robots, Cats, and HumansProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642115(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642115
Xu LTowey DFrench ABenford S(2024)Uncovering the Metaverse within Everyday Environments: A Coarse-to-Fine ApproachBehaviors2024 IEEE 48th Annual Computers, Software, and Applications Conference (COMPSAC)10.1109/COMPSAC61105.2024.00074(499-509)Online publication date: 2-Jul-2024
https://doi.org/10.1109/COMPSAC61105.2024.00074
Mikkonen JMitchell R(2022)A Making Mode is Missing Code: Research Through Design Lacks Discourse Around Programming[ ] With Design: Reinventing Design Modes10.1007/978-981-19-4472-7_140(2131-2147)Online publication date: 6-Nov-2022
https://doi.org/10.1007/978-981-19-4472-7_140
Christophides VEfthymiou VPalpanas TPapadakis GStefanidis K(2020)An Overview of End-to-End Entity Resolution for Big DataACM Computing Surveys10.1145/341889653:6(1-42)Online publication date: 6-Dec-2020
https://dl.acm.org/doi/10.1145/3418896
Koleva BSpence JBenford SKwon HSchnädelbach HThorn EPreston WHazzard AGreenhalgh CAdams MFarr JTandavanitj NAngus ALane G(2020)Designing Hybrid GiftsACM Transactions on Computer-Human Interaction10.1145/339819327:5(1-33)Online publication date: 3-Aug-2020
https://dl.acm.org/doi/10.1145/3398193
Jiang HWang BWang XChristie MChen B(2020)Example-driven virtual cinematography by learning camera behaviorsACM Transactions on Graphics10.1145/3386569.339242739:4(45:1-45:14)Online publication date: 12-Aug-2020
https://dl.acm.org/doi/10.1145/3386569.3392427
Kotwal ALevin AGkioulekas I(2020)Interferometric transmission probing with coded mutual intensityACM Transactions on Graphics10.1145/3386569.339238439:4(74:1-74:16)Online publication date: 12-Aug-2020
https://dl.acm.org/doi/10.1145/3386569.3392384
Zheng CGyory PDo EWakkary RAndersen KOdom WDesjardins APetersen M(2020)Tangible Interfaces with Printed Paper MarkersProceedings of the 2020 ACM Designing Interactive Systems Conference10.1145/3357236.3395578(909-923)Online publication date: 3-Jul-2020
https://dl.acm.org/doi/10.1145/3357236.3395578
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents