research-article

Open access

Grand Challenges in Shape-Changing Interface Research

Authors:

Jason Alexander,

Jürgen Steimle,

Kasper Hornbæk,

Miguel Bruns Alonso,

Timothy MerrittAuthors Info & Claims

CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

Paper No.: 299, Pages 1 - 14

https://doi.org/10.1145/3173574.3173873

Published: 21 April 2018 Publication History

Abstract

Shape-changing interfaces have emerged as a new method for interacting with computers, using dynamic changes in a device's physical shape for input and output. With the advances of research into shape-changing interfaces, we see a need to synthesize the main, open research questions. The purpose of this synthesis is to formulate common challenges across the diverse fields engaged in shape-change research, to facilitate progression from single prototypes and individual design explorations to grander scientific goals, and to draw attention to challenges that come with maturity, including those concerning ethics, theory-building, and societal impact. In this article we therefore present 12 grand challenges for research on shape-changing interfaces, derived from a three-day workshop with 25 shape-changing interface experts with backgrounds in design, computer science, human-computer interaction, engineering, robotics, and material science.

References

[1]

Ahmed Al Maimani and Anne Roudaut. 2017. Frozen Suit: Designing a Changeable Stiffness Suit and Its Application to Haptic Games. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 2440--2448.

Digital Library

[2]

Anders S. G. Andrae and Otto Andersen. 2010. Life Cycle Assessments of Consumer Electronics-Are they Consistent? The International Journal of Life Cycle Assessment 15, 8 (01 Sep 2010), 827--836.

[3]

Minoru Asada. 1995. Preface. Advanced Robotics 10, 2 (1995), 139--142.

[4]

Christoph Bartneck, Dana Kuli´ c, Elizabeth Croft, and Susana Zoghbi. 2009. Measurement Instruments for the Anthropomorphism, Animacy, Likeability, Perceived Intelligence, and Perceived Safety of Robots. International Journal of Social Robotics 1, 1 (01 Jan 2009), 71--81.

[5]

Jordan Beck and Erik Stolterman. 2017. Reviewing the Big Questions Literature;: Or, Should HCI Have Big Questions?. In Proceedings of the 2017 Conference on Designing Interactive Systems (DIS '17). ACM, New York, NY, USA, 969--981.

Digital Library

[6]

Hrvoje Benko, Andrew D. Wilson, and Ravin Balakrishnan. 2008. Sphere: Multi-touch Interactions on a Spherical Display. In Proceedings of the 21st Annual ACM Symposium on User Interface Software and Technology (UIST '08). ACM, New York, NY, USA, 77--86.

Digital Library

[7]

Joanna Berzowska and Marcelo Coelho. 2005. Kukkia and Vilkas: Kinetic Electronic Garments. In Ninth IEEE International Symposium on Wearable Computers (ISWC'05). 82--85.

Digital Library

[8]

Paul Brochu and Qibing Pei. 2010. Advances in Dielectric Elastomers for Actuators and Artificial Muscles. Macromolecular rapid communications 31, 1 (2010), 10--36.

[9]

Marcelo Coelho, Hiroshi Ishii, and Pattie Maes. 2008. Surflex: A Programmable Surface for the Design of Tangible Interfaces. In CHI '08 Extended Abstracts on Human Factors in Computing Systems (CHI EA '08). ACM, New York, NY, USA, 3429--3434.

Digital Library

[10]

Marcelo Coelho and Jamie Zigelbaum. 2011. Shape-changing Interfaces. Personal and Ubiquitous Computing 15, 2 (01 Feb 2011), 161--173.

Digital Library

[11]

Daniel M Cohen and Christopher S Chen. 2008. Mechanical Control of Stem Cell Differentiation. StemBook {Internet} (October 2008).

[12]

Stelian Coros, Bernhard Thomaszewski, Gioacchino Noris, Shinjiro Sueda, Moira Forberg, Robert W. Sumner, Wojciech Matusik, and Bernd Bickel. 2013. Computational Design of Mechanical Characters. ACM Trans. Graph. 32, 4, Article 83 (July 2013), 12 pages.

Digital Library

[13]

Artem Dementyev, Hsin-Liu (Cindy) Kao, Inrak Choi, Deborah Ajilo, Maggie Xu, Joseph A. Paradiso, Chris Schmandt, and Sean Follmer. 2016. Rovables: Miniature On-Body Robots As Mobile Wearables. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16). ACM, New York, NY, USA, 111--120.

Digital Library

[14]

Panteleimon Dimitriadis and Jason Alexander. 2014. Evaluating the Effectiveness of Physical Shape-change for In-pocket Mobile Device Notifications. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 2589--2592.

Digital Library

[15]

Tom Djajadiningrat, Stephan Wensveen, Joep Frens, and Kees Overbeeke. 2004. Tangible Products: Redressing the Balance between Appearance and Action. Personal and Ubiquitous Computing 8, 5 (01 Sep 2004), 294--309.

Digital Library

[16]

Robert Dubin. 1969. Theory Building. Free Press.

[17]

Anthony Dunne and Fiona Raby. 2013. Speculative Everything: Design, Fiction, and Social Dreaming. MIT Press.

Digital Library

[18]

Nature Editorial. 2016. Go forth and replicate! 536, 7617 (August 2016), 373.

[19]

Panteleimon Ekkekakis. 2013. The Measurement of Affect, Mood, and Emotion: A Guide for Health-behavioral Research. Cambridge University Press.

[20]

Aluna Everitt and Jason Alexander. 2017. PolySurface: A Design Approach for Rapid Prototyping of Shape-Changing Displays Using Semi-Solid Surfaces. In Proceedings of the 2017 Conference on Designing Interactive Systems (DIS '17). ACM, New York, NY, USA, 1283--1294.

Digital Library

[21]

Aluna Everitt, Faisal Taher, and Jason Alexander. 2016. ShapeCanvas: An Exploration of Shape-Changing Content Generation by Members of the Public. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 2778--2782.

Digital Library

[22]

Sean Follmer, Daniel Leithinger, Alex Olwal, Nadia Cheng, and Hiroshi Ishii. 2012. Jamming User Interfaces: Programmable Particle Stiffness and Sensing for Malleable and Shape-changing Devices. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (UIST '12). ACM, New York, NY, USA, 519--528.

Digital Library

[23]

Sean Follmer, Daniel Leithinger, Alex Olwal, Akimitsu Hogge, and Hiroshi Ishii. 2013. inFORM: Dynamic Physical Affordances and Constraints Through Shape and Object Actuation. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (UIST '13). ACM, New York, NY, USA, 417--426.

Digital Library

[24]

SPARC The Robotics Partnership for Europe. 2016. Robotics 2020 Multi-Annual Roadmap. Technical Report. Retrieved 15/09/17 from https://www.eu-robotics.net/cms/upload/topic_groups/ H2020_Robotics_Multi-Annual_Roadmap_ICT-2017B.pdf

[25]

Stephen J Furst, George Bunget, and Stefan Seelecke. 2013. Design and Fabrication of a Bat-inspired Flapping-flight Platform using Shape Memory Alloy Muscles and Joints. Smart Materials and Structures 22, 1 (2013).

[26]

Antonio Gomes, Andrea Nesbitt, and Roel Vertegaal. 2013. MorePhone: A Study of Actuated Shape Deformations for Flexible Thin-film Smartphone Notifications. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 583--592.

Digital Library

[27]

Antonio Gomes, Calvin Rubens, Sean Braley, and Roel Vertegaal. 2016. BitDrones: Towards Using 3D Nanocopter Displays As Interactive Self-Levitating Programmable Matter. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 770--780.

Digital Library

[28]

Saul Greenberg, Sebastian Boring, Jo Vermeulen, and Jakub Dostal. 2014. Dark Patterns in Proxemic Interactions: A Critical Perspective. In Proceedings of the 2014 Conference on Designing Interactive Systems (DIS '14). ACM, New York, NY, USA, 523--532.

Digital Library

[29]

Daniel Groeger, Elena Chong Loo, and Jürgen Steimle. 2016. HotFlex: Post-print Customization of 3D Prints Using Embedded State Change. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 420--432.

Digital Library

[30]

Erik Grönvall, Sofie Kinch, Marianne Graves Petersen, and Majken K. Rasmussen. 2014. Causing Commotion with a Shape-changing Bench: Experiencing Shape-changing Interfaces in Use. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 2559--2568.

Digital Library

[31]

Dave Hakkens. 2016. Phoneblocks. (2016). Retrieved 15/09/17 from www.phonebloks.com.

[32]

John Hardy, Christian Weichel, Faisal Taher, John Vidler, and Jason Alexander. 2015. ShapeClip: Towards Rapid Prototyping with Shape-Changing Displays for Designers. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 19--28.

Digital Library

[33]

Nikolaj Haulrik, Rasmus M. Petersen, and Timothy Merritt. 2017. CADLens: Haptic Feedback for Navigating in 3D Environments. In Proceedings of the 2017 ACM Conference Companion Publication on Designing Interactive Systems (DIS '17 Companion). ACM, New York, NY, USA, 127--131.

Digital Library

[34]

Fabian Hemmert, Susann Hamann, Matthias Löwe, Josefine Zeipelt, and Gesche Joost. 2010. Shape-changing Mobiles: Tapering in Two-dimensional Deformational Displays in Mobile Phones. In CHI '10 Extended Abstracts on Human Factors in Computing Systems (CHI EA '10). ACM, New York, NY, USA, 3075--3080.

Digital Library

[35]

Bart Hengeveld. 2015. Composing Interaction: Exploring Tangible Notation Systems For Design. In Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '15). ACM, New York, NY, USA, 667--672.

Digital Library

[36]

Guy Hoffman and Wendy Ju. 2014. Designing Robots with Movement in Mind. Journal of Human-Robot Interaction 3, 1 (2014), 89--122.

Digital Library

[37]

David Holman and Roel Vertegaal. 2008. Organic User Interfaces: Designing Computers in Any Way, Shape, or Form. Commun. ACM 51, 6 (June 2008), 48--55.

Digital Library

[38]

Kasper Hornbæk, Søren S. Sander, Javier Andrés Bargas-Avila, and Jakob Grue Simonsen. 2014. Is Once Enough?: On the Extent and Content of Replications in Human-computer Interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 3523--3532.

Digital Library

[39]

Eva Hornecker and Jacob Buur. 2006. Getting a Grip on Tangible Interaction: A Framework on Physical Space and Social Interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '06). ACM, New York, NY, USA, 437--446.

Digital Library

[40]

Steven Houben, Nicolai Marquardt, Jo Vermeulen, Clemens Klokmose, Johannes Schöning, Harald Reiterer, and Christian Holz. 2017. Opportunities and Challenges for Cross-device Interactions in the Wild. Interactions 24, 5 (Aug. 2017), 58--63.

Digital Library

[41]

Caroline Hummels, Kees C. J. Overbeeke, and Sietske Klooster. 2007. Move to Get Moved: A Search for Methods, Tools and Knowledge to Design for Expressive and Rich Movement-based Interaction. Personal and Ubiquitous Computing 11, 8 (01 Dec 2007), 677--690.

Digital Library

[42]

Yeup Hur, Miriam Sturdee, Migeul Bruns Alonso, Panos Markopoulos, and Jason Alexander. 2017. Fiction and Physicality: A Designerly Approach Towards Complexities of Emerging Technologies. The Design Journal 20, sup1 (2017), 3849--3862.

[43]

Hiroshi Ishii, Dávid Lakatos, Leonardo Bonanni, and Jean-Baptiste Labrune. 2012. Radical Atoms: Beyond Tangible Bits, Toward Transformable Materials. interactions 19, 1 (Jan. 2012), 38--51.

Digital Library

[44]

Hiroshi Ishii, Daniel Leithinger, Sean Follmer, Amit Zoran, Philipp Schoessler, and Jared Counts. 2015. TRANSFORM: Embodiment of "Radical Atoms" at Milano Design Week. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '15). ACM, New York, NY, USA, 687--694.

Digital Library

[45]

Hiroshi Ishii, Sandia Ren, and Phil Frei. 2001. Pinwheels: Visualizing Information Flow in an Architectural Space. In CHI '01 Extended Abstracts on Human Factors in Computing Systems (CHI EA '01). ACM, New York, NY, USA, 111--112.

Digital Library

[46]

Sungjune Jang, Lawrence H. Kim, Kesler Tanner, Hiroshi Ishii, and Sean Follmer. 2016. Haptic Edge Display for Mobile Tactile Interaction. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 3706--3716.

Digital Library

[47]

Yvonne Jansen, Pierre Dragicevic, Petra Isenberg, Jason Alexander, Abhijit Karnik, Johan Kildal, Sriram Subramanian, and Kasper Hornbæk. 2015. Opportunities and Challenges for Data Physicalization. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 3227--3236.

Digital Library

[48]

Lynette A. Jones and Susan J. Lederman. 2006. Human Hand Function. Oxford University Press. 52--56 pages.

[49]

William Jones, Robert Capra, Anne Diekema, Jaime Teevan, Manuel Pérez-Quiñones, Jesse David Dinneen, and Bradley Hemminger. 2015. ?For Telling" the Present: Using the Delphi Method to Understand Personal Information Management Practices. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 3513--3522.

Digital Library

[50]

Branko Kolarevic. 2004. Architecture in the Digital Age: Design and Manufacturing. Taylor & Francis.

[51]

Aleksandra Kupferberg, Stefan Glasauer, Markus Huber, Markus Rickert, Alois Knoll, and Thomas Brandt. 2011. Biological Movement Increases Acceptance of Humanoid Robots as Human Partners in Motor Interaction. AI & SOCIETY 26, 4 (01 Nov 2011), 339--345.

[52]

Matthijs Kwak and Joep W. Frens. 2015. From Movement to Mechanism: Exploring Expressive Movement Qualities in Shape-change. In Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '15). ACM, New York, NY, USA, 461--464.

Digital Library

[53]

Mathieu Le Goc, Lawrence H. Kim, Ali Parsaei, Jean-Daniel Fekete, Pierre Dragicevic, and Sean Follmer. 2016. Zooids: Building Blocks for Swarm User Interfaces. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16). ACM, New York, NY, USA, 97--109.

Digital Library

[54]

Kurt Luther, Jari-Lee Tolentino, Wei Wu, Amy Pavel, Brian P. Bailey, Maneesh Agrawala, Björn Hartmann, and Steven P. Dow. 2015. Structuring, Aggregating, and Evaluating Crowdsourced Design Critique. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing (CSCW '15). ACM, New York, NY, USA, 473--485.

Digital Library

[55]

Timothy Robert Merritt, Mie Nørgaard, Christian Ø. Laursen, Majken Kirkegård Rasmussen, and Marianne Graves Petersen. 2015. Imagined Physics: Exploring Examples of Shape-changing Interfaces. In Cognitive Robotics. CRC Press LLC, 89--111.

[56]

G. Michelitsch, J. Williams, M. Osen, B. Jimenez, and S. Rapp. 2004. Haptic Chameleon: A New Concept of Shape-changing User Interface Controls with Force Feedback. In CHI '04 Extended Abstracts on Human Factors in Computing Systems (CHI EA '04). ACM, New York, NY, USA, 1305--1308.

Digital Library

[57]

Ken Nakagaki, Artem Dementyev, Sean Follmer, Joseph A. Paradiso, and Hiroshi Ishii. 2016a. ChainFORM: A Linear Integrated Modular Hardware System for Shape Changing Interfaces. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16). ACM, New York, NY, USA, 87--96.

Digital Library

[58]

Ken Nakagaki, Luke Vink, Jared Counts, Daniel Windham, Daniel Leithinger, Sean Follmer, and Hiroshi Ishii. 2016b. Materiable: Rendering Dynamic Material Properties in Response to Direct Physical Touch with Shape Changing Interfaces. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 2764--2772.

Digital Library

[59]

I.C. Nnorom and O. Osibanjo. 2008. Overview of Electronic Waste (e-waste) Management Practices and Legislations, and their Poor Applications in the Developing Countries. Resources, Conservation and Recycling 52, 6 (2008), 843--858.

[60]

Mie Nørgaard, Tim Merritt, Majken Kirkegaard Rasmussen, and Marianne Graves Petersen. 2013. Exploring the Design Space of Shape-changing Objects: Imagined Physics. In Proceedings of the 6th International Conference on Designing Pleasurable Products and Interfaces (DPPI '13). ACM, New York, NY, USA, 251--260.

Digital Library

[61]

Simon Olberding, Michael Wessely, and Jürgen Steimle. 2014. PrintScreen: Fabricating Highly Customizable Thin-film Touch-displays. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST '14). ACM, New York, NY, USA, 281--290.

Digital Library

[62]

Themis Omirou, Asier Marzo, Sue Ann Seah, and Sriram Subramanian. 2015. LeviPath: Modular Acoustic Levitation for 3D Path Visualisations. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 309--312.

Digital Library

[63]

Kas Oosterhuis and Nimish Biloria. 2008. Interactions with Proactive Architectural Spaces: The Muscle Projects. Commun. ACM 51, 6 (2008), 70--78.

Digital Library

[64]

Jifei Ou, Felix Heibeck, and Hiroshi Ishii. 2017. Pneuduino. (2017). Retrieved 15/09/17 from www.pneuduino.org.

[65]

Jifei Ou, Mélina Skouras, Nikolaos Vlavianos, Felix Heibeck, Chin-Yi Cheng, Jannik Peters, and Hiroshi Ishii. 2016. aeroMorph - Heat-sealing Inflatable Shape-change Materials for Interaction Design. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16). ACM, New York, NY, USA, 121--132.

Digital Library

[66]

Young-Woo Park, Joohee Park, and Tek-Jin Nam. 2015. The Trial of Bendi in a Coffeehouse: Use of a Shape-Changing Device for a Tactile-Visual Phone Conversation. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 2181--2190.

Digital Library

[67]

Amanda Parkes and Hiroshi Ishii. 2010. Bosu: A Physical Programmable Design Tool for Transformability with Soft Mechanics. In Proceedings of the 8th ACM Conference on Designing Interactive Systems (DIS '10). ACM, New York, NY, USA, 189--198.

Digital Library

[68]

Esben W. Pedersen, Sriram Subramanian, and Kasper Hornbæk. 2014. Is My Phone Alive?: A Large-scale Study of Shape Change in Handheld Devices Using Videos. In Proceedings of the 32Nd Annual ACM Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 2579--2588.

Digital Library

[69]

Marianne Graves Petersen, Ole Sejer Iversen, Peter Gall Krogh, and Martin Ludvigsen. 2004. Aesthetic Interaction: A Pragmatist's Aesthetics of Interactive Systems. In Proceedings of the 5th Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques (DIS '04). ACM, New York, NY, USA, 269--276.

Digital Library

[70]

Ivan Poupyrev, Tatsushi Nashida, and Makoto Okabe. 2007. Actuation and Tangible User Interfaces: The Vaucanson Duck, Robots, and Shape Displays. In Proceedings of the 1st International Conference on Tangible and Embedded Interaction (TEI '07). ACM, New York, NY, USA, 205--212.

Digital Library

[71]

Domenico Prattichizzo, Monica Malvezzi, Irfan Hussain, and Gionata Salvietti. 2014. The Sixth-Finger: A Modular Extra-finger to Enhance Human Hand Capabilities. In The 23rd IEEE International Symposium on Robot and Human Interactive Communication. 993--998.

[72]

Majken K. Rasmussen, Esben W. Pedersen, Marianne G. Petersen, and Kasper Hornbæk. 2012. Shape-changing Interfaces: A Review of the Design Space and Open Research Questions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 735--744.

Digital Library

[73]

Matthias Rauterberg, Ben Salem, and Dirk Van De Mortel. 2005. From Passive to Active Forms. Design and Semantics of Form and Movement (2005), 111--117.

[74]

Philip R Ross and Stephan AG Wensveen. 2010. Designing Behavior in Interaction: Using Aesthetic Experience as a Mechanism for Design. International Journal of Design 4, 2 (2010), 3--13.

[75]

Anne Roudaut, Abhijit Karnik, Markus Löchtefeld, and Sriram Subramanian. 2013. Morphees: Toward High "Shape Resolution" in Self-actuated Flexible Mobile Devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 593--602.

Digital Library

[76]

Anne Roudaut, Diana Krusteva, Mike McCoy, Abhijit Karnik, Karthik Ramani, and Sriram Subramanian. 2016. Cubimorph: Designing Modular Interactive Devices. In 2016 IEEE International Conference on Robotics and Automation (ICRA). 3339--3345.

[77]

Anne Roudaut, Rebecca Reed, Tianbo Hao, and Sriram Subramanian. 2014. Changibles: Analyzing and Designing Shape Changing Constructive Assembly. In Proceedings of the 32Nd Annual ACM Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 2593--2596.

Digital Library

[78]

Daniel Rozin. 2007. Peg Mirror. (2007). Retrieved 15/09/17 from http://www.smoothware.com/danny/pegmirror.html.

[79]

Marcos Serrano, Anne Roudaut, and Pourang Irani. 2016. Investigating Text Legibility on Non-Rectangular Displays. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 498--508.

Digital Library

[80]

Marcos Serrano, Anne Roudaut, and Pourang Irani. 2017. Visual Composition of Graphical Elements on Non-Rectangular Displays. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 4405--4416.

Digital Library

[81]

Orit Shaer and Eva Hornecker. 2010. Tangible User Interfaces: Past, Present, and Future Directions. Found. Trends Hum.-Comput. Interact. 3, 1--2 (Jan. 2010), 1--137.

Digital Library

[82]

Hiroki Shigemune, Shingo Maeda, Vito Cacucciolo, Yoshitaka Iwata, Eiji Iwase, Shujo Hashimoto, and Shigeki Sugano. 2017. Printed Paper Robot Driven by Electrostatic Actuator. IEEE Robotics and Automation Letters 2, 2 (April 2017), 1001--1007.

[83]

Makoto Shimojo, Masami Shinohara, and Yukio Fukui. 1999. Human Shape Recognition Performance for 3D Tactile Display. IEEE Transactions on Systems, Man, and Cybernetics-Part A: Systems and Humans 29, 6 (1999), 637--644.

Digital Library

[84]

Ben Shneiderman. 1987. Designing the User Interface: Strategies for Effective Human-computer Interaction. Addison-Wesley Longman Publishing Co., Inc., Boston, MA, USA.

Digital Library

[85]

Adam Spiers, Aaron Dollar, Janet van der Linden, and Maria Oshodi. 2015. First Validation of the Haptic Sandwich: A Shape Changing Handheld Haptic Navigation Aid. In 2015 International Conference on Advanced Robotics (ICAR). 144--151.

[86]

Mandayam A. Srinivasan and Cagatay Basdogan. 1997. Haptics in Virtual Environments: Taxonomy, Research Status, and Challenges. Computers & Graphics 21, 4 (1997), 393--404. Haptic Displays in Virtual Environments and Computer Graphics in Korea.

[87]

Jelle Stienstra, Miguel Bruns Alonso, Stephan Wensveen, and Stoffel Kuenen. 2012. How to Design for Transformation of Behavior Through Interactive Materiality. In Proceedings of the 7th Nordic Conference on Human-Computer Interaction: Making Sense Through Design (NordiCHI '12). ACM, New York, NY, USA, 21--30.

Digital Library

[88]

Evan Strasnick, Jackie Yang, Kesler Tanner, Alex Olwal, and Sean Follmer. 2017. shiftIO: Reconfigurable Tactile Elements for Dynamic Affordances and Mobile Interaction. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 5075--5086.

Digital Library

[89]

Paul Strohmeier, Juan Pablo Carrascal, Bernard Cheng, Margaret Meban, and Roel Vertegaal. 2016. An Evaluation of Shape Changes for Conveying Emotions. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 3781--3792.

Digital Library

[90]

ART+COM Studios. 2008. Kinetic Sculpture -- The Shapes of Things to Come, 2008. (2008). Retrieved 15/09/17 from https://artcom.de/en/project/kinetic-sculpture/.

[91]

Miriam Sturdee and Jason Alexander. 2018. Analysis and Classification of Shape-Changing Interfaces for Design and Application-based Research. ACM Comput. Surv. 51, 1, Article 2 (Jan. 2018), 32 pages.

Digital Library

[92]

Miriam Sturdee, Paul Coulton, and Jason Alexander. 2017. Using Design Fiction to Inform Shape-Changing Interface Design and Use. The Design Journal 20, sup1 (2017), 4146--4157.

[93]

Miriam Sturdee, John Hardy, Nick Dunn, and Jason Alexander. 2015. A Public Ideation of Shape-Changing Applications. In Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces (ITS '15). ACM, New York, NY, USA, 219--228.

Digital Library

[94]

Ivan E. Sutherland. 1965. The Ultimate Display. In Proceedings of the IFIP Congress. 506--508.

[95]

Faisal Taher, John Hardy, Abhijit Karnik, Christian Weichel, Yvonne Jansen, Kasper Hornbæk, and Jason Alexander. 2015. Exploring Interactions with Physically Dynamic Bar Charts. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 3237--3246.

Digital Library

[96]

Faisal Taher, Yvonne Jansen, Jonathan Woodruff, John Hardy, Kasper Hornbæk, and Jason Alexander. 2017a. Investigating the Use of a Dynamic Physical Bar Chart for Data Exploration and Presentation. IEEE Transactions on Visualization and Computer Graphics 23, 1 (Jan 2017), 451--460.

Digital Library

[97]

Faisal Taher, John Vidler, and Jason Alexander. 2017b. A Characterization of Actuation Techniques for Generating Movement in Shape-Changing Interfaces. International Journal of Human-Computer Interaction 33, 5 (2017), 385--398.

[98]

Haodan Tan, John Tiab, Selma Šabanovi´ c, and Kasper Hornbæk. 2016. Happy Moves, Sad Grooves: Using Theories of Biological Motion and Affect to Design Shape-Changing Interfaces. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems (DIS '16). ACM, New York, NY, USA, 1282--1293.

Digital Library

[99]

Seppe Terryn, Joost Brancart, Dirk Lefeber, Guy Van Assche, and Bram Vanderborght. 2017. Self-healing Soft Pneumatic Robots. Science Robotics 2, 9 (2017), eaan4268.

[100]

John Tiab and Kasper Hornbæk. 2016. Understanding Affordance, System State, and Feedback in Shape-Changing Buttons. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 2752--2763.

Digital Library

[101]

Skylar Tibbits. 2014. 4D printing: Multi-material Shape Change. Architectural Design 84, 1 (2014), 116--121.

[102]

Giovanni Maria Troiano, Esben Warming Pedersen, and Kasper Hornbæk. 2014. User-defined Gestures for Elastic, Deformable Displays. In Proceedings of the 2014 International Working Conference on Advanced Visual Interfaces (AVI '14). ACM, New York, NY, USA, 1--8.

Digital Library

[103]

Philip Tuddenham, David Kirk, and Shahram Izadi. 2010. Graspables Revisited: Multi-touch vs. Tangible Input for Tabletop Displays in Acquisition and Manipulation Tasks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10). ACM, New York, NY, USA, 2223--2232.

Digital Library

[104]

Anna Vallgårda, Morten Winther, Nina Mørch, and Edit E Vizer. 2015. Temporal Form in Interaction Design. International Journal of Design 9, 3 (2015), 1--15.

[105]

Christian Weichel, Jason Alexander, and John Hardy. 2015. Shape Display Shader Language (SDSL): A New Programming Model for Shape Changing Displays. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '15). ACM, New York, NY, USA, 1121--1126.

Digital Library

[106]

Martin Weigel, Tong Lu, Gilles Bailly, Antti Oulasvirta, Carmel Majidi, and Jürgen Steimle. 2015. iSkin: Flexible, Stretchable and Visually Customizable On-Body Touch Sensors for Mobile Computing. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 2991--3000.

Digital Library

[107]

Zheng Yan. 2015. Encyclopedia of Mobile Phone Behavior. IGI Global.

Digital Library

[108]

Lining Yao, Ryuma Niiyama, Jifei Ou, Sean Follmer, Clark Della Silva, and Hiroshi Ishii. 2013. PneUI: Pneumatically Actuated Soft Composite Materials for Shape Changing Interfaces. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (UIST '13). ACM, New York, NY, USA, 13--22.

Digital Library

[109]

Mark Yim, Wei-Min Shen, Behnam Salemi, Daniela Rus, Mark Moll, Hod Lipson, Eric Klavins, and Gregory S Chirikjian. 2007. Modular Self-reconfigurable Robot Systems {Grand Challenges of Robotics}. IEEE Robotics & Automation Magazine 14, 1 (2007), 43--52.

[110]

Oren Zuckerman and Ayelet Gal-Oz. 2013. To TUI or not to TUI: Evaluating Performance and Preference in Tangible vs. Graphical User Interfaces. International Journal of Human-Computer Studies 71, 7 (2013), 803 -- 820.

Digital Library

Cited By

Yu JAyobi AMarshall PO'Kane A(2025)Creatively Supporting Mental Wellbeing: A Tangible Toolkit to Scaffold Self-Tracking through Mindful ColouringProceedings of the Nineteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3689050.3704944(1-17)Online publication date: 4-Mar-2025
https://dl.acm.org/doi/10.1145/3689050.3704944
Otaran AJiang YSteimle J(2025)Sparsely actuated modular metamaterials for shape changing interfacesProceedings of the Nineteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3689050.3704942(1-12)Online publication date: 4-Mar-2025
https://dl.acm.org/doi/10.1145/3689050.3704942
Daniel MDelamare W(2025)ShyPins: Safeguarding User Mental Safety From The Forcible (Dis)Appearance Of Pin-based Controls By Using Speed ZonesProceedings of the Nineteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3689050.3704940(1-16)Online publication date: 4-Mar-2025
https://dl.acm.org/doi/10.1145/3689050.3704940
Show More Cited By

Index Terms

Grand Challenges in Shape-Changing Interface Research
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Grand challenges in human-food interaction
Highlights
- Highlights increasing interest in combining interactive technology with food, called human-food interaction (HFI).
- Presents a set of next steps for human-food interaction (HFI) for a more fully developed HFI research agenda.
- ...
Abstract
There is an increasing interest in combining interactive technology with food, leading to a new research area called human-food interaction. While food experiences are increasingly benefiting from interactive technology, for example in the form ...
KirigamiTable: Designing for Proxemic Transitions with a Shape-Changing Tabletop
CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

A core challenge in tabletop research is to support transitions between individual activities and team work. Shape-changing tabletops open up new opportunities for addressing this challenge. However, interaction design for shape-changing furniture is in ...
GranDIHC-BR: Grand Research Challenges in Human-Computer Interaction in Brazil for 2025-2035✱
IHC '24: Proceedings of the XXIII Brazilian Symposium on Human Factors in Computing Systems
The II GranDIHC-BR is a collaborative initiative to identify Grand Research Challenges for Human-Computer Interaction (HCI) and define a research agenda for the next decade (2025-2035) in Brazil. A diverse group of researchers and practitioners identified ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

April 2018

8489 pages

ISBN:9781450356206

DOI:10.1145/3173574

General Chairs:
Regan Mandryk
University of Saskatchewan, Canada
,
Mark Hancock
University of Waterloo, Canada
,
Program Chairs:
Mark Perry
Brunel University London, UK
,
Anna Cox
University College London, UK

Copyright © 2018 Owner/Author.

This work is licensed under a Creative Commons Attribution International 4.0 License.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 April 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

ERC
EC FET-open
EPSRC
Leverhulme Trust

Conference

CHI '18

Sponsor:

SIGCHI

CHI '18: CHI Conference on Human Factors in Computing Systems

April 21 - 26, 2018

Montreal QC, Canada

Acceptance Rates

CHI '18 Paper Acceptance Rate 666 of 2,590 submissions, 26%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

169
Total Citations
View Citations
6,231
Total Downloads

Downloads (Last 12 months)1,153
Downloads (Last 6 weeks)159

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Yu JAyobi AMarshall PO'Kane A(2025)Creatively Supporting Mental Wellbeing: A Tangible Toolkit to Scaffold Self-Tracking through Mindful ColouringProceedings of the Nineteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3689050.3704944(1-17)Online publication date: 4-Mar-2025
https://dl.acm.org/doi/10.1145/3689050.3704944
Otaran AJiang YSteimle J(2025)Sparsely actuated modular metamaterials for shape changing interfacesProceedings of the Nineteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3689050.3704942(1-12)Online publication date: 4-Mar-2025
https://dl.acm.org/doi/10.1145/3689050.3704942
Daniel MDelamare W(2025)ShyPins: Safeguarding User Mental Safety From The Forcible (Dis)Appearance Of Pin-based Controls By Using Speed ZonesProceedings of the Nineteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3689050.3704940(1-16)Online publication date: 4-Mar-2025
https://dl.acm.org/doi/10.1145/3689050.3704940
Zhang LHuai YHu ZWu JCassinelli AZhu K(2025)ThreadTessel: A Modularized Tangible Toolkit Leveraging Origami Tessellation for Designing Thread-actuated Shape-changing StructuresProceedings of the Nineteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3689050.3704929(1-15)Online publication date: 4-Mar-2025
https://dl.acm.org/doi/10.1145/3689050.3704929
Dominiak JWysokińska ABentvelzen MRomanowski AWoźniak P(2025)A design space for reconfigurable interactive desktop environments (RIDEs)Behaviour & Information Technology10.1080/0144929X.2024.2447920(1-26)Online publication date: 16-Feb-2025
https://doi.org/10.1080/0144929X.2024.2447920
Soana VMinooee Sabery SBosi FWurdemann H(2025)Elastic robotic structures: a multidisciplinary framework for the design and control of shape-morphing elastic system for architectural and design applicationsConstruction Robotics10.1007/s41693-024-00128-89:1Online publication date: 13-Jan-2025
https://doi.org/10.1007/s41693-024-00128-8
Fan ZSanson ARames TCoutrix C(2024)Design and Perception of a Soft Shape Change Beneath a SmartwatchProceedings of the ACM on Human-Computer Interaction10.1145/36764958:MHCI(1-23)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1145/3676495
Ion AMajidi CYao LAlavi A(2024)Bridging Disciplines for a New Era in Physical AIAdjunct Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3672539.3686704(1-3)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3672539.3686704
Gao CQian WLiu RHanocka RNakagaki K(2024)Towards Multimodal Interaction with AI-Infused Shape-Changing InterfacesAdjunct Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3672539.3686315(1-3)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3672539.3686315
Müller MKammer DFranke I(2024)Kickstarting Application Development for Elastic Displays with Do-it-yourself Hardware Assembly InstructionsProceedings of the 2024 International Conference on Advanced Visual Interfaces10.1145/3656650.3656678(1-5)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3656650.3656678
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Figures

Tables

Media

View Table of Conten