Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3313831.3376856acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

Household Surface Interactions: Understanding User Input Preferences and Perceived Home Experiences

Published: 23 April 2020 Publication History

Abstract

Households contain a variety of surfaces that are used in a number of activity contexts. As ambient technology becomes commonplace in our homes, it is only a matter of time before these surfaces become linked to computer systems for Household Surface Interaction (HSI). However, little is known about the user experience attached to HSI, and the potential acceptance of HSI within modern homes. To address this problem, we ran a mixed methods user study with 39 participants to examine HSI using nine household surfaces and five common gestures (tap, press, swipe, drag, and pinch). We found that under the right conditions, surfaces with some amount of texture can enhance HSI. Furthermore, perceived good and poor user experience varied among participants for surface type indicating individual preferences. We present findings and design considerations based on surface characteristics and the challenges that users perceive they may have with HSI within their homes.

Supplementary Material

ZIP File (pn9583aux.zip)
The zip file contains:
MP4 File (a727-tigwell-presentation.mp4)

References

[1]
Hamed S. Alavi, Elizabeth F. Churchill, Mikael Wiberg, Denis Lalanne, Peter Dalsgaard, Ava Fatah Gen Schieck, and Yvonne Rogers. 2019. Introduction to Human-Building Interaction (HBI): Interfacing HCI with Architecture and Urban Design. ACM Trans. Comput.-Hum. Interact. 26, 2, Article 6 (March 2019), 10 pages.
[2]
Olivier Bau and Ivan Poupyrev. 2012. REVEL: Tactile Feedback Technology for Augmented Reality. ACM Trans. Graph. 31, 4, Article 89 (July 2012), 11 pages.
[3]
Michel Beaudouin-Lafon. 2011. Lessons Learned from the WILD Room, a Multisurface Interactive Environment. In Proceedings of the 23rd Conference on L'Interaction Homme-Machine (IHM '11). ACM, NY, NY, USA, Article 18, 8 pages.
[4]
Hrvoje Benko, Ricardo Jota, and Andrew Wilson. 2012. MirageTable: Freehand Interaction on a Projected Augmented Reality Tabletop. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, NY, NY, USA, 199--208.
[5]
O. Bimber, A. Emmerling, and T. Klemmer. 2005. Embedded entertainment with smart projectors. Computer 38, 1 (Jan 2005), 48--55.
[6]
Leonardo Bonanni and Chia-Hsun Lee. 2004. The Kitchen As a Graphical User Interface. In ACM SIGGRAPH 2004 Art Gallery (SIGGRAPH '04). ACM, NY, NY, USA, 109--111.
[7]
Leonardo Bonanni, Chia-Hsun Lee, and Ted Selker. 2005. Cooking with the Elements: Intuitive Immersive Interfaces for Augmented Reality Environments. In Proceedings of the 2005 IFIP TC13 International Conference on Human-Computer Interaction (INTERACT'05). Springer-Verlag, Berlin, Heidelberg, 1022--1025.
[8]
Keith Bright and Geoff Cook. 2010. The colour, light and contrast manual: designing and managing inclusive built environments. Wiley-Blackwell.
[9]
Gabe Cohn, Daniel Morris, Shwetak N. Patel, and Desney S. Tan. 2011. Your Noise is My Command: Sensing Gestures Using the Body As an Antenna. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, NY, NY, USA, 791--800.
[10]
Andy Crabtree and Peter Tolmie. 2016. A Day in the Life of Things in the Home. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing (CSCW '16). Association for Computing Machinery, New York, NY, USA, 1738--1750.
[11]
Scott Davidoff, Min Kyung Lee, Charles Yiu, John Zimmerman, and Anind K. Dey. 2006. Principles of Smart Home Control. In UbiComp 2006: Ubiquitous Computing, Paul Dourish and Adrian Friday (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 19--34.
[12]
Tanja Döring. 2016. The Interaction Material Profile: Understanding and Inspiring How Physical Materials Shape Interaction. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '16). ACM, NY, NY, USA, 2446--2453.
[13]
Tanja Döring, Axel Sylvester, and Albrecht Schmidt. 2012. Exploring Material-centered Design Concepts for Tangible Interaction. In CHI '12 Extended Abstracts on Human Factors in Computing Systems (CHI EA '12). ACM, NY, NY, USA, 1523--1528.
[14]
Peter Elliott and Graeme Hawthorne. 2005. Imputing missing repeated measures data: how should we proceed? Australian and New Zealand Journal of Psychiatry 39, 7 (2005), 575--582.
[15]
Andy Field. 2013. Discovering statistics using IBM SPSS statistics. sage.
[16]
Krzysztof Z. Gajos, Jacob O. Wobbrock, and Daniel S. Weld. 2008. Improving the Performance of Motor-Impaired Users with Automatically-Generated, Ability-Based Interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '08). Association for Computing Machinery, New York, NY, USA, 1257--1266.
[17]
Elisa Giaccardi and Elvin Karana. 2015. Foundations of Materials Experience: An Approach for HCI. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, NY, NY, USA, 2447--2456.
[18]
Mayank Goel, Alex Jansen, Travis Mandel, Shwetak N. Patel, and Jacob O. Wobbrock. 2013. ContextType: Using Hand Posture Information to Improve Mobile Touch Screen Text Entry. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). Association for Computing Machinery, New York, NY, USA, 2795--2798.
[19]
Barry G Green, Susan J Lederman, and Joseph C Stevens. 1979. The effect of skin temperature on the perception of roughness. Sensory processes 3, 4 (1979), 327--333.
[20]
Jonna Häkkilä and Ashley Colley. 2016. Towards a Design Space for Liquid User Interfaces. In Proceedings of the 9th Nordic Conference on Human-Computer Interaction (NordiCHI '16). ACM, NY, NY, USA, Article 34, 4 pages.
[21]
Jonna Häkkila, Yun He, and Ashley Colley. 2015. Experiencing the Elements -- User Study with Natural Material Probes. In Human-Computer Interaction -- INTERACT 2015, Julio Abascal, Simone Barbosa, Mirko Fetter, Tom Gross, Philippe Palanque, and Marco Winckler (Eds.). Springer International Publishing, Cham, 324--331.
[22]
Jonna Häkkilä, Olli Koskenranta, Maaret Posti, and Yun He. 2013. City Landmark As an Interactive Installation: Experiences with Stone, Water and Public Space. In Proceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction (TEI '14). ACM, NY, NY, USA, 221--224.
[23]
Sarah Hayes, Trevor Hogan, and Kieran Delaney. 2017. Exploring the Materials of TUIs: A Multi-Method Approach. In Proceedings of the 2017 ACM Conference Companion Publication on Designing Interactive Systems (DIS '17 Companion). ACM, NY, NY, USA, 55--60.
[24]
A. Hryniowski, I. B. Daya, A. Gawish, M. Lamm, A. Wong, and P. Fieguth. 2018. Multi-projector Resolution Enhancement Through Biased Interpolation. In 2018 15th Conference on Computer and Robot Vision (CRV). 190--197.
[25]
E. A. Johnson. 1965. Touch display--a novel input/output device for computers. Electronics Letters 1, 8 (October 1965), 219--220.
[26]
Brett R. Jones, Hrvoje Benko, Eyal Ofek, and Andrew D. Wilson. 2013. IllumiRoom: Peripheral Projected Illusions for Interactive Experiences. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, NY, NY, USA, 869--878.
[27]
Wendy Ju, Leonardo Bonanni, Richard Fletcher, Rebecca Hurwitz, Tilke Judd, Rehmi Post, Matthew Reynolds, and Jennifer Yoon. 2002. Origami Desk: Integrating Technological Innovation and Human-centric Design. In Proceedings of the 4th Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques (DIS '02). ACM, NY, NY, USA, 399--405.
[28]
Heekyoung Jung and Erik Stolterman. 2010. Material Probe: Exploring Materiality of Digital Artifacts. In Proceedings of the Fifth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '11). Association for Computing Machinery, New York, NY, USA, 153--156.
[29]
Heekyoung Jung and Erik Stolterman. 2011. Form and Materiality in Interaction Design: A New Approach to HCI. In CHI '11 Extended Abstracts on Human Factors in Computing Systems (CHI EA '11). ACM, NY, NY, USA, 399--408.
[30]
Hideki Koike, Yoichi Sato, Yoshinori Kobayashi, Hiroaki Tobita, and Motoki Kobayashi. 2000. Interactive Textbook and Interactive Venn Diagram: Natural and Intuitive Interfaces on Augmented Desk System. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '00). ACM, NY, NY, USA, 121--128.
[31]
S J Lederman. 1976. The "callus-thenics" of touching. (1976).
[32]
Chia-Hsun Lee, Leonardo Bonnani, and Ted Selker. 2005. Augmented Reality Kitchen: Enhancing Human Sensibility in Domestic Life. In ACM SIGGRAPH 2005 Posters (SIGGRAPH '05). ACM, NY, NY, USA, Article 60.
[33]
David Lindlbauer, Jens Emil Grønbæk, Morten Birk, Kim Halskov, Marc Alexa, and Jörg Müller. 2016. Combining Shape-Changing Interfaces and Spatial Augmented Reality Enables Extended Object Appearance. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, NY, NY, USA, 791--802.
[34]
Nobuyuki Matsushita and Jun Rekimoto. 1997. HoloWall: Designing a Finger, Hand, Body, and Object Sensitive Wall. In Proceedings of the 10th Annual ACM Symposium on User Interface Software and Technology (UIST '97). ACM, NY, NY, USA, 209--210.
[35]
Shree K Nayar, Harish Peri, Michael D Grossberg, and Peter N Belhumeur. A projection system with radiometric compensation for screen imperfections. Citeseer.
[36]
Ofcom. 2018. The Communications Market Report. (2018). https://www.ofcom.org.uk/research-and-data/multi-sector-research/cmr/cmr-2018
[37]
Ivan Poupyrev, Shigeaki Maruyama, and Jun Rekimoto. 2002. Ambient Touch: Designing Tactile Interfaces for Handheld Devices. In Proceedings of the 15th Annual ACM Symposium on User Interface Software and Technology (UIST '02). ACM, NY, NY, USA, 51--60.
[38]
Ramesh Raskar and Kok-Lim Low. 2001. Interacting with Spatially Augmented Reality. In Proceedings of the 1st International Conference on Computer Graphics, Virtual Reality and Visualisation (AFRIGRAPH '01). ACM, NY, NY, USA, 101--108.
[39]
Ramesh Raskar, Greg Welch, Matt Cutts, Adam Lake, Lev Stesin, and Henry Fuchs. 1998. The Office of the Future: A Unified Approach to Image-based Modeling and Spatially Immersive Displays. In Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '98). ACM, NY, NY, USA, 179--188.
[40]
Jun Rekimoto. 2002. SmartSkin: An Infrastructure for Freehand Manipulation on Interactive Surfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '02). ACM, NY, NY, USA, 113--120.
[41]
Munehiko Sato, Shigeo Yoshida, Alex Olwal, Boxin Shi, Atsushi Hiyama, Tomohiro Tanikawa, Michitaka Hirose, and Ramesh Raskar. 2015. SpecTrans: Versatile Material Classification for Interaction with Textureless, Specular and Transparent Surfaces. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, NY, NY, USA, 2191--2200.
[42]
T. Schiphorst, N. Motamedi, and N. Jaffe. 2007. Applying an Aesthetic Framework of Touch for Table-Top Interactions. In Second Annual IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP'07). 71--74.
[43]
Magdalena Schmid, Sonja Rümelin, and Hendrik Richter. 2013. Empowering Materiality: Inspiring the Design of Tangible Interactions. In Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction (TEI '13). ACM, NY, NY, USA, 91--98.
[44]
Sony. 2018. Sony Xperia Touch. (2018). https://www.sonymobile.com/gb/products/smart-products/xperia-touch
[45]
Sebastian Stein and Stephen J. McKenna. 2013. Combining Embedded Accelerometers with Computer Vision for Recognizing Food Preparation Activities. In Proceedings of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '13). ACM, NY, NY, USA, 729--738.
[46]
Julia M. Thornbury and Charlotte M. Mistretta. 1981. Tactile Sensitivity as a Function of Age1. Journal of Gerontology 36, 1 (01 1981), 34--39.
[47]
Garreth W. Tigwell, David R. Flatla, and Rachel Menzies. 2018a. It's Not Just the Light: Understanding the Factors Causing Situational Visual Impairments During Mobile Interaction. In Proceedings of the 10th Nordic Conference on Human-Computer Interaction (NordiCHI '18). ACM, NY, NY, USA, 338--351.
[48]
Garreth W. Tigwell, Rachel Menzies, and David R. Flatla. 2018b. Designing for Situational Visual Impairments: Supporting Early-Career Designers of Mobile Content. In Proceedings of the 2018 Designing Interactive Systems Conference (DIS '18). ACM, NY, NY, USA, 387--399.
[49]
Garreth W. Tigwell, Zhanna Sarsenbayeva, Benjamin M. Gorman, David R. Flatla, Jorge Goncalves, Yeliz Yesilada, and Jacob O. Wobbrock. 2019. Addressing the Challenges of Situationally-Induced Impairments and Disabilities in Mobile Interaction. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (CHI EA '19). ACM, NY, NY, USA, Article W30, 8 pages.
[50]
Christian Tonn, Frank Petzold, Oliver Bimber, Anselm Grundhaufer, and Dirk Donath. 2008. Spatial Augmented Reality for Architecture Designing and Planning with and within Existing Buildings. International Journal of Architectural Computing 6, 1 (2008), 41--58.
[51]
Sarah J. Tracy. 2013. Qualitative Research Methods: Collecting Evidence, Crafting Analysis, Communicating Impact. Wiley-Blackwell.
[52]
Ying-Chao Tung, Mayank Goel, Isaac Zinda, and Jacob O. Wobbrock. 2018. RainCheck: Overcoming Capacitive Interference Caused by Rainwater on Smartphones. In Proceedings of the 20th ACM International Conference on Multimodal Interaction (ICMI '18). Association for Computing Machinery, New York, NY, USA, 464--471.
[53]
Leena Ventä-Olkkonen, Panu AAkerman, Arto Puikkonen, Ashley Colley, and Jonna Häkkilä. 2014. Touching the Ice: In-the-wild Study of an Interactive Icewall. In Proceedings of the 26th Australian Computer-Human Interaction Conference on Designing Futures: The Future of Design (OzCHI '14). ACM, NY, NY, USA, 129--132.
[54]
Craig Villamor, Dan Willis, and Luke Wroblewski. 2010. Touch gesture reference guide. Touch Gesture Reference Guide (2010). http://www.lukew.com/touch/
[55]
Jorick Vissers and David Geerts. 2015. TUIkit: Evaluating Physical and Functional Experiences of Tangible User Interface Prototypes. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, NY, NY, USA, 1267--1276.
[56]
Ron Wakkary, Doenja Oogjes, Sabrina Hauser, Henry Lin, Cheng Cao, Leo Ma, and Tijs Duel. 2017. Morse Things: A Design Inquiry into the Gap Between Things and Us. In Proceedings of the 2017 Conference on Designing Interactive Systems (DIS '17). Association for Computing Machinery, New York, NY, USA, 503--514.
[57]
Roy Want, Kenneth P. Fishkin, Anuj Gujar, and Beverly L. Harrison. 1999. Bridging Physical and Virtual Worlds with Electronic Tags. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '99). ACM, NY, NY, USA, 370--377.
[58]
Mikael Wiberg. 2016. Interaction, new materials & computing -- Beyond the disappearing computer, towards material interactions. Materials & Design 90 (2016), 1200 -- 1206.
[59]
Jacob O Wobbrock. 2006. The future of mobile device research in HCI. In CHI 2006 workshop proceedings: what is the next generation of human-computer interaction. 131--134.
[60]
Hui-Shyong Yeo, Gergely Flamich, Patrick Schrempf, David Harris-Birtill, and Aaron Quigley. 2016. RadarCat: Radar Categorization for Input & Interaction. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16). ACM, NY, NY, USA, 833--841.
[61]
Hui-Shyong Yeo, Juyoung Lee, Andrea Bianchi, David Harris-Birtill, and Aaron Quigley. 2017. SpeCam: Sensing Surface Color and Material with the Front-facing Camera of a Mobile Device. In Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '17). ACM, NY, NY, USA, Article 25, 9 pages.
[62]
Stefanie Zollmann, Tobias Langlotz, and Oliver Bimber. 2007. Passive-active geometric calibration for view-dependent projections onto arbitrary surfaces. JVRB-Journal of Virtual Reality and Broadcasting 4, 6 (2007).

Cited By

View all
  • (2024)Identifying Hand-based Input Preference Based on Wearable EEGProceedings of the Augmented Humans International Conference 202410.1145/3652920.3653028(102-118)Online publication date: 4-Apr-2024
  • (2024)Human-Building Interaction for Interactive Cultural Heritage SiteDesign for Equality and Justice10.1007/978-3-031-61698-3_36(321-329)Online publication date: 9-Jul-2024
  • (2024)Deaf and Hard of Hearing People’s Perspectives on Augmented Reality Interfaces for Improving the Accessibility of Smart SpeakersUniversal Access in Human-Computer Interaction10.1007/978-3-031-60881-0_21(334-357)Online publication date: 29-Jun-2024
  • Show More Cited By

Index Terms

  1. Household Surface Interactions: Understanding User Input Preferences and Perceived Home Experiences

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems
    April 2020
    10688 pages
    ISBN:9781450367080
    DOI:10.1145/3313831
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 23 April 2020

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. materiality
    2. surface texture
    3. user experience

    Qualifiers

    • Research-article

    Funding Sources

    • The Carnegie Trust for the Universities of Scotland

    Conference

    CHI '20
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

    Upcoming Conference

    CHI '25
    CHI Conference on Human Factors in Computing Systems
    April 26 - May 1, 2025
    Yokohama , Japan

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)92
    • Downloads (Last 6 weeks)5
    Reflects downloads up to 18 Nov 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Identifying Hand-based Input Preference Based on Wearable EEGProceedings of the Augmented Humans International Conference 202410.1145/3652920.3653028(102-118)Online publication date: 4-Apr-2024
    • (2024)Human-Building Interaction for Interactive Cultural Heritage SiteDesign for Equality and Justice10.1007/978-3-031-61698-3_36(321-329)Online publication date: 9-Jul-2024
    • (2024)Deaf and Hard of Hearing People’s Perspectives on Augmented Reality Interfaces for Improving the Accessibility of Smart SpeakersUniversal Access in Human-Computer Interaction10.1007/978-3-031-60881-0_21(334-357)Online publication date: 29-Jun-2024
    • (2023)MicroCamProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36109217:3(1-28)Online publication date: 27-Sep-2023
    • (2022)Towards Responsive Architecture that Mediates PlaceProceedings of the ACM on Human-Computer Interaction10.1145/35555686:CSCW2(1-27)Online publication date: 11-Nov-2022
    • (2020)Everyday automation experience: a research agendaPersonal and Ubiquitous Computing10.1007/s00779-020-01450-y24:6(725-734)Online publication date: 9-Oct-2020

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media