extended-abstract

(Re-)connecting with Nature in Urban Life: Engaging with Wildlife via AI-powered Wearables

Authors:

Min-Ling ZhangAuthors Info & Claims

MobileHCI '22: Adjunct Publication of the 24th International Conference on Human-Computer Interaction with Mobile Devices and Services

Article No.: 14, Pages 1 - 5

https://doi.org/10.1145/3528575.3551435

Published: 28 September 2022 Publication History

Abstract

Connecting with nature is essential for our health and well-being. However, we are getting less connected with nature today because of urbanization. Considering urban is where human and other species co-habit, we believe there is an opportunity to design interactive technologies to engage urban residents with those wild species to deepen the residents’ connection with nature in their daily life. In this paper, we present GoChirp, an always-available AI-powered wearable device that connects users with nature by engaging them with surrounding wild birds. GoChirp embeds machine learning techniques to detect surrounding birds by recognizing birds’ chirping sound. The device brings the birds to users’ attention via haptic feedback that mimics the bird flapping. GoChirp comes with a mobile APP that supports users to take photos and identifying the species of the bird showing in the photo. With GoChirp, we hope to further the understanding of interaction design for connecting people with nature and inspire designers to consider the role of always-available technology in supporting human-nature interaction.

References

[1]

[1] BIRDS 400.2022. https://www.kaggle.com/datasets/gpiosenka/100-bird-species/discussion?resource=download&group=owned. Accessed 10 August 2022.

[2]

Jesper J Alvarsson, Stefan Wiens, and Mats E Nilsson. 2010. Stress recovery during exposure to nature sound and environmental noise. International Journal of Environmental Research and Public Health 7, 3(2010), 1036–1046.

[3]

[3] Audubon.2022. audubon.org/apps. Accessed 10 August 2022.

[4]

Magnus Bang, Carin Torstensson, and Cecilia Katzeff. 2006. The powerhhouse: A persuasive computer game designed to raise awareness of domestic energy consumption. In International Conference on Persuasive Technology. Springer, 123–132.

[5]

Thomas H Beery and Daniel Wolf-Watz. 2014. Nature to place: Rethinking the environmental connectedness perspective. Journal of Environmental Psychology 40 (2014), 198–205.

[6]

Ann Blandford, Dominic Furniss, and Stephann Makri. 2016. Qualitative HCI research: Going behind the scenes. Synthesis Lectures on Human-centered Informatics 9, 1(2016), 1–115.

[7]

Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative Research in Psychology 3, 2 (2006), 77–101.

[8]

Marion Buchenau and Jane Fulton Suri. 2000. Experience prototyping. In Proceedings of the 3rd Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques (New York City, New York, USA) (DIS ’00). Association for Computing Machinery, New York, NY, USA, 424–433.

Digital Library

[9]

Rachel Clarke, Sara Heitlinger, Ann Light, Laura Forlano, Marcus Foth, and Carl DiSalvo. 2019. More-than-human participation: Design for sustainable smart city futures. Interactions 26, 3 (apr 2019), 60–63.

Digital Library

[10]

Carl DiSalvo, Phoebe Sengers, and Hrönn Brynjarsdóttir. 2010. Mapping the landscape of sustainable HCI. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Atlanta, Georgia, USA) (CHI ’10). Association for Computing Machinery, New York, NY, USA, 1975–1984.

Digital Library

[11]

Lara S Franco, Danielle F Shanahan, and Richard A Fuller. 2017. A review of the benefits of nature experiences: More than meets the eye. International Journal of Environmental Research and Public Health 14, 8(2017), 864.

[12]

Christopher Frauenberger. 2019. Entanglement HCI the next wave?ACM Trans. Comput.-Hum. Interact. 27, 1, Article 2 (nov 2019), 27 pages.

Digital Library

[13]

William W. Gaver, John Bowers, Kirsten Boehner, Andy Boucher, David W.T. Cameron, Mark Hauenstein, Nadine Jarvis, and Sarah Pennington. 2013. Indoor weather stations: Investigating a ludic Approach to environmental HCI through batch prototyping. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Paris, France) (CHI ’13). Association for Computing Machinery, New York, NY, USA, 3451–3460.

Digital Library

[14]

Matteo Giusti, Ulrika Svane, Christopher M. Raymond, and Thomas H. Beery. 2018. A framework to assess where and how children connect to nature. Frontiers in Psychology 8 (2018).

[15]

[15] Merlin Bird ID.2022. https://merlin.allaboutbirds.org. Accessed 10 August 2022.

[16]

Marie A. Jarrell, Christine Wendell, Cameron Ogle, William Hendrickson, and J. Drew Lanham. 2019. Bird watch: A fully immersive VR birdwatching simulator. In Extended Abstracts of the Annual Symposium on Computer-Human Interaction in Play Companion Extended Abstracts (Barcelona, Spain) (CHI PLAY ’19 Extended Abstracts). Association for Computing Machinery, New York, NY, USA, 253–260.

Digital Library

[17]

Selin Kesebir and Pelin Kesebir. 2017. A growing disconnection from nature is evident in cultural products. Perspectives on Psychological Science 12, 2 (2017), 258–269.

[18]

Selin Kesebir and Pelin Kesebir. 2017. How modern life became disconnected from nature. Greater Good Magazine(2017).

[19]

Bran Knowles, Oliver Bates, and Maria Håkansson. 2018. This changes sustainable HCI. Association for Computing Machinery, New York, NY, USA, 1–12.

Digital Library

[20]

Ilpo Koskinen, John Zimmerman, Thomas Binder, Johan Redstrom, and Stephan Wensveen. 2011. Design research through practice: From the lab, field, and showroom. Elsevier.

Digital Library

[21]

Zhuying Li, Rakesh Patibanda, Felix Brandmueller, Wei Wang, Kyle Berean, Stefan Greuter, and Florian Mueller. 2018. The Guts Game: Towards designing ingestible games. In Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play (Melbourne, VIC, Australia) (CHI PLAY ’18). Association for Computing Machinery, New York, NY, USA, 271–283.

Digital Library

[22]

Zhuying Li, Yan Wang, Jacob Sheahan, Beisi Jiang, Stefan Greuter, and Floyd Mueller. 2020. InsideOut: Towards an understanding of designing playful experiences with imaging capsules. Association for Computing Machinery, New York, NY, USA, 601–613.

[23]

Zhuying Li, Yan Wang, Wei Wang, Weikang Chen, Ti Hoang, Stefan Greuter, and Florian Floyd Mueller. 2019. HeatCraft: Designing playful experiences with ingestible sensors via localized thermal stimuli. Association for Computing Machinery, New York, NY, USA, 1–12.

[24]

Ann Light, Alison Powell, and Irina Shklovski. 2017. Design for existential crisis in the anthropocene age. In Proceedings of the 8th International Conference on Communities and Technologies (Troyes, France) (C&T ’17). Association for Computing Machinery, New York, NY, USA, 270–279.

Digital Library

[25]

Jen Liu, Daragh Byrne, and Laura Devendorf. 2018. Design for collaborative survival: An inquiry into human-fungi relationships. Association for Computing Machinery, New York, NY, USA, 1–13.

Digital Library

[26]

Szu-Yu (Cyn) Liu, Shaowen Bardzell, and Jeffrey Bardzell. 2019. Symbiotic encounters: HCI and sustainable agriculture. Association for Computing Machinery, New York, NY, USA, 1–13.

[27]

John McCarthy and Peter Wright. 2004. Technology as experience. Interactions 11, 5 (sep 2004), 42–43.

Digital Library

[28]

Floyd Mueller, Pedro Lopes, Paul Strohmeier, Wendy Ju, Caitlyn Seim, Martin Weigel, Suranga Nanayakkara, Marianna Obrist, Zhuying Li, Joseph Delfa, Jun Nishida, Elizabeth M. Gerber, Dag Svanaes, Jonathan Grudin, Stefan Greuter, Kai Kunze, Thomas Erickson, Steven Greenspan, Masahiko Inami, Joe Marshall, Harald Reiterer, Katrin Wolf, Jochen Meyer, Thecla Schiphorst, Dakuo Wang, and Pattie Maes. 2020. Next steps for human-computer integration. Association for Computing Machinery, New York, NY, USA, 1–15.

Digital Library

[29]

Lisa P. Nathan and Eric M. Meyers. 2016. Enriching visions of sustainability through informal public pedagogies. Interactions 23, 5 (aug 2016), 54–57.

Digital Library

[30]

Elizabeth K Nisbet, John M Zelenski, and Steven A Murphy. 2009. The nature relatedness scale: Linking individuals’ connection with nature to environmental concern and behavior. Environment and Behavior 41, 5 (2009), 715–740.

[31]

Mark Sandler, Andrew Howard, Menglong Zhu, Andrey Zhmoginov, and Liang-Chieh Chen. 2018. MobileNetV2: Inverted Residuals and Linear Bottlenecks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[32]

Mangalam Sankupellay, Anna Kalma, Sean Magin, Jessica L. Cappadonna, Paul Roe, and Margot Brereton. 2017. Birdsound: Enticing urban dwellers to engage with local birds around their home. In Proceedings of the 29th Australian Conference on Computer-Human Interaction (Brisbane, Queensland, Australia) (OZCHI ’17). Association for Computing Machinery, New York, NY, USA, 172–181.

Digital Library

[33]

Nancy Smith, Shaowen Bardzell, and Jeffrey Bardzell. 2017. Designing for cohabitation: Naturecultures, hybrids, and decentering the human in design. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 1714–1725.

Digital Library

[34]

Alessandro Soro, Margot Brereton, Tshering Dema, Jessica L. Oliver, Min Zhen Chai, and Aloha May Hufana Ambe. 2018. The ambient birdhouse: An IoT device to discover birds and engage with nature. Association for Computing Machinery, New York, NY, USA, 1–13.

[35]

Helene Steiner, Paul Johns, Asta Roseway, Chris Quirk, Sidhant Gupta, and Jonathan Lester. 2017. Project Florence: A plant to human experience. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI EA ’17). Association for Computing Machinery, New York, NY, USA, 1415–1420.

Digital Library

[36]

Ekaterina R. Stepanova, John Desnoyers-Stewart, Philippe Pasquier, and Bernhard E. Riecke. 2020. JeL: Breathing together to connect with others and nature. Association for Computing Machinery, New York, NY, USA, 641–654.

Digital Library

[37]

Dan Stowell, Michael D Wood, Hanna Pamuła, Yannis Stylianou, and Hervé Glotin. 2019. Automatic acoustic detection of birds through deep learning: the first Bird Audio Detection challenge. Methods in Ecology and Evolution 10, 3 (2019), 368–380.

[38]

Anne M Treisman. 1964. Selective attention in man. British medical bulletin 20, 1 (1964), 12–16.

[39]

Makoto Yokohari and Marco Amati. 2005. Nature in the city, city in the nature: Case studies of the restoration of urban nature in Tokyo, Japan and Toronto, Canada. Landscape and Ecological Engineering 1, 1 (2005), 53–59.

Cited By

Kneile MJürgens TChristoforakos LLaschke M(2023)The thing that made me thinki-com10.1515/icom-2023-001922:2(161-171)Online publication date: 11-Jul-2023
https://doi.org/10.1515/icom-2023-0019
Li ZWang YAndres JSemertzidis NGreuter SMueller F(2023)A Design Framework for Ingestible PlayACM Transactions on Computer-Human Interaction10.1145/358995430:4(1-39)Online publication date: 11-Sep-2023
https://dl.acm.org/doi/10.1145/3589954
Huang SZhang YFeng YRen HYao C(2023)Melody Oasis: Research and Design of a Nature Interactive System for Children Based on Plant Electrical Signals2023 16th International Symposium on Computational Intelligence and Design (ISCID)10.1109/ISCID59865.2023.00055(200-203)Online publication date: 16-Dec-2023
https://doi.org/10.1109/ISCID59865.2023.00055

Index Terms

(Re-)connecting with Nature in Urban Life: Engaging with Wildlife via AI-powered Wearables
1. Computer systems organization
  1. Dependable and fault-tolerant systems and networks
    1. Redundancy
  2. Embedded and cyber-physical systems
    1. Embedded systems
    2. Robotics
2. Networks
  1. Network properties
    1. Network reliability

Recommendations

Wearables as Context for Guiard-abiding Bimanual Touch
UIST '16: Proceedings of the 29th Annual Symposium on User Interface Software and Technology

We explore the contextual details afforded by wearable devices to support multi-user, direct-touch interaction on electronic whiteboards in a way that-unlike previous work-can be fully consistent with natural bimanual-asymmetric interaction as set forth ...
Mobile Collocated Interactions With Wearables
MobileHCI '15: Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct

Research on mobile collocated interactions has been looking at situations in which collocated users engage in collaborative activities using their mobile devices, thus going from personal/individual toward shared/multiuser experiences and interactions. ...
Securely Connecting Wearables to Ambient Displays with User Intent
Wearables are often small and have limited user interfaces, hence they often wirelessly interface with a personal smartphone or a personal computer to relay information from the wearable for display. In this paper, we envision a new method LightTouch by ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

MobileHCI '22: Adjunct Publication of the 24th International Conference on Human-Computer Interaction with Mobile Devices and Services

September 2022

124 pages

ISBN:9781450393416

DOI:10.1145/3528575

Copyright © 2022 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 September 2022

Check for updates

Author Tags

Qualifiers

Extended-abstract
Research
Refereed limited

Conference

MobileHCI '22

Sponsor:

SIGCHI

MobileHCI '22: 24th International Conference on Human-Computer Interaction with Mobile Devices and Services

September 28 - October 1, 2022

BC, Vancouver, Canada

Acceptance Rates

Overall Acceptance Rate 202 of 906 submissions, 22%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
269
Total Downloads

Downloads (Last 12 months)105
Downloads (Last 6 weeks)13

Reflects downloads up to 21 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Kneile MJürgens TChristoforakos LLaschke M(2023)The thing that made me thinki-com10.1515/icom-2023-001922:2(161-171)Online publication date: 11-Jul-2023
https://doi.org/10.1515/icom-2023-0019
Li ZWang YAndres JSemertzidis NGreuter SMueller F(2023)A Design Framework for Ingestible PlayACM Transactions on Computer-Human Interaction10.1145/358995430:4(1-39)Online publication date: 11-Sep-2023
https://dl.acm.org/doi/10.1145/3589954
Huang SZhang YFeng YRen HYao C(2023)Melody Oasis: Research and Design of a Nature Interactive System for Children Based on Plant Electrical Signals2023 16th International Symposium on Computational Intelligence and Design (ISCID)10.1109/ISCID59865.2023.00055(200-203)Online publication date: 16-Dec-2023
https://doi.org/10.1109/ISCID59865.2023.00055

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents