Nothing Special   »   [go: up one dir, main page]

skip to main content
research-article
Open access

OptiStructures: Fabrication of Room-Scale Interactive Structures with Embedded Fiber Bragg Grating Optical Sensors and Displays

Published: 15 June 2020 Publication History

Abstract

A recent topic of considerable interest in the "smart building" community involves building interactive devices using sensors, and rapidly creating these objects using new fabrication methods. However, much of this work has been done at what might be called hand scale, with less attention paid to larger objects and structures (at furniture or room scales) despite the fact that we are very often literally surrounded by such objects. In this work, we present a new set of techniques for creating interactive objects at these scales. We demonstrate fabrication of both input sensors and displays directly into cast materials -those formed from a liquid or paste which solidifies in a mold; including, for example: concrete, plaster, polymer resins, and composites.
Through our novel set of sensing and fabrication techniques, we enable human activity recognition at room scale and across a variety of materials. Our techniques create objects that appear the same as typical passive objects, but contain internal fiber optics for both input sensing and simple displays. We use a new fabrication device to inject optical fibers into CNC milled molds. Fiber Bragg Grating optical sensors configured as very sensitive vibration sensors are embedded in these objects. These require no internal power, can be placed at multiple locations along a single fiber, and can be interrogated from the end of the fiber. We evaluate the performance of our system by creating two full-scale application prototypes: an interactive wall, and an interactive table. With these prototypes, we demonstrate the ability of our system to sense a variety of human activities across eight different users. Our tests show that with suitable materials these sensors can detect and classify both direct interactions (such as tapping) and more subtle vibrations caused by activities such as walking across the floor nearby.

Supplementary Material

swaminathan (swaminathan.zip)
Supplemental movie, appendix, image and software files for, OptiStructures: Fabrication of Room-Scale Interactive Structures with Embedded Fiber Bragg Grating Optical Sensors and Displays

References

[1]
Nasa armstrong fact sheet: Fiber optic sensing system | nasa. https://www.nasa.gov/centers/armstrong/news/FactSheets/FS-110-AFRC.html. (Accessed on 02/09/2020).
[2]
Baam - big area additive manufacturing, 2019.
[3]
Boxzy home, 2019.
[4]
Objet30 pro desktop 3d printer for rapid prototyping, 2019.
[5]
Fiber Bragg Grating Manufacturing Workstation, Apr 2020. [Online; accessed 27. Apr. 2020].
[6]
Micron Optics, Apr 2020. [Online; accessed 27. Apr. 2020].
[7]
Farhad Ansari. Sensing issues in civil structural health monitoring. Springer, 2005.
[8]
Tyler J Arsenault, Ajit Achuthan, Pier Marzocca, Chiara Grappasonni, and Giuliano Coppotelli. Development of a fbg based distributed strain sensor system for wind turbine structural health monitoring. Smart Materials and Structures, 22(7):075027, 2013.
[9]
Amelie Bonde, Shijia Pan, Hae Young Noh, and Pei Zhang. Deskbuddy: an office activity detection system: demo abstract. In Proceedings of the 18th International Conference on Information Processing in Sensor Networks, pages 352--353, 2019.
[10]
Kristyna Čápová, Lukáš Velebil, and Jan Včelák. Laboratory and in-situ testing of integrated fbg sensors for shm for concrete and timber structures. Sensors, 20(6):1661, 2020.
[11]
A. J. Eronen, V. T. Peltonen, J. T. Tuomi, A. P. Klapuri, S. Fagerlund, T. Sorsa, G. Lorho, and J. Huopaniemi. Audio-based context recognition. Trans. Audio, Speech and Lang. Proc., 14(1):321--329, December 2006.
[12]
J. Fagert, M. Mirshekari, S. Pan, P. Zhang, and H.Y. Noh. Characterizing left-right gait balance using footstep-induced structural vibrations. In SPIE 10168, Sensors and Smart Structures Technologies for Civil, Mechanical, and Aerospace Systems, volume 10168, pages 10168--10168 - 9, 2017.
[13]
James Fogarty, Carolyn Au, and Scott E. Hudson. Sensing from the basement: A feasibility study of unobtrusive and low-cost home activity recognition. In Proceedings of the 19th Annual ACM Symposium on User Interface Software and Technology, UIST '06, pages 91--100, New York, NY, USA, 2006. ACM.
[14]
Jon E. Froehlich, Eric Larson, Tim Campbell, Conor Haggerty, James Fogarty, and Shwetak N. Patel. Hydrosense: Infrastructure-mediated single-point sensing of whole-home water activity. In Proceedings of the 11th International Conference on Ubiquitous Computing, UbiComp '09, pages 235--244, New York, NY, USA, 2009. ACM.
[15]
Nan-Wei Gong, Steve Hodges, and Joseph A Paradiso. Leveraging conductive inkjet technology to build a scalable and versatile surface for ubiquitous sensing. In Proceedings of the 13th international conference on Ubiquitous computing, pages 45--54, 2011.
[16]
Anhong Guo, Anuraag Jain, Shomiron Ghose, Gierad Laput, Chris Harrison, and Jeffrey P. Bigham. Crowd-ai camera sensing in the real world. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., 2(3):111:1--111:20, September 2018.
[17]
Daniele Inaudi. Optical Fiber Sensors for Dam and Levee Monitoring and Damage Detection, pages 91--120. 11 2019.
[18]
Daniele Inaudi and Branko Glisic. Long-Range Pipeline Monitoring by Distributed Fiber Optic Sensing. American Society of Mechanical Engineers Digital Collection, pages 763--772, Oct 2008.
[19]
Alexandra Ion, Johannes Frohnhofen, Ludwig Wall, Robert Kovacs, Mirela Alistar, Jack Lindsay, Pedro Lopes, Hsiang-Ting Chen, and Patrick Baudisch. Metamaterial mechanisms. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology, UIST '16, pages 529--539, New York, NY, USA, 2016. ACM.
[20]
Alexandra Ion, Robert Kovacs, Oliver S. Schneider, Pedro Lopes, and Patrick Baudisch. Metamaterial textures. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, CHI '18, pages 336:1--336:12, New York, NY, USA, 2018. ACM.
[21]
Gayan Chanaka Kahandawa, Jayantha Ananda Epaarachchi, John Canning, Gang-Ding Peng, and Alan Lau. Development of embedded fbg sensor networks for shm systems. In Structural Health Monitoring Technologies and Next-Generation Smart Composite Structures, pages 61--88. CRC Press, 2016.
[22]
Cansu Karatas, Boray Degerliyurt, Yavuz Yaman, and Melin Sahin. Fibre bragg grating sensor applications for structural health monitoring. Aircraft Engineering and Aerospace Technology, 2018.
[23]
Raman Kashyap. Fiber bragg gratings. Academic press, Cambridge, MA, 2009.
[24]
JM Ko and YQ Ni. Technology developments in structural health monitoring of large-scale bridges. Engineering structures, 27(12):1715--1725, 2005.
[25]
Robert Kovacs, Alexandra Ion, Pedro Lopes, Tim Oesterreich, Johannes Filter, Philipp Otto, Tobias Arndt, Nico Ring, Melvin Witte, Anton Synytsia, and et al. Trussformer: 3d printing large kinetic structures. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology, UIST '18, pages 113--125, New York, NY, USA, 2018. Association for Computing Machinery.
[26]
Robert Kovacs, Anna Seufert, Ludwig Wall, Hsiang-Ting Chen, Florian Meinel, Willi Müller, Sijing You, Maximilian Brehm, Jonathan Striebel, Yannis Kommana, et al. Trussfab: Fabricating sturdy large-scale structures on desktop 3d printers. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, pages 2606--2616. ACM, 2017.
[27]
Benjamin Lafreniere, Tovi Grossman, Fraser Anderson, Justin Matejka, Heather Kerrick, Danil Nagy, Lauren Vasey, Evan Atherton, Nicholas Beirne, Marcelo H Coelho, et al. Crowdsourced fabrication. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology, pages 15--28. ACM, 2016.
[28]
Gierad Laput, Karan Ahuja, Mayank Goel, and Chris Harrison. Ubicoustics: Plug-and-play acoustic activity recognition. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology, UIST '18, pages 213--224, New York, NY, USA, 2018. ACM.
[29]
Gierad Laput and Chris Harrison. Exploring the efficacy of sparse, general-purpose sensor constellations for wide-area activity sensing. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 3(2):55, 2019.
[30]
Gierad Laput and Chris Harrison. Surfacesight: A new spin on touch, user, and object sensing for iot experiences. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, CHI '19, pages 329:1--329:12, New York, NY, USA, 2019. ACM.
[31]
Gierad Laput, Walter S. Lasecki, Jason Wiese, Robert Xiao, Jeffrey P. Bigham, and Chris Harrison. Zensors: Adaptive, rapidly deployable, human-intelligent sensor feeds. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI '15, pages 1935--1944, New York, NY, USA, 2015. ACM.
[32]
Gierad Laput, Yang Zhang, and Chris Harrison. Synthetic sensors: Towards general-purpose sensing. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, pages 3986--3999. ACM, 2017.
[33]
K. Loupos and A. Amditis. Structural Health Monitoring Fiber Optic Sensors. SpringerLink, pages 185--206, 2017.
[34]
Linjie Luo, Ilya Baran, Szymon Rusinkiewicz, and Wojciech Matusik. Chopper: partitioning models into 3d-printable parts. 2012.
[35]
R Maaskant, T Alavie, RM Measures, G Tadros, SH Rizkalla, and A Guha-Thakurta. Fiber-optic bragg grating sensors for bridge monitoring. Cement and Concrete Composites, 19(1):21--33, 1997.
[36]
Ramin Madarshahian, Juan M Caicedo, and Diego Arocha Zambrana. Benchmark problem for human activity identification using floor vibrations. Expert Systems with Applications, 62:263--272, 2016.
[37]
Micron Optics. SM-130 Optical Sensing Interrogator, 2009.
[38]
Mostafa Mirshekari, Jonathon Fagert, Shijia Pan, Pei Zhang, and Hae Young Noh. Step-level occupant detection across different structures through footstep-induced floor vibration using model transfer. Journal of Engineering Mechanics, 146(3):04019137, 2020.
[39]
Mostafa Mirshekari, Shijia Pan, Jonathon Fagert, Eve M Schooler, Pei Zhang, and Hae Young Noh. Occupant localization using footstep-induced structural vibration. Mechanical Systems and Signal Processing, 112:77--97, 2018.
[40]
Shijia Pan, Ceferino Gabriel Ramirez, Mostafa Mirshekari, Jonathon Fagert, Albert Jin Chung, Chih Chi Hu, John Paul Shen, Hae Young Noh, and Pei Zhang. Surfacevibe: Vibration-based tap & swipe tracking on ubiquitous surfaces. In Proceedings of the 16th ACM/IEEE International Conference on Information Processing in Sensor Networks, IPSN '17, pages 197--208, New York, NY, USA, 2017. ACM.
[41]
Shwetak N. Patel, Matthew S. Reynolds, and Gregory D. Abowd. Detecting human movement by differential air pressure sensing in hvac system ductwork: An exploration in infrastructure mediated sensing. In Proceedings of the 6th International Conference on Pervasive Computing, Pervasive '08, pages 1--18, Berlin, Heidelberg, 2008. Springer-Verlag.
[42]
Shwetak N. Patel, Thomas Robertson, Julie A. Kientz, Matthew S. Reynolds, and Gregory D. Abowd. At the flick of a switch: Detecting and classifying unique electrical events on the residential power line. In Proceedings of the 9th International Conference on Ubiquitous Computing, UbiComp '07, pages 271--288, Berlin, Heidelberg, 2007. Springer-Verlag.
[43]
PCB Piezotronics. ICP Impact Hammer, 2015.
[44]
Jeffrey D Poston, R Michael Buehrer, and Pablo A Tarazaga. A framework for occupancy tracking in a building via structural dynamics sensing of footstep vibrations. Frontiers in Built Environment, 3:65, 2017.
[45]
Nishkam Ravi, Nikhil Dandekar, Preetham Mysore, and Michael L Littman. Activity recognition from accelerometer data. In Aaai, volume 5, pages 1541--1546, 2005.
[46]
Bruce Richardson, Krispin Leydon, Mikael Fernstrom, and Joseph A Paradiso. Z-tiles: building blocks for modular, pressure-sensing floorspaces. In CHI'04 extended abstracts on Human factors in computing systems, pages 1529--1532, 2004.
[47]
Whitten L Schulz, Joel Pascal Conte, Eric Udd, and John M Seim. Static and dynamic testing of bridges and highways using long-gage fiber bragg grating based strain sensors. In Industrial Sensing Systems, volume 4202, pages 79--86. International Society for Optics and Photonics, 2000.
[48]
Erich P. Stuntebeck, Shwetak N. Patel, Thomas Robertson, Matthew S. Reynolds, and Gregory D. Abowd. Wideband powerline positioning for indoor localization. In Proceedings of the 10th International Conference on Ubiquitous Computing, UbiComp '08, pages 94--103, New York, NY, USA, 2008. ACM.
[49]
Saiganesh Swaminathan, Kadri Bugra Ozutemiz, Carmel Majidi, and Scott E. Hudson. Fiberwire: Embedding electronic function into 3d printed mechanically strong, lightweight carbon fiber composite objects. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, CHI '19, pages 567:1--567:11, New York, NY, USA, 2019. ACM.
[50]
Saiganesh Swaminathan, Michael Rivera, Runchang Kang, Zheng Luo, Kadri Bugra Ozutemiz, and Scott E Hudson. Input, output and construction methods for custom fabrication of room-scale deployable pneumatic structures. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 3(2):62, 2019.
[51]
S Takeda, Y Aoki, T Ishikawa, N Takeda, and H Kikukawa. Structural health monitoring of composite wing structure during durability test. Composite structures, 79(1):133--139, 2007.
[52]
PM Toet, RAJ Hagen, HC Hakkesteegt, J Lugtenburg, and MP Maniscalco. Miniature and low cost fiber bragg grating interrogator for structural monitoring in nano-satellites. In International Conference on Space Optics---ICSO 2014, volume 10563, page 105631E. International Society for Optics and Photonics, 2017.
[53]
Karl Willis, Eric Brockmeyer, Scott Hudson, and Ivan Poupyrev. Printed optics: 3d printing of embedded optical elements for interactive devices. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology, UIST '12, pages 589--598, New York, NY, USA, 2012. ACM.
[54]
Hironori Yoshida, Takeo Igarashi, Yusuke Obuchi, Yosuke Takami, Jun Sato, Mika Araki, Masaaki Miki, Kosuke Nagata, Kazuhide Sakai, and Syunsuke Igarashi. Architecture-scale human-assisted additive manufacturing. ACM Transactions on Graphics (TOG), 34(4):88, 2015.
[55]
Wei Zhang, Junqi Gao, Bin Shi, Heliang Cui, and Hong Zhu. Health monitoring of rehabilitated concrete bridges using distributed optical fiber sensing. Computer-Aided Civil and Infrastructure Engineering, 21(6):411--424, 2006.
[56]
Yang Zhang, Gierad Laput, and Chris Harrison. Vibrosight: Long-range vibrometry for smart environment sensing. In The 31st Annual ACM Symposium on User Interface Software and Technology, pages 225--236. ACM, 2018.
[57]
Yang Zhang, Chouchang Jack Yang, Scott E Hudson, Chris Harrison, and Alanson Sample. Wall++: Room-scale interactive and context-aware sensing. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, page 273. ACM, 2018.
[58]
Zhupeng Zheng and Ying Lei. Structural monitoring techniques for the largest excavation section subsea tunnel: Xiamen xiang'an subsea tunnel. Journal of Aerospace Engineering, 30(2):B4016002, 2017.
[59]
Jesus Zozaya. Voltera: Build hardware faster, 2019.

Cited By

View all
  • (2024)WooDowel: Electrode Isolation for Electromagnetic Shielding in Triboelectric Plywood SensorsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642304(1-17)Online publication date: 11-May-2024
  • (2023)PigSense: Structural Vibration-based Activity and Health Monitoring System for PigsACM Transactions on Sensor Networks10.1145/360480620:1(1-43)Online publication date: 18-Oct-2023
  • (2023)Functional Destruction: Utilizing Sustainable Materials’ Physical Transiency for Electronics ApplicationsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580811(1-16)Online publication date: 19-Apr-2023
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies  Volume 4, Issue 2
June 2020
771 pages
EISSN:2474-9567
DOI:10.1145/3406789
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 June 2020
Published in IMWUT Volume 4, Issue 2

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. embedded sensing
  2. interactive structures
  3. optical fibers

Qualifiers

  • Research-article
  • Research
  • Refereed

Funding Sources

  • NSF

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)222
  • Downloads (Last 6 weeks)34
Reflects downloads up to 18 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2024)WooDowel: Electrode Isolation for Electromagnetic Shielding in Triboelectric Plywood SensorsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642304(1-17)Online publication date: 11-May-2024
  • (2023)PigSense: Structural Vibration-based Activity and Health Monitoring System for PigsACM Transactions on Sensor Networks10.1145/360480620:1(1-43)Online publication date: 18-Oct-2023
  • (2023)Functional Destruction: Utilizing Sustainable Materials’ Physical Transiency for Electronics ApplicationsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580811(1-16)Online publication date: 19-Apr-2023
  • (2023)MM-Tap: Adaptive and Scalable Tap Localization on Ubiquitous Surfaces With mm-Level AccuracyIEEE Internet of Things Journal10.1109/JIOT.2023.328440410:23(20789-20802)Online publication date: 1-Dec-2023
  • (2022)Move With the Theremin: Body Posture and Gesture Recognition Using the Theremin in Loose-Garment With Embedded Textile Cables as AntennasFrontiers in Computer Science10.3389/fcomp.2022.9152804Online publication date: 22-Jun-2022
  • (2022)Environmental physical intelligence: Seamlessly deploying sensors and actuators to our everyday lifeAdjunct Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology10.1145/3526114.3558525(1-5)Online publication date: 29-Oct-2022
  • (2022)iWood: Makeable Vibration Sensor for Interactive PlywoodProceedings of the 35th Annual ACM Symposium on User Interface Software and Technology10.1145/3526113.3545640(1-12)Online publication date: 29-Oct-2022
  • (2022)Strawctures: A Modular Electronic Construction Kit for Human-Scale Interactive StructuresProceedings of the Sixteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3490149.3501322(1-10)Online publication date: 13-Feb-2022
  • (2021)DucoProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/34781185:3(1-25)Online publication date: 14-Sep-2021
  • (2021)MoCapaci: Posture and gesture detection in loose garments using textile cables as capacitive antennasProceedings of the 2021 ACM International Symposium on Wearable Computers10.1145/3460421.3480418(78-83)Online publication date: 21-Sep-2021
  • Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Full Access

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media