research-article

A magic lens for revealing device interactions in smart environments

Authors:

Yassin N. Hassan,

Gábor SörösAuthors Info & Claims

SA '14: SIGGRAPH Asia 2014 Mobile Graphics and Interactive Applications

Article No.: 9, Pages 1 - 6

https://doi.org/10.1145/2669062.2669077

Published: 24 November 2014 Publication History

Abstract

Keeping track of device interactions in smart environments is a challenging task for everyday users. Given the expected high number of communicating devices in future smart homes, it will become increasingly important to put users more in control of their smart environments by providing tools to monitor and control the interactions between smart objects and remote services. We present a system for collecting and visualizing interactions ofWeb-enabled smart things andWeb services in an intuitive and visually appealing way. Our tool displays device interactions both using a Web-based visualization application and in the form of a "magic lens" by augmenting the camera view of a tablet with relevant connections between recognized devices in the camera's field of view.

References

[1]

Bay, H., Ess, A., Tuytelaars, T., and Van Gool, L. 2008. Speeded-Up Robust Features (SURF). Computer Vision and Image Understanding 110, 3, 346--359.

Digital Library

[2]

Beckel, C., Sadamori, L., and Santini, S. 2013. Automatic Socio-Economic Classification of Households Using Electricity Consumption Data. In Proceedings of the 4th International Conference on Future Energy Systems (ACM e-Energy 2013), ACM.

Digital Library

[3]

Bier, E. A., Stone, M. C., Pier, K., Buxton, W., and DeRose, T. D. 1993. Toolglass and Magic Lenses: The See-through Interface. In Proceedings of the 20th Annual Conference on Computer Graphics and Interactive Techniques, ACM, SIGGRAPH '93, 73--80.

Digital Library

[4]

Brush, A. J., Lee, B., Mahajan, R., Agarwal, S., Saroiu, S., and Dixon, C. 2011. Home Automation in theWild: Challenges and Opportunities. In Proceedings of the ACM CHI Conference on Human Factors in Computing Systems (Vancouver, Canada), ACM, 2115--2124.

Digital Library

[5]

Csurka, G., Dance, C. R., Fan, L., Willamowski, J., and Bray, C. 2004. Visual Categorization with Bags of Keypoints. In Proceedings of the Workshop on Statistical Learning in Computer Vision (SLCV).

[6]

Dötzer, F. 2006. Privacy Issues in Vehicular Ad Hoc Networks. In Privacy Enhancing Technologies, G. Danezis and D. Martin, Eds., vol. 3856 of Lecture Notes in Computer Science. Springer Berlin Heidelberg, 197--209.

Digital Library

[7]

Ester, M., Kriegel, H.-P., Sander, J., and Xu, X. 1996. A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise. In KDD, 226--231.

[8]

Grinter, R. E., Edwards, W. K., Newman, M. W., and Ducheneaut, N. 2005. The Work to Make a Home Network Work. In Proceedings of the ninth conference on European Conference on Computer Supported Cooperative Work, 469--488.

Digital Library

[9]

Karavirta, V., Korhonen, A., Malmi, L., and Naps, T. L. 2010. A Comprehensive Taxonomy of Algorithm Animation Languages. J. Vis. Lang. Comput. 21, 1, 1--22.

Digital Library

[10]

Keith Mitchell, Nicholas J. P. Race, M. C. 2005. CANVIS: context-aware network visualization using smartphones. In Proceedings of the 7th Conference on Human-Computer Interaction with Mobile Devices and Services (Mobile HCI 2005).

Digital Library

[11]

Kleiminger, W., Beckel, C., and Santini, S. 2011. Opportunistic Sensing for Efficient Energy Usage in Private Households. In Proceedings of the Smart Energy Strategies Conference 2011.

[12]

Kovatsch, M., Mayer, S., and Ostermaier, B. 2012. Moving Application Logic from the Firmware to the Cloud: Towards the Thin Server Architecture for the Internet of Things. In Proceedings of the 6th International Conference on Innovative Mobile and Internet Services in Ubiquitous Computing (IMIS 2012).

Digital Library

[13]

Lastra, J. L. M., and Delamer, I. M. 2006. Semantic Web Services in Factory Automation: Fundamental Insights and Research Roadmap. IEEE Transactions on Industrial Informatics 2, 1, 1--11.

[14]

Mattern, F. 1989. Virtual Time and Global States of Distributed Systems. In Proc. Workshop on Parallel and Distributed Algorithms, North-Holland, C. M. et al., Ed., 215--226.

[15]

Mayer, S., Beckel, C., Scheidegger, B., Barthels, C., and Sörös, G. 2012. Demo: Uncovering Device Whispers in Smart Homes. In Proceedings of the 11th International Conference on Mobile and Ubiquitous Multimedia (MUM 2012).

Digital Library

[16]

Mayer, S., Guinard, D., and Trifa, V. 2012. Searching in a Web-based Infrastructure for Smart Things. In Proceedings of the 3rd International Conference on the Internet of Things (IoT), IEEE Computer Society, 119--126.

[17]

Mayer, S., Inhelder, N., Verborgh, R., de Walle, R. V., and Mattern, F. 2014. Configuration of Smart Environments Made Simple - Combining Visual Modeling with Semantic Metadata and Reasoning. In Proceedings of the 4th IEEE International Conference on the Internet of Things (IoT 2014).

[18]

Minarik, P., and Dymacek, T. 2008. NetFlow Data Visualization Based on Graphs. In Proceedings of the 5th International Workshop on Visualization for Computer Security, Springer, 144--151.

Digital Library

[19]

Poole, E. S., Chetty, M., Grinter, R. E., and Edwards, W. K. 2008. More Than Meets the Eye: Transforming the User Experience of Home Network Management. In Proceedings of the 7th ACM Conference on Designing Interactive Systems (DIS 2008), ACM, 455--464.

Digital Library

[20]

Price, B. A., Baecker, R. M., and Small, I. S. 1993. A Principled Taxonomy of Software Visualization. J. Vis. Lang. Comput. 4, 3, 211--266.

[21]

Randall, D. 2003. Living Inside a Smart Home: A Case Study. In Inside the Smart Home, R. Harper, Ed. Springer, 227--246.

[22]

Rial, A., and Danezis, G. 2011. Privacy-preserving smart metering. In Proceedings of the 10th Annual ACM Workshop on Privacy in the Electronic Society (WPES 2011), ACM, 49--60.

Digital Library

[23]

Röcker, C., Janse, M. D., Portolan, N., and Streitz, N. 2005. User Requirements for Intelligent Home Environments: A Scenario-Driven Approach and Empirical Cross-Cultural Study. In Proceedings of the 2005 Joint Conference on Smart Objects and Ambient Intelligence: Innovative Context-aware Services: Usages and Technologies, ACM, 111--116.

Digital Library

[24]

Rosten, E., and Drummond, T. 2006. Machine Learning for High-Speed Corner Detection. In Proceedings of the 9th European Conference on Computer Vision (ECCV 2006), Lecture Notes in Computer Science. Springer, May, 430--443.

Digital Library

[25]

Schall, G., Zollmann, S., and Reitmayr, G. 2013. Smart Vidente: advances in mobile augmented reality for interactive visualization of underground infrastructure. Personal and Ubiquitous Computing 17, 7, 1533--1549

Digital Library

Cited By

Strecker JAkhunov KCarbone FGarcía KBektaş KGomez AMayer SYildirim K(2023)MR Object Identification and InteractionProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36108797:3(1-26)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3610879
Schenkluhn MPeukert CWeinhardt C(2023)Augmented Reality-based Indoor Positioning for Smart Home AutomationsExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585745(1-6)Online publication date: 19-Apr-2023
https://doi.org/10.1145/3544549.3585745
Jha SMayer SGarcia K(2023)Actionable Contextual Explanations for Cyber-Physical Systems2023 IEEE 22nd International Conference on Trust, Security and Privacy in Computing and Communications (TrustCom)10.1109/TrustCom60117.2023.00255(1879-1886)Online publication date: 1-Nov-2023
https://doi.org/10.1109/TrustCom60117.2023.00255
Show More Cited By

Index Terms

A magic lens for revealing device interactions in smart environments

Recommendations

Magic lenses for revealing device interactions in smart environments (demo abstract)
SA '14: SIGGRAPH Asia 2014 Mobile Graphics and Interactive Applications

We present a tool for visualizing device interactions in smart environments as a magic lens by augmenting the live camera view of a tablet with relevant connections between recognized devices in the camera's field of view.
Semantic metadata to support device interaction in smart environments
UbiComp '13 Adjunct: Proceedings of the 2013 ACM conference on Pervasive and ubiquitous computing adjunct publication

Facilitating the interaction of human users and machines with smart devices is important to drive the successful adoption of the Internet of Things in people's homes and at their workplaces. In this paper, we present a system that helps users control ...
Embedded semantic metadata to support device interaction in smart environments
UbiComp '13 Adjunct: Proceedings of the 2013 ACM conference on Pervasive and ubiquitous computing adjunct publication

Facilitating the interaction of human users and machines with smart devices is important to drive the successful adoption of the Internet of Things in people's homes and at their workplaces. In this poster contribution, we present an approach to support ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

SA '14: SIGGRAPH Asia 2014 Mobile Graphics and Interactive Applications

November 2014

80 pages

ISBN:9781450318914

DOI:10.1145/2669062

Copyright © 2014 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 November 2014

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Swiss National Science Foundation

Conference

SA'14

SA'14: SIGGRAPH Asia 2014

December 3 - 6, 2014

Shenzhen, China

Acceptance Rates

Overall Acceptance Rate 178 of 869 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

19
Total Citations
View Citations
327
Total Downloads

Downloads (Last 12 months)19
Downloads (Last 6 weeks)1

Reflects downloads up to 24 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Strecker JAkhunov KCarbone FGarcía KBektaş KGomez AMayer SYildirim K(2023)MR Object Identification and InteractionProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36108797:3(1-26)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3610879
Schenkluhn MPeukert CWeinhardt C(2023)Augmented Reality-based Indoor Positioning for Smart Home AutomationsExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585745(1-6)Online publication date: 19-Apr-2023
https://doi.org/10.1145/3544549.3585745
Jha SMayer SGarcia K(2023)Actionable Contextual Explanations for Cyber-Physical Systems2023 IEEE 22nd International Conference on Trust, Security and Privacy in Computing and Communications (TrustCom)10.1109/TrustCom60117.2023.00255(1879-1886)Online publication date: 1-Nov-2023
https://doi.org/10.1109/TrustCom60117.2023.00255
Long YLuo XZhu YLee KWang S(2023)Data Transparency Design in Internet of Things: A Systematic ReviewInternational Journal of Human–Computer Interaction10.1080/10447318.2023.222899740:18(5003-5025)Online publication date: 18-Jul-2023
https://doi.org/10.1080/10447318.2023.2228997
Strecker JGarcía KBektaş KMayer SRamanathan G(2022)SOCRAR: Semantic OCR through Augmented RealityProceedings of the 12th International Conference on the Internet of Things10.1145/3567445.3567453(25-32)Online publication date: 7-Nov-2022
https://dl.acm.org/doi/10.1145/3567445.3567453
Bermejo Fernandez CNurmi PHui PShen HZhuang YSmith JYang YCesar PMetze FPrabhakaran B(2021)Seeing is Believing?Proceedings of the 29th ACM International Conference on Multimedia10.1145/3474085.3475552(4183-4192)Online publication date: 17-Oct-2021
https://dl.acm.org/doi/10.1145/3474085.3475552
Bermejo Fernandez CLee LNurmi PHui P(2021)PARA: Privacy Management and Control in Emerging IoT Ecosystems using Augmented RealityProceedings of the 2021 International Conference on Multimodal Interaction10.1145/3462244.3479885(478-486)Online publication date: 18-Oct-2021
https://dl.acm.org/doi/10.1145/3462244.3479885
Prange SShams APiening RAbdelrahman YAlt FKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)PriView– Exploring Visualisations to Support Users’ Privacy AwarenessProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445067(1-18)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445067
Kaneko KTsutsumi YSharma SOkada Y(2020)PACKUARIUM: Network Packet Visualization Using Mixed Reality for Detecting Bot IoT Device of DDoS AttackAdvances in Internet, Data and Web Technologies10.1007/978-3-030-39746-3_38(361-372)Online publication date: 31-Jan-2020
https://doi.org/10.1007/978-3-030-39746-3_38
Becker VRauchenstein FSörös G(2019)Investigating Universal Appliance Control through Wearable Augmented RealityProceedings of the 10th Augmented Human International Conference 201910.1145/3311823.3311853(1-9)Online publication date: 11-Mar-2019
https://dl.acm.org/doi/10.1145/3311823.3311853
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents