research-article

Revealing the invisible: visualizing the location and event flow of distributed physical devices

Authors:

Nicolai Marquardt,

Sheelagh Carpendale,

Saul GreenbergAuthors Info & Claims

TEI '10: Proceedings of the fourth international conference on Tangible, embedded, and embodied interaction

Pages 41 - 48

https://doi.org/10.1145/1709886.1709896

Published: 24 January 2010 Publication History

Abstract

Distributed physical user interfaces comprise networked sensors, actuators and other devices attached to a variety of computers in different locations. Developing such systems is no easy task. It is hard to track the location and status of component devices, even harder to understand, validate, test and debug how events are transmitted between devices, and hardest yet to see if the overall system behaves correctly. Our Visual Environment Explorer supports developers of these systems by visualizing the location and status of individual and/or aggregate devices. It visualizes the current event flow between devices as they are received and transmitted, as well as the event history. Events are displayable at various levels of detail. The visualization also shows the activity of applications that use these physical devices. The tool is highly interactive: developers can explore system behavior through spatial navigation, zooming, multiple simultaneous views, event filtering, details-on-demand, and time-dependent semantic zooming.

References

[1]

Baecker, R., DiGiano, C., and Marcus, A. Software visualization for debugging. Commun. ACM 40, 4, (1997), 44--54.

Digital Library

[2]

Buschmann, C., Pfisterer, D., Fischer, S., Fekete, S.P., and Kroller, A. SpyGlass: a wireless sensor network visualizer. ACM SIGBED Review 2, 1 (2005), 1--6.

Digital Library

[3]

Buxton, W.A.S. Living in Augmented Reality: Ubiquitous Media and Reactive Environments. In K. Finn, A. Sellen and S. Wilber, eds., Video Mediated Communication. Lawrence Erlbaum Associates (1997), 363--384.

[4]

Consolvo, S., Roessler, P., and Shelton, B.E. The CareNet Display: Lessons Learned from an In Home Evaluation of an Ambient Display. Proc. of UbiComp 2004, Springer (2004), 1--17.

[5]

Ducheneaut, N., Smith, T.F., Begole, J.B., Newman, M.W., and Beckmann, C. The Orbital Browser: Composing Ubicomp Services Using Only Rotation and Selection. Ext. Abstracts of CHI 2006, ACM (2006), 321--326.

Digital Library

[6]

Egglestone, S.R., Humble, J., Greenhalgh, C., Rodden, T., and Hampshire, A. The Equator Component Toolkit: Managing Digital Information Flow in the Home. Adj. Proc. of UIST 2006, ACM (2006).

[7]

Fan, F. and Biagioni, E.S. An approach to data visualization and interpretation for sensor networks. Proc. of HICSS 2004, IEEE (2004).

Digital Library

[8]

Fitzmaurice, G.W., Ishii, H., and Buxton, W.A.S. Bricks: Laying the Foundations for Graspable User Interfaces. Proc. of CHI 1995, ACM (1995), 442--449.

Digital Library

[9]

Girod, L., Stathopoulos, T., Ramanathan, N., et al. A system for simulation, emulation, and deployment of heterogeneous sensor networks. Proc. of 2nd int. Conf. on Embedded Networked Sensor Systems, ACM (2004), 201--213.

Digital Library

[10]

Greenberg, S. and Fitchett, C. Phidgets: Easy Development of Physical Interfaces Through Physical Widgets. Proc. of UIST 2001, ACM (2001), 209--218.

Digital Library

[11]

Gross, T. and Marquardt, N. CollaborationBus: An Editor for the Easy Configuration of Ubiquitous Computing Environments. Proc. of PDP 2007, IEEE (2007), 307--314.

Digital Library

[12]

Hartmann, B., Klemmer, S.R., and Bernstein, M.d. tools: Integrated prototyping for physical interaction design. IEEE Pervasive Computing, (2005).

[13]

Hudson, S.E. and Mankoff, J. Rapid Construction of Functioning Physical Interfaces from Cardboard, Thumbtacks, Tin Foil and Masking Tape. Proc. of UIST 2006, ACM (2006), 289--298.

Digital Library

[14]

Ishii, H. and Ullmer, B. Tangible Bits: Towards Seamless Interfaces Between People, Bits and Atoms. Proc. of CHI 1997, ACM (1997), 234--241.

Digital Library

[15]

Klemmer, S.R., Li, J., Lin, J., and Landay, J.A. Papier-Mache: Toolkit Support for Tangible Input. Proc. of CHI 2004, ACM (2004), 399--406.

Digital Library

[16]

Marquardt, N. and Greenberg, S. Distributed Physical Interfaces with Shared Phidgets. Proc. of TEI 2007, ACM (2007), 13--20.

Digital Library

[17]

Morris, M.R. Visualization for Casual Debugging and System Awareness in a Ubiquitous Computing Environment. Adj. Proc. of UbiComp 2004.

[18]

Mynatt, E.D., Rowan, J., Jacobs, A., and Craighill, S. Digital Family Portraits: Supporting Peace of Mind for Extended Family Members. Proc. of CHI 2001, ACM (2001), 333--340.

Digital Library

[19]

Nath, S., Liu, J., and Zhao, F. Challenges in building a portal for sensors world-wide. First Workshop on World-Sensor-Web: Mobile Device Centric Sensory Networks and Applications (WSW), (2006).

[20]

Ndumu, D.T., Nwana, H.S., Lee, L.C., and Collis, J.C. Visualising and debugging distributed multi-agent systems. Proc. of the third annual conf. on Autonomous Agents, ACM (1999), 326--333.

Digital Library

[21]

Ringel, M., Tyler, J., Stone, M., Ballagas, R., and Borchers, J. iStuff: A Scalable Architecture for Lightweight, Wireless Devices for Ubicomp User Interfaces. Proc. of UbiComp 2002, Springer (2002).

[22]

Salber, D., Dey, A.K., and Abowd, G.D. The Context Toolkit: Aiding the Development of Context-Enabled Applications. Proc. of CHI 1999, ACM (1999), 434--441.

Digital Library

[23]

Santanche, A., Nath, S., Liu, J., Priyantha, B., and Zhao, F. SenseWeb: Browsing the Physical World in Real Time. Proc. of IPSN 2006, ACM/IEEE (2006).

[24]

Villar, N. and Gellersen, H. A Malleable Control Structure for Softwired User Interfaces. Proc. of TEI 2007, ACM (2007), 49--56.

Digital Library

[25]

Weiser, M. The Computer for the 21st Century. Scientific American 265, (1991), 94.

[26]

Wendlandt, D., Casado, M., Tarjan, P., and McKeown, N. The Clack graphical router: visualizing network software. Proc. of the 2006 ACM Symposium on Software Visualization, ACM (2006), 7--15.

Digital Library

Cited By

Fournier FSkarbovsky I(2019)Enriching Smart Contracts with Temporal AspectsBlockchain – ICBC 201910.1007/978-3-030-23404-1_9(126-141)Online publication date: 19-Jun-2019
https://doi.org/10.1007/978-3-030-23404-1_9
McGrath WWarner JKarchemsky MHead ADrew DHartmann BBaudisch PSchmidt AWilson A(2018)WiFröstProceedings of the 31st Annual ACM Symposium on User Interface Software and Technology10.1145/3242587.3242668(447-455)Online publication date: 11-Oct-2018
https://dl.acm.org/doi/10.1145/3242587.3242668
Mayton BDublon GRussell SLynch EHaddad DRamasubramanian VDuhart CDavenport GParadiso J(2017)The networked sensory landscapePresence: Teleoperators and Virtual Environments10.1162/PRES_a_0029226:2(182-209)Online publication date: 1-May-2017
https://dl.acm.org/doi/10.1162/PRES_a_00292
Show More Cited By

Index Terms

Revealing the invisible: visualizing the location and event flow of distributed physical devices
1. Human-centered computing
  1. Interaction design
    1. Interaction design process and methods
      1. Interface design prototyping
2. Software and its engineering
  1. Software notations and tools
    1. Development frameworks and environments

Recommendations

The Revealing Flashlight: Interactive Spatial Augmented Reality for Detail Exploration of Cultural Heritage Artifacts
Special Issue on Interacting with the Past

Cultural heritage artifacts often contain details that are difficult to distinguish due to aging effects such as erosion. We propose the revealing flashlight, a new interaction and visualization technique in spatial augmented reality that helps to ...
Towards automated analysis and visualization of distributed software systems
SOFTVIS '10: Proceedings of the 5th international symposium on Software visualization

This paper sketches one approach to facilitate comprehension of distributed software systems. These systems gain more and more importance due to a paradigm shift in software systems and applications, evolving from single-chip solutions to multi-tiered ...
Towards a Generic Architecture for Interactive Cost-Aware Visualization of Monitoring Data in Distributed Systems
SHCIS '17: Proceedings of the 4th Workshop on Security in Highly Connected IT Systems

The collection of monitoring data in distributed systems can serve many different purposes, such as system status monitoring, performance evaluation, and optimization. There are many well-established approaches for data collection and visualization in ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

TEI '10: Proceedings of the fourth international conference on Tangible, embedded, and embodied interaction

January 2010

414 pages

ISBN:9781605588414

DOI:10.1145/1709886

Conference Chairs:
Marcelo Coelho
MIT Media Lab
,
Jamie Zigelbaum
MIT Media Lab, Oblong Industries
,
General Chairs:
Hiroshi Ishii
MIT Media Lab
,
Robert J.K. Jacob
Tufts University
,
Pattie Maes
MIT Media Lab
,
Program Chairs:
Thomas Pederson
IT University of Copenhagen
,
Orit Shaer
Wellesley College
,
Ron Wakkary
Simon Fraser University

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 January 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

TEI '10

Sponsor:

SIGCHI

TEI '10: Fourth International Conference on Tangible, Embedded, and Embodied Interaction

January 24 - 27, 2010

Massachusetts, Cambridge, USA

Acceptance Rates

Overall Acceptance Rate 393 of 1,367 submissions, 29%

Upcoming Conference

TEI '25

Sponsor:
sigchi

Nineteenth International Conference on Tangible, Embedded, and Embodied Interaction

March 4 - 7, 2025

Bordeaux / Talence , France

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
394
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)0

Reflects downloads up to 26 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Fournier FSkarbovsky I(2019)Enriching Smart Contracts with Temporal AspectsBlockchain – ICBC 201910.1007/978-3-030-23404-1_9(126-141)Online publication date: 19-Jun-2019
https://doi.org/10.1007/978-3-030-23404-1_9
McGrath WWarner JKarchemsky MHead ADrew DHartmann BBaudisch PSchmidt AWilson A(2018)WiFröstProceedings of the 31st Annual ACM Symposium on User Interface Software and Technology10.1145/3242587.3242668(447-455)Online publication date: 11-Oct-2018
https://dl.acm.org/doi/10.1145/3242587.3242668
Mayton BDublon GRussell SLynch EHaddad DRamasubramanian VDuhart CDavenport GParadiso J(2017)The networked sensory landscapePresence: Teleoperators and Virtual Environments10.1162/PRES_a_0029226:2(182-209)Online publication date: 1-May-2017
https://dl.acm.org/doi/10.1162/PRES_a_00292
Etzion OFournier FSkarbovsky Ivon Halle BGal AWeidlich MKalogeraki VVenkasubramanian N(2016)A model driven approach for event processing applicationsProceedings of the 10th ACM International Conference on Distributed and Event-based Systems10.1145/2933267.2933268(81-92)Online publication date: 13-Jun-2016
https://dl.acm.org/doi/10.1145/2933267.2933268
Aksenov PLuyten KConinx K(2012)O brother, where art thou located?Journal of Location Based Services10.1080/17489725.2012.6820986:4(211-233)Online publication date: 1-Dec-2012
https://dl.acm.org/doi/10.1080/17489725.2012.682098
Israel JBelaifa OGispen AStark RGross MNunes NDo EBrewster SOakley I(2011)An object-centric interaction framework for tangible interfaces in virtual environmentsProceedings of the fifth international conference on Tangible, embedded, and embodied interaction10.1145/1935701.1935777(325-332)Online publication date: 22-Jan-2011
https://dl.acm.org/doi/10.1145/1935701.1935777
Loke S(2010)Building Intelligent Environments by Adding Smart Artifacts to SpacesProceedings of the 2010 Sixth International Conference on Intelligent Environments10.1109/IE.2010.12(25-28)Online publication date: 18-Jul-2010
https://dl.acm.org/doi/10.1109/IE.2010.12

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents