Article

Synchronous gestures for multiple persons and computers

Author:

Ken HinckleyAuthors Info & Claims

UIST '03: Proceedings of the 16th annual ACM symposium on User interface software and technology

Pages 149 - 158

https://doi.org/10.1145/964696.964713

Published: 02 November 2003 Publication History

Abstract

This research explores distributed sensing techniques for mobile devices using synchronous gestures. These are patterns of activity, contributed by multiple users (or one user with multiple devices), which take on a new meaning when they occur together in time, or in a specific sequence in time. To explore this new area of inquiry, this work uses tablet computers augmented with touch sensors and two-axis linear accelerometers (tilt sensors). The devices are connected via an 802.11 wireless network and synchronize their time-stamped sensor data. This paper describes a few practical examples of interaction techniques using synchronous gestures such as dynamically tiling together displays by physically bumping them together, discusses implementation issues, and speculates on further possibilities for synchronous gestures.

Supplementary Material

WMV File (p149-hinckley_512k.wmv)

Download
3.74 MB

Medium Resolution (p149-hinckley_512k.mov)

Download
10.56 MB

Low Resolution (p149-hinckley_56k.mov)

Download
874.40 KB

High Resolution (p149-hinckley_768k.mov)

Download
16.79 MB

References

[1]

1. Analog Devices Inc., Low-Cost +/-2g Dual-Axis Accelerometer with Duty Cycle Output, http:// www.analog.com/UploadedFiles/Datasheets/ 567227477ADXL202E_a.pdf, 2002.

[2]

2. Ayatsuka, Y., Matsushita, N., Rekimoto, J., HyperPalette: a Hybrid Computing Environment for Small Computing Devices, CHI 2000 Extended Abstracts, 2000, 133-134.

Digital Library

[3]

3. Bahl, P., Padmanabhan, V., RADAR: An In-Building RF-Based User Location and Tracking System, IEEE 19th Annual Joint Conference of the IEEE Computer and Communications Societies (INFOCOM 2000), 775-784.

[4]

4. Baxter, L.K., Capacitive Sensors: Design and Applications. IEEE Press Series on Electronics Technology, ed. R.J. Herrick. 1997, New York: The Institute of Electrical and Electronics Engineers.

[5]

5. Buxton, W., Chunking and Phrasing and the Design of Human-Computer Dialogues, Information Processing '86, Proc. of the IFIP 10th World Computer Congress, 1986: Amsterdam: North Holland Publishers, 475-480.

[6]

6. Chen, J.C., Yip, L., Wang, H., Maniezzo, D., Hudson, R.E., Elson, J., Yao, K., Estrin, D., DSP Implementation of a Distributed Acoustical Beamformer on a Wireless Sensor Platform, Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2003), 2003, Hong Kong, China.

[7]

7. Choudhury, T., Pentland, A., The Sociometer: A Wearable Device for Understanding Human Networks, Conference on Computer Supported Cooperative Work (Workshop: Ad hoc Communications and Collaboratin in Ubiquitous Computing Environments), 2002.

[8]

8. Dannenberg, R., Aura as a Platform for Distributed Sensing and Control, Symposium on Sensing and Input for Media-Centric Systems (SIMS 02), 2002, University of Santa Barbara: Center for Research in Electronic Art Technology.

[9]

9. Dey, A., Abowd, G., Salber, D., A Conceptual Framework and a Toolkit for Supporting the Rapid Prototyping of Context-Aware Applications. Journal of Human-Computer Interaction, 2001. 16(2-4): p. 97-166.

Digital Library

[10]

10. Dourish, P., Bly, S., Portholes: Supporting Awareness in a Distributed Work Group, Proc. CHI'92, 1992, 541-547.

Digital Library

[11]

11. Elson, J., Girod, L., Estrin, D., Fine-Grained Network Time Synchronization using Reference Broadcasts, Proc. Fifth Symposium on Operating Systems Design and Implementation (OSDI 2002), 2002, Boston, MA.

Digital Library

[12]

12. Gorbet, M., Orth, M., Ishii, H., Triangles: Tangible Interface for Manipulation and Exploration of Digital Information Topography, Proc. CHI'98 Conference on Human Factors in Computing Systems, 1998, 49-56.

Digital Library

[13]

13. Grudin, J., Partitioning Digital Worlds: Focal and Peripheral Awareness in Multiple Monitor Use, CHI 2001, 2001, 458-465.

Digital Library

[14]

14. Harrison, B., Fishkin, K., Gujar, A., Mochon, C., Want, R., Squeeze Me, Hold Me, Tilt Me! An Exploration of Manipulative User Interfaces, Proc. ACM CHI'98 Conf. on Human Factors in Computing Systems, 1998, 17-24.

Digital Library

[15]

15. Hinckley, K., Distributed and Local Sensing Techniques for Face-to-Face Collaboration, ICMI-PUI'03 Fifth International Conference on Multimodal Interfaces, 2003, Vancouver B.C., Canada.

Digital Library

[16]

16. Hinckley, K., Pierce, J., Sinclair, M., Horvitz, E., Sensing Techniques for Mobile Interaction, ACM UIST 2000 Symp. on User Interface Software & Technology, 2000, 91-100.

Digital Library

[17]

17. Hinckley, K., Sinclair, M., Touch-Sensing Input Devices, ACM CHI'99 Conf. on Human Factors in Computing Systems, 1999, 223-230.

Digital Library

[18]

18. Holmquist, L., Mattern, F., Schiele, B., Alahuhta, P., Beigl, M., Gellersen, H., Smart-Its Friends: A Technique for Users to Easily Establish Connections between Smart Artefacts, Ubicomp 2001, 2001: Springer-Verlag, 116-122.

Digital Library

[19]

19. Horvitz, E., Kadie, C., Paek, T., Hovel, D., Models of Attention in Computing and Communications: From Principles to Applications. Comm. of the ACM, 2003. 46(3).

Digital Library

[20]

20. Jiang, H., Kessler, D., Nonnemaker, J., DEMIS: A Dynamic Event Model for Interactive Systems, Proc. ACM Symposium on Virtual Reality Software and Technology (VRST 2002).

Digital Library

[21]

21. Johanson, B., Fox, A., The Event Heap: A Coordination Infrastructure for Interactive Workspaces, Proc. of the 4th IEEE Workshop on Mobile Computer Systems and Applications (WMCSA-2002), 2002, Callicoon, New York.

Digital Library

[22]

22. Pierce, J., Mahaney, H., Abowd, G., Opportunistic Annexing for Handheld Devices: Opportunities and Challenges, Tech Report #GIT-GVU-03-31, 2003. http://www.cc.gatech.edu/ gvu/research/techreports.html.

[23]

23. Rekimoto, J., Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments, UIST'97 Symp. on User Interface Software & Technology, 31-39.

Digital Library

[24]

24. Schilit, B.N., Adams, N.I., Want, R., Context-Aware Computing Applications, Proc. IEEE Workshop on Mobile Computing Systems and Applications, 1994, Santa Cruz, CA: IEEE Computer Society, 85-90.

[25]

25. Tandler, P., Prante, T., Müller-Tomfelde, C., Streitz, N., Steinmetz, R., Connectables: dynamic coupling of displays for the flexible creation of shared workspaces, UIST 2001, 11-20.

Digital Library

Cited By

Zhang MMarin ERyan MKostakos VMurray TTag BOswald D(2024)OOBKey: Key Exchange with Implantable Medical Devices Using Out-Of-Band ChannelsProceedings of the 19th International Conference on Availability, Reliability and Security10.1145/3664476.3670876(1-13)Online publication date: 30-Jul-2024
https://dl.acm.org/doi/10.1145/3664476.3670876
Vanderdonckt JVatavu RSluÿters A(2024)Engineering Touchscreen Input for 3-Way Displays: Taxonomy, Datasets, and ClassificationCompanion Proceedings of the 16th ACM SIGCHI Symposium on Engineering Interactive Computing Systems10.1145/3660515.3661331(57-65)Online publication date: 24-Jun-2024
https://dl.acm.org/doi/10.1145/3660515.3661331
Gryphon KVu VChung H(2023)A Design Space of Multi-Display Spatial Interactions for Visualization TasksProceedings of the 2023 ACM Symposium on Spatial User Interaction10.1145/3607822.3614516(1-13)Online publication date: 13-Oct-2023
https://dl.acm.org/doi/10.1145/3607822.3614516
Show More Cited By

Index Terms

Synchronous gestures for multiple persons and computers

Recommendations

HandSense: discriminating different ways of grasping and holding a tangible user interface
TEI '09: Proceedings of the 3rd International Conference on Tangible and Embedded Interaction

As mobile and tangible devices are getting smaller and smaller it is desirable to extend the interaction area to their whole surface area. The HandSense prototype employs capacitive sensors for detecting when it is touched or held against a body part. ...
The UnMousePad: an interpolating multi-touch force-sensing input pad
SIGGRAPH '09: ACM SIGGRAPH 2009 papers

Recently, there has been great interest in multi-touch interfaces. Such devices have taken the form of camera-based systems such as Microsoft Surface [de los Reyes et al. 2007] and Perceptive Pixel's FTIR Display [Han 2005] as well as hand-held devices ...
Investigating mid-air gestures and handhelds in motion tracked environments
PerDis '16: Proceedings of the 5th ACM International Symposium on Pervasive Displays

Smart spaces with multiple interactive devices and motion tracking capabilities are becoming more common. However, there is little research on how interaction with one device affects the usage of other devices in the space. We investigate the effects of ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '03: Proceedings of the 16th annual ACM symposium on User interface software and technology

November 2003

220 pages

ISBN:1581136366

DOI:10.1145/964696

Copyright © 2003 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques
SMART Technologies Inc.
Nokia
ACM: Association for Computing Machinery
Intel Research
SIGCHI: ACM Special Interest Group on Computer-Human Interaction
New Media Innovation Centre
Pacific Northwest National Laboratory

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 November 2003

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

UIST03

Sponsor:

UIST03: 16th Annual ACM Symposium on User Interface Software and Technology

November 2 - 5, 2003

Vancouver, Canada

Acceptance Rates

UIST '03 Paper Acceptance Rate 25 of 116 submissions, 22%;

Overall Acceptance Rate 561 of 2,567 submissions, 22%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

220
Total Citations
View Citations
2,866
Total Downloads

Downloads (Last 12 months)50
Downloads (Last 6 weeks)2

Reflects downloads up to 21 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zhang MMarin ERyan MKostakos VMurray TTag BOswald D(2024)OOBKey: Key Exchange with Implantable Medical Devices Using Out-Of-Band ChannelsProceedings of the 19th International Conference on Availability, Reliability and Security10.1145/3664476.3670876(1-13)Online publication date: 30-Jul-2024
https://dl.acm.org/doi/10.1145/3664476.3670876
Vanderdonckt JVatavu RSluÿters A(2024)Engineering Touchscreen Input for 3-Way Displays: Taxonomy, Datasets, and ClassificationCompanion Proceedings of the 16th ACM SIGCHI Symposium on Engineering Interactive Computing Systems10.1145/3660515.3661331(57-65)Online publication date: 24-Jun-2024
https://dl.acm.org/doi/10.1145/3660515.3661331
Gryphon KVu VChung H(2023)A Design Space of Multi-Display Spatial Interactions for Visualization TasksProceedings of the 2023 ACM Symposium on Spatial User Interaction10.1145/3607822.3614516(1-13)Online publication date: 13-Oct-2023
https://dl.acm.org/doi/10.1145/3607822.3614516
Azim MRahman AHeo S(2023)UnifiedSense: Enabling Without-Device Gesture Interactions Using Over-the-shoulder Training Between Redundant Wearable SensorsProceedings of the ACM on Human-Computer Interaction10.1145/36042777:MHCI(1-25)Online publication date: 13-Sep-2023
https://dl.acm.org/doi/10.1145/3604277
Kühn RKegel KKallenbach FKorzetz MAßmann USchlegel T(2023)Mobile Device-Based Interactions for Collocated Direct Voting in Collaborative ScenariosLearning and Collaboration Technologies10.1007/978-3-031-34550-0_37(520-537)Online publication date: 9-Jun-2023
https://doi.org/10.1007/978-3-031-34550-0_37
Homaeian LWallace JScott S(2022)Handoff and Deposit: Designing Temporal Coordination in Cross-Device Transfer Techniques for Mixed-Focus CollaborationProceedings of the ACM on Human-Computer Interaction10.1145/35551926:CSCW2(1-23)Online publication date: 11-Nov-2022
https://dl.acm.org/doi/10.1145/3555192
Yan ZZhou JWu YLiu GLuo DZhou ZMi HSun LChen XTao YZhang YWang G(2022)Shoes++Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35346206:2(1-29)Online publication date: 7-Jul-2022
https://dl.acm.org/doi/10.1145/3534620
Shi CXie LWang CYang PSong YLu S(2021)Just Shake Them Together: Imitation-Resistant Secure Pairing of Smart Devices via ShakingWireless Communications and Mobile Computing10.1155/2021/66684782021(1-15)Online publication date: 2-Apr-2021
https://doi.org/10.1155/2021/6668478
Marquardt NHenry Riche NHolz CRomat HPahud MBrudy FLedo DPark CNicholas MSeyed TOfek ELee BBuxton WHinckley K(2021)AirConstellations: In-Air Device Formations for Cross-Device Interaction via Multiple Spatially-Aware ArmaturesThe 34th Annual ACM Symposium on User Interface Software and Technology10.1145/3472749.3474820(1252-1268)Online publication date: 10-Oct-2021
https://dl.acm.org/doi/10.1145/3472749.3474820
Nguyen NZuniga AFlores HLee HPerrault SNurmi P(2021)Intelligent Shifting Cues: Increasing the Awareness of Multi-Device Interaction OpportunitiesProceedings of the 29th ACM Conference on User Modeling, Adaptation and Personalization10.1145/3450613.3456839(213-223)Online publication date: 21-Jun-2021
https://dl.acm.org/doi/10.1145/3450613.3456839
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents