research-article

SpeckleSense: fast, precise, low-cost and compact motion sensing using laser speckle

Authors:

Ramesh RaskarAuthors Info & Claims

UIST '11: Proceedings of the 24th annual ACM symposium on User interface software and technology

Pages 489 - 498

https://doi.org/10.1145/2047196.2047261

Published: 16 October 2011 Publication History

Abstract

Motion sensing is of fundamental importance for user interfaces and input devices. In applications, where optical sensing is preferred, traditional camera-based approaches can be prohibitive due to limited resolution, low frame rates and the required computational power for image processing. We introduce a novel set of motion-sensing configurations based on laser speckle sensing that are particularly suitable for human-computer interaction. The underlying principles allow these configurations to be fast, precise, extremely compact and low cost. We provide an overview and design guidelines for laser speckle sensing for user interaction and introduce four general speckle projector/sensor configurations. We describe a set of prototypes and applications that demonstrate the versatility of our laser speckle sensing techniques.

Supplementary Material

JPG File (fp421.jpg)

Download
10.78 KB

MP4 File (fp421.mp4)

Download
33.25 MB

References

[1]

3Dconnexion. Space 3d mice. http://www.3dconnexion.com/. July 2011.

[2]

Apple Magic Mouse. http://www.apple.com/magicmouse/. July 2011.

[3]

Avago Technologies. Adns-9500 sensor.http://www.avagotech.com/docs/AV02--1726EN. July 2011.

[4]

Axsotic. 3d-spheric-mouse. http://www.axsotic.com/. July 2011.

[5]

Balakrishnan, R., Baudel, T., Kurtenbach, G., and Fitzmaurice, G. The Rockin' Mouse: Integral 3D Manipulation on a Plane. Proc. CHI '97 (1997), 311--318.

Digital Library

[6]

Bathiche, S. N., and Starkweather, G. K., Data input device for tracking and detecting lift-off from a tracking surface by a reflected laser speckle pattern, U.S. Patent 7,161,582., 200.

[7]

Baudisch, P., Sinclair, M., and Wilson, A., Soap: a pointing device that works in mid-air. Proc. UIST '06 (2006), 43--46.

Digital Library

[8]

Butler, A., Izadi, S., and Hodges, S. SideSight: multi-"touch" interaction around small devices. Proc. UIST '08 (2008), 201--204.

Digital Library

[9]

Dainty, J. C. Laser Speckle and Related Phenomena. Springer-Verlag, Berlin (1984).

[10]

DePue, M. T., Schroeder, D. W., and Xie, T., Optical device that measures distance between the device and a surface, U.S. Patent 7,427,981, 2008.

[11]

1Fitzmaurice, G. W. Situated information spaces and spatially aware palmtop computers. Commun. ACM 36, 7 (Jul. 1993), 39--49.

Digital Library

[12]

Goodman, J. W. Speckle phenomena in Optics: Theory and Applications. Roberts and Company, Englewood, 2007.

[13]

Gyration. Air mouse. http://www.gyration.com/. July 2011.

[14]

Hachet, M., Pouderoux, J., and Guitton, P. A camera-based interface for interaction with mobile handheld computers. Proc. I3D '05 (2005), 65--72.

Digital Library

[15]

Harrison, C. and Hudson, S. E., Abracadabra: wireless, high-precision, and unpowered finger input for very small mobile devices, Proc. UIST '09 (2009), 121--124.

Digital Library

[16]

Harrison, C. and Hudson, S. E., Minput: enabling interaction on small mobile devices with high-precision, low-cost, multipoint optical tracking, Proc. CHI '10 (2010), 1661--1664.

Digital Library

[17]

Hinckley, K., Pierce, J., Sinclair, M., and Horvitz, E. Sensing techniques for mobile interaction. Proc. UIST '00 (2000). 91--100.

Digital Library

[18]

Hinckley, K., Sinclair, M., Hanson, E., Szeliski, R., and Con-way, M. The Videomouse: A Camera-based Multi-degree-of-freedom Input Device. Proc. UIST '99 (1999), 103--112.

Digital Library

[19]

Liao, C.-M., Huang, P. S., Chiu, C.-C., Hwang, Y.-Y., Ma, S.-I. Real-time finger-controlled navigation system using laser speckle patterns, Optical Engineering, Volume 49, Issue 5 (2010).

[20]

Liao, C.-M., Huang, P. S., Hwang, Y.-Y., Chen, M., Chiu, C.-C. Robust technique of analyzing and locating laser speckle patterns for optical computer mice, Optics and Lasers in Engineering, 47, 7--8 (2009), 875--883.

[21]

Logitech. Mx air mouse. http://www.logitech.com/en-us/mice-pointers/mice/devices/3443/. July 2011.

[22]

MacKenzie, S., Soukoreff, R., and Pal, C. A Two-ball Mouse Affords Three Degrees of Freedom. CHI EA '97 (1997) 303--304.

Digital Library

[23]

Mohan, A., Woo, G., Hiura, S., Smithwick, Q., Raskar, R. Bokode: imperceptible visual tags for camera based interaction from a distance. Proc. SIGGRAPH '09 (2009).

Digital Library

[24]

Ni, T. and Baudisch, P., Disappearing mobile devices. Proc. UIST '09 (2009), 101--110.

Digital Library

[25]

Olwal, A. LightSense: Enabling spatially aware handheld inte-raction devices. Proc. ISMAR '06 (2006). 119--122.

Digital Library

[26]

Olwal, A., and Feiner, S. Spatially Aware Handhelds for High-Precision Tangible Interaction with Large Displays. Proc. TEI '09 (2009), 181--188.

Digital Library

[27]

Philips. Laser Doppler technology. http://lasersensors.philips.com/. July 2011.

[28]

Popov, P., Pulov, S., and Pulov, V. A laser speckle pattern technique for designing an optical computer mouse, Optics and Lasers in Engineering, 42, 1 (2004), 21--26.

[29]

PrimeSense. http://www.primesense.com/. July 2011.

[30]

Raskar, R., Nii, H., deDecker, B., Hashimoto, Y., Summet, J., Moore, D., Zhao, Y., Westhues, J., Dietz, P., Barnwell, J., Nayar, S., Inami, M., Bekaert, P., Noland, M., Branzoi, V., and Bruns, E. 2007. Prakash: lighting aware motion capture using photosensing markers and multiplexed illuminators. Proc. SIGGRAPH '07 (2007), Article 36.

Digital Library

[31]

Raskar, R., Welch, G., Cutts, M., Lake, A., Stesin, L., and Fuchs, H. The office of the future: a unified approach to image-based modeling and spatially immersive displays. Proc. SIGGRAPH '98 (1998). 179--188.

Digital Library

[32]

Reilly, D., Rodgers, M., Argue, R., Nunes, M., and Inkpen, K. Marked-up maps: Combining paper maps and electronic information resources. Personal and Ubiquitous Computing, 10, 4 (2006), 215--226.

Digital Library

[33]

Reilly, R. and Hanson, A. Gesture recognition for augmentative human computer interaction, Engineering in Medicine and Biology Society, 2 (1995), 1275--1276.

[34]

Rekimoto, J. and Nagao, K. The world through the computer: Computer augmented interaction with real world environments. Proc. UIST '95 (1995), 29--36.

Digital Library

[35]

Rekimoto, J. Tilting operations for small screen interfaces. Proc. UIST '96 (1996), 167--168.

Digital Library

[36]

Sanneblad, J. and Holmquist, L. E., Ubiquitous graphics: combining hand-held and wall-size displays to interact with large images. Proc. AVI '06 (2006), 373--377.

Digital Library

[37]

Schroeder, D. W., DePue, M. T., Kakarala, R., Xie, T. VanWiggeren, G. D. Tracking motion using an interference pattern, U.S. Patent 7,737,947, 2010.

[38]

Villar, N., Izadi, S., Rosenfeld, D., Benko, H., Helmes, J., Westhues, J., Hodges, S., Ofek, E., Butler, A., Cao, X., and Chen, B. Mouse 2.0: Multi-touch Meets the Mouse. Proc. UIST '09 (2009), 33--42.

Digital Library

[39]

Wang, J. and Canny, J. TinyMotion: camera phone based interaction methods. CHI '06 EA, 339--344, 2006.

Digital Library

[40]

Welch, G. and Foxlin, E. Motion Tracking: No Silver Bullet, but a Respectable Arsenal. Computer Graphics and Applications, 22, 6 (2002), 24--38.

Digital Library

[41]

Wilson, A. and Shafer, S., Xwand: UI for intelligent spaces, in Proc CHI '03 (2003), 545--55.

Digital Library

[42]

Yang, X.-D., Mak, E., McCallum, D., Irani, P., Cao, X., and Izadi, S. Lensmouse: augmenting the mouse with an interactive touch display, Proc. CHI '10 (2010), 2431--2440.

Digital Library

[43]

Yee, K. Peephole displays: Pen interaction on spatially aware hand-held computers. Proc. CHI '03 (2003), 1--8.

Digital Library

Cited By

Zhang PYing WRiggs SHeo S(2024)MoiréTag: A Low-Cost Tag for High-Precision Tangible Interactions without Active ComponentsProceedings of the ACM on Human-Computer Interaction10.1145/36981138:ISS(1-19)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698113
Wang XZhang Y(2024)TextureSightProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314137:4(1-27)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631413
Liu BHuang YSu YWang CWang SWu G(2024)A fast stereo-matching method for a speckle pattern based on grid and gradient constraintsJournal of Modern Optics10.1080/09500340.2024.237544770:19-21(983-994)Online publication date: 8-Jul-2024
https://doi.org/10.1080/09500340.2024.2375447
Show More Cited By

Index Terms

SpeckleSense: fast, precise, low-cost and compact motion sensing using laser speckle
1. Hardware
  1. Communication hardware, interfaces and storage

Recommendations

Mouse 2.0: multi-touch meets the mouse
UIST '09: Proceedings of the 22nd annual ACM symposium on User interface software and technology

In this paper we present novel input devices that combine the standard capabilities of a computer mouse with multi-touch sensing. Our goal is to enrich traditional pointer-based desktop interactions with touch and gestures. To chart the design space, we ...
Pop through mouse button interactions
UIST '01: Proceedings of the 14th annual ACM symposium on User interface software and technology

We present a range of novel interactions enabled by a simple modification in the design of a computer mouse. By converting each mouse button to pop through tactile push-buttons, similar to the focus/shutter-release buttons used in many cameras, users ...
Comparing Touchscreen and Mouse Input Performance by People With and Without Upper Body Motor Impairments
CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

Controlled studies of touchscreen input performance for users with upper body motor impairments remain relatively sparse. To address this gap, we present a controlled lab study of mouse vs. touchscreen performance with 32 participants (16 with upper ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '11: Proceedings of the 24th annual ACM symposium on User interface software and technology

October 2011

654 pages

ISBN:9781450307161

DOI:10.1145/2047196

General Chair:
Jeff Pierce
IBM Research, USA
,
Program Chairs:
Maneesh Agrawala
University of California, Berkeley, USA
,
Scott Klemmer
Stanford University, USA

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 October 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

UIST '11

Sponsor:

UIST '11: The 24th Annual ACM Symposium on User Interface Software and Technology

October 16 - 19, 2011

California, Santa Barbara, USA

Acceptance Rates

UIST '11 Paper Acceptance Rate 67 of 262 submissions, 26%;

Overall Acceptance Rate 561 of 2,567 submissions, 22%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

30
Total Citations
View Citations
1,049
Total Downloads

Downloads (Last 12 months)70
Downloads (Last 6 weeks)12

Reflects downloads up to 18 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zhang PYing WRiggs SHeo S(2024)MoiréTag: A Low-Cost Tag for High-Precision Tangible Interactions without Active ComponentsProceedings of the ACM on Human-Computer Interaction10.1145/36981138:ISS(1-19)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698113
Wang XZhang Y(2024)TextureSightProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314137:4(1-27)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631413
Liu BHuang YSu YWang CWang SWu G(2024)A fast stereo-matching method for a speckle pattern based on grid and gradient constraintsJournal of Modern Optics10.1080/09500340.2024.237544770:19-21(983-994)Online publication date: 8-Jul-2024
https://doi.org/10.1080/09500340.2024.2375447
Min TXia CYamamoto TSugiura Y(2023)Seeing the Wind: An Interactive Mist Interface for Airflow InputProceedings of the ACM on Human-Computer Interaction10.1145/36264807:ISS(398-419)Online publication date: 1-Nov-2023
https://dl.acm.org/doi/10.1145/3626480
Streli PJiang JRossie JHolz C(2023)Structured Light Speckle: Joint Ego-Centric Depth Estimation and Low-Latency Contact Detection via Remote VibrometryProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606749(1-12)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606749
Carver CSchwartz HShao QShade NLazzaro JWang XLiu JFossum EZhou XCosta XHassanieh HAsadi ACox LPerino DWidmer JGiustiniano D(2023)Catch Me If You Can: Demonstrating Laser Tethering with Highly Mobile TargetsProceedings of the 29th Annual International Conference on Mobile Computing and Networking10.1145/3570361.3614081(1-3)Online publication date: 2-Oct-2023
https://dl.acm.org/doi/10.1145/3570361.3614081
Yan ZLin YWang GCai YCao PMi HZhang Y(2023)LaserShoes: Low-Cost Ground Surface Detection Using Laser Speckle ImagingProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581344(1-20)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581344
Zhang TSheinin MChan DRau MO'Toole MNarasimhan S(2023)Analyzing Physical Impacts Using Transient Surface Wave Imaging2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52729.2023.00422(4339-4348)Online publication date: Jun-2023
https://doi.org/10.1109/CVPR52729.2023.00422
Babic TReiterer HHaller M(2022)Understanding and Creating Spatial Interactions with Distant Displays Enabled by Unmodified Off-The-Shelf SmartphonesMultimodal Technologies and Interaction10.3390/mti61000946:10(94)Online publication date: 19-Oct-2022
https://doi.org/10.3390/mti6100094
Sagawa RHiguchi YFurukawa RKawasaki H(2022)Acquisition and Visualization of Micro-Vibration of a Sound Wave in 3D SpaceJournal of Robotics and Mechatronics10.20965/jrm.2022.p102434:5(1024-1032)Online publication date: 20-Oct-2022
https://doi.org/10.20965/jrm.2022.p1024
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents