research-article

LensMouse: augmenting the mouse with an interactive touch display

Authors:

Xing-Dong Yang,

David McCallum,

Shahram IzadiAuthors Info & Claims

CHI '10: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 2431 - 2440

https://doi.org/10.1145/1753326.1753695

Published: 10 April 2010 Publication History

Abstract

We introduce LensMouse, a novel device that embeds a touch-screen display -- or tangible 'lens' -- onto a mouse. Users interact with the display of the mouse using direct touch, whilst also performing regular cursor-based mouse interactions. We demonstrate some of the unique capabili-ties of such a device, in particular for interacting with auxil-iary windows, such as toolbars, palettes, pop-ups and dia-log-boxes. By migrating these windows onto LensMouse, challenges such as screen real-estate use and window man-agement can be alleviated. In a controlled experiment, we evaluate the effectiveness of LensMouse in reducing cursor movements for interacting with auxiliary windows. We also consider the concerns involving the view separation that results from introducing such a display-based device. Our results reveal that overall users are more effective with LenseMouse than with auxiliary application windows that are managed either in single or dual-monitor setups. We conclude by presenting other application scenarios that LensMouse could support.

Supplementary Material

JPG File (1753695.jpg)

Download
13.27 KB

JPG File (p2431.jpg)

Download
18.82 KB

index.html (index.html)

Slides from the presentation

Download
.93 KB

MOV File (p2431.mov)

Supplemental video file for "LensMouse: augmenting the mouse with an interactive touch display"

Download
14.87 MB

Audio only (1753695.mp3)

Download
32.55 MB

Video (1753695.mp4)

Download
343.15 MB

References

[1]

Ashdown, M., Oka, K., Sato, Y. (2005). Combining head tracking and mouse input for a GUI on multiple monitors. CHI Extended Abstracts, 1188--1191.

Digital Library

[2]

Asano, T., Sharlin, E., Kitamura, Y., Takashima, K., and Kishino, F. (2005). Predictive Interaction Using the Delphian desktop. UIST, 133--141.

Digital Library

[3]

Benko, H. and Feiner, S. (2005). Multi-Monitor Mouse. CHI Extended Abstracts, 1208--1211.

Digital Library

[4]

Baudisch, P., Cutrell, E., Hinckley, K., and Gruen, R. (2004). Mouse Ether: Accelerating the Acquisition of Targets Across Multi-Monitor Displays. CHI, 1379--1382.

Digital Library

[5]

Baudisch, P. and Gutwin, C. (2004). Multiblending: displaying overlapping windows simultaneously without the drawbacks of alpha blending. CHI, 367--374.

Digital Library

[6]

Balakrishnan, R. and Patel, P. (1998). The PadMouse: Facilitating selection and spatial positioning for the non-dominant hand. CHI, 9--16.

Digital Library

[7]

Bi, X. and Balakrishnan, R. (2009). Comparing Usage of a Large High-Resolution Display to Single or Dual Desktop Displays for Daily Work. CHI, 1005--1014.

Digital Library

[8]

Bier, E.A., Stone, C.M., Pier, M, Buxton, W., and DeRose, T.D. (1993). Toolglass and Magic Lenses: The See-Through Interface. SIGGRAPH, 73--80.

Digital Library

[9]

Cechanowicz, J., Irani, P., Subramanian, S. (2007). Augmenting the mouse with pressure sensitive input. CHI, 1385--1394

Digital Library

[10]

Chen, N., Guimbretière, F., Dixon, M., Lewis, C., and Agrawala, M. (2008). Navigation Techniques for Dual-Display E-Book Readers. CHI, 1779--1788.

Digital Library

[11]

Dickie, C., Hart, J., Vertegaal, R., and Eiser, A. (2006). LookPoint: an evaluation of eye input for hands-free switching of input devices between multiple computers. OZCHI, 119--126.

Digital Library

[12]

Grudin, J., (2001). Partitioning digital worlds: focal and peripheral awareness in multiple monitor use. CHI, 458--465.

Digital Library

[13]

Guiard, Y., Blanch, R., and Beaudouin-Lafon, M. (2004). Object pointing: a complement to bitmap pointing in GUIs. GI, 9--16.

Digital Library

[14]

Hutchings, D.R., Smith, G., Meyers, B., Czerwinski, M., Robertson, G. (2004). Display space usage and window management operation comparisons between single monitor and multiple monitor users. AVI, 32--39.

Digital Library

[15]

Hutchings, D.R. and Stasko, J. (2005). mudibo: Multiple dialog boxes for multiple monitors. CHI Extended Abstracts, 1471--1474.

Digital Library

[16]

Hutchings, D.R. and Stasko, J. (2007). Consistency, Multiple Monitors, and Multiple Windows. CHI Extended Abstracts, 211--214.

Digital Library

[17]

Hutchings, H.M. and Pierce, J.S. (2006). Understanding the whethers, hows, and whys of divisible interfaces. AVI, 274--277.

Digital Library

[18]

Hornbæk, K., Bederson, B.B., and Plaisant, C. (2002). Navigation patterns and usability of zoomable user interfaces with and without an overview. TOHCI, 9(4), 362--389.

Digital Library

[19]

Hinckley, K., Sinclair, M., Hanson, E., Szeliski, R., and Conway, M. (1999). The VideoMouse: a camera-based multi-degree-of-freedom input device. UIST, 103--112.

Digital Library

[20]

Hinckley, K., Cutrell, E., Bathiche, S., and Muss, T. (2002). Quantitative analysis of scrolling techniques. CHI, 65--72.

Digital Library

[21]

Hinckley, K., Dixon, M., Sarin, R., Guimbretiere, F., and Balakrishnan, R. (2009). Codex: a dual screen tablet computer. CHI, 1933--1942.

Digital Library

[22]

Ishak, E.W., Feiner, S.K. (2004). Interacting with hidden content using content-aware free-space transparency. UIST, 189--192.

Digital Library

[23]

Kobayashi, M. and Igarashi, T. (2008). Ninja Cursors: Using Multiple Cursors to Assist Target Acquisition on Large Screens. CHI, 949--958.

Digital Library

[24]

Kang, Y. and Stasko, J. (2008) Lightweight Task/Application Performance using Single versus Multiple Monitors: A Comparative Study. GI, 17--24.

Digital Library

[25]

Myers, B.A., Miller, R.C., Bostwick, B., and Evankovich, C. (2000). Extending the windows desktop interface with connected handheld computers. 4th USENIX Windows Systems Symposium, 79--88.

Digital Library

[26]

McGuffin, M. and Balakrishnan, R. (2002). Acquisition of expanding targets. CHI, 57--64.

Digital Library

[27]

Morris, M.R., Brush, A.J.B., and Meyers, B. (2007). Reading Revisited: Evaluating the Usability of Digital Display Surfaces for Active Reading Tasks. Tabletop, 79--86.

[28]

MacKenzie, S. (1992). Fitts' law as a research and design tool in human-computer interaction. Human-Computer Interaction 7(1): 91--139.

Digital Library

[29]

Nacenta, M., Mandryk, R., Gutwin, C. (2008). Targeting Across Displayless Space. CHI, 777--786.

Digital Library

[30]

Plaisant, C., Carr, D., and Shneiderman, B. (1995). Image-browser taxonomy and guidelines for designers. IEEE Software, 12(2), 21--32.

Digital Library

[31]

Pietriga, E., Appert, C., and Beaudouin-Lafon, M. (2007). Pointing and Beyond: an Operationalization and Preliminary Evaluation of Multi-scale Searching. CHI, 1215--1224.

Digital Library

[32]

Parhi, P., Karlson, A., and Bederson, B. (2006). Target size study for one-handed thumb use on small touch screen devices. MobileHCI, 203--210.

Digital Library

[33]

Ramos, G., Cockburn, A., Beaudouin-Lafon, M. and Balakrishnan, R. (2007). Pointing Lenses: Facilitating Stylus Input through Visual- and Motor-Space Magnification, CHI, 757--766.

Digital Library

[34]

Ringel, M. (2003). When One Isn't Enough: An Analysis of Virtual Desktop Usage Strategies and Their Implications for Design. CHI Extended Abstracts, 762--763.

Digital Library

[35]

Shi, K., Irani, P, and Subramanian, S. (2009). Pressure-Move: Pressure Input with Mouse Movement, INTERACT, 25--39.

Digital Library

[36]

St. John, M., Harris, W., and Osga, G.A. (1997). Designing for multitasking environments: Multiple monitors versus multiple windows. HFES, 1313--1317.

[37]

Tan, D.S. and Czerwinski, Mary (2003). Effects of Visual Separation and Physical Discontinuities when Distributing Information across Multiple Displays. INTERACT, 252--260.

[38]

Tan, D.S., Meyers, B., and Czerwinski, M. (2004). WinCuts: Manipulating Arbitrary Window Regions for More Effective Use of Screen Space. CHI EA, 1525--1528.

Digital Library

[39]

Villar, N., Izadi, S., Rosenfeld, D., Benko, H., Helmes, J., Westhues, J., Hodges, S., Butler, A., Ofek, E., Cao, X., and Chen, B. (2009). Mouse 2.0: Multitouch Meets the Mouse. UIST, 33--42.

Digital Library

[40]

Vogel, D. and Baudisch, P. (2007). Shift: A Technique for Operating Pen-Based Interfaces Using Touch. CHI, 657--666.

Digital Library

[41]

Ware, C. and Lewis, M. (1995). The DragMag image magnifier. CHI, 407--408.

Digital Library

Cited By

Yan YWang ZHuang QYang Z(2023)MousePath: Lightweight phone-to-web information sharing via mouse interfacePervasive and Mobile Computing10.1016/j.pmcj.2023.10175690(101756)Online publication date: Mar-2023
https://doi.org/10.1016/j.pmcj.2023.101756
Li LFang ZJia WZhang F(2022)Hierarchical Pointing on Distant Displays with Smart DevicesInternational Journal of Human–Computer Interaction10.1080/10447318.2022.210855939:19(3859-3874)Online publication date: 6-Sep-2022
https://doi.org/10.1080/10447318.2022.2108559
Keddisseh ESerrano MDubois E(2021)SmartCom: Exploiter un Smartphone pour Interagir avec les Barres d'OutilsProceedings of the 32nd Conference on l'Interaction Homme-Machine10.1145/3450522.3451244(1-10)Online publication date: 13-Apr-2021
https://dl.acm.org/doi/10.1145/3450522.3451244
Show More Cited By

Index Terms

LensMouse: augmenting the mouse with an interactive touch display
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Touch screens

Recommendations

Novel interaction techniques using touch-sensitive tangibles in tabletop environments
ITS '12: Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces

In this work, we propose techniques for interaction that use a touch-sensitive tangible to assist 3D manipulation in tabletop applications. The objective of this research is to investigate the effectiveness and user satisfaction with this combination ...
TDome: A Touch-Enabled 6DOF Interactive Device for Multi-Display Environments
CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

The rapid evolution of multi-display environments (MDEs) has created a vacuum in need of novel input devices to optimize interaction in MDEs. In this paper, we propose TDome, a novel touch-enabled 6DOF input and output device to facilitate interactions ...
Pointable: an in-air pointing technique to manipulate out-of-reach targets on tabletops
ITS '11: Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces

Selecting and moving digital content on interactive tabletops often involves accessing the workspace beyond arm's reach. We present Pointable, an in-air, bimanual perspective-based interaction technique that augments touch input on a tabletop for ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '10: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

April 2010

2690 pages

ISBN:9781605589299

DOI:10.1145/1753326

General Chair:
Elizabeth Mynatt
Georgia Institute of Technology
,
Program Chairs:
Geraldine Fitzpatrick
Vienna University of Technology
,
Scott Hudson
Carnegie Mellon University
,
Keith Edwards
Georgia Tech
,
Tom Rodden
University of Nottingham

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 April 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '10

Sponsor:

SIGCHI

CHI '10: CHI Conference on Human Factors in Computing Systems

April 10 - 15, 2010

Georgia, Atlanta, USA

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI '25

Sponsor:
sigchi

CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

42
Total Citations
View Citations
1,923
Total Downloads

Downloads (Last 12 months)39
Downloads (Last 6 weeks)3

Reflects downloads up to 18 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Yan YWang ZHuang QYang Z(2023)MousePath: Lightweight phone-to-web information sharing via mouse interfacePervasive and Mobile Computing10.1016/j.pmcj.2023.10175690(101756)Online publication date: Mar-2023
https://doi.org/10.1016/j.pmcj.2023.101756
Li LFang ZJia WZhang F(2022)Hierarchical Pointing on Distant Displays with Smart DevicesInternational Journal of Human–Computer Interaction10.1080/10447318.2022.210855939:19(3859-3874)Online publication date: 6-Sep-2022
https://doi.org/10.1080/10447318.2022.2108559
Keddisseh ESerrano MDubois E(2021)SmartCom: Exploiter un Smartphone pour Interagir avec les Barres d'OutilsProceedings of the 32nd Conference on l'Interaction Homme-Machine10.1145/3450522.3451244(1-10)Online publication date: 13-Apr-2021
https://dl.acm.org/doi/10.1145/3450522.3451244
Keddisseh ESerrano MDubois EKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)KeyTch: Combining the Keyboard with a Touchscreen for Rapid Command Selection on ToolbarsProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445288(1-13)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445288
Lee SLim YLee GBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)MirrorPad: Mirror on Touchpad for Direct Pen Interaction in the Laptop EnvironmentProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376212(1-9)Online publication date: 21-Apr-2020
https://dl.acm.org/doi/10.1145/3313831.3376212
Keddisseh ESerrano MSayegh NDubois E(2019)Accessibility study for augmented keyboard for input interaction techniquesAdjunct Proceedings of the 31st Conference on l'Interaction Homme-Machine10.1145/3366551.3370345(1-8)Online publication date: 10-Dec-2019
https://dl.acm.org/doi/10.1145/3366551.3370345
Hung MOehlberg LLedo D(2019)WatchPenProceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services10.1145/3338286.3344413(1-7)Online publication date: 1-Oct-2019
https://dl.acm.org/doi/10.1145/3338286.3344413
Hung MLedo DOehlberg L(2019)WatchPenProceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services10.1145/3338286.3340122(1-8)Online publication date: 1-Oct-2019
https://dl.acm.org/doi/10.1145/3338286.3340122
Mohr PTatzgern MLanglotz TLang ASchmalstieg DKalkofen DBrewster SFitzpatrick GCox AKostakos V(2019)TrackCapProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300815(1-11)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290605.3300815
Dubois ESerrano MRaynal MMandryk RHancock MPerry MCox A(2018)Rolling-MenuProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3173941(1-12)Online publication date: 21-Apr-2018
https://dl.acm.org/doi/10.1145/3173574.3173941
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents