research-article

Touch & connect and touch & select: interacting with a computer by touching it with a mobile phone

Authors:

Khoovirajsingh Seewoonauth,

Paul HolleisAuthors Info & Claims

MobileHCI '09: Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services

Article No.: 36, Pages 1 - 9

https://doi.org/10.1145/1613858.1613905

Published: 15 September 2009 Publication History

Abstract

Exchanging data between a mobile phone and a computer such as a laptop is still a very cumbersome process. This paper presents two different techniques, touch & connect and touch & select, designed help to overcome this problem and facilitate and speed up spontaneous interactions between such devices. Using touch & connect, the user can physically touch a computer in order to pair a Bluetooth connection and initiate a file transfer between these two devices. Touch & select extends this concept in that users can select a specific object or location on the computer screen by simply touching it with the mobile phone. We report the implementation of these interaction techniques based on Near Field Communication (NFC) tags and present a formal, comparative study focusing on transferring images. The results provide clear evidence of the advantages of touch & connect and touch & select when compared with current Bluetooth-based implementations. Considering task completion time for uploading and downloading pictures, touch & select was 43% and touch & connect 31% faster than the conventional Bluetooth-based approach.

References

[1]

Ailisto, H. et al. Physical Browsing with NFC Technology. In VTT Research Notes 2400. 2007. http://www.vtt.fi/inf/pdf/tiedotteet/2007/T2400.pdf

[2]

Ballagas, R., Rohs, M., Sheridan, J., Borchers, J. Sweep and Point&Shoot: Phonecam-Based Interactions for Large Public Displays. In CHI'05, 1200--1203, 2005.

Digital Library

[3]

Rukzio, E. Physical Mobile Interactions: Mobile Devices as Pervasive Mediators for Interactions with the Real World. PhD Dissertation. University of Munich. 2007.

[4]

Boring, S., Altendorfer, M., Broll, G., Hilliges, O., Butz, A. Shoot&Copy: Phonecam-based Information Transfer from Public Displays onto Mobile Phones. In Mobility'07, 24--31, 2007.

Digital Library

[5]

Cheverst, K., Dix A., Fitton, D, Kray, C., Rouncefield, M., Sas, C., Saslis-Lagoudakis, G., Sheridan, J. G. Exploring Bluetooth based Mobile Phone Interaction with the Hermes Photo Display. In MobileHCI'05, 47--54, 2005.

Digital Library

[6]

ECMA International. Near Field Communication White paper. Ecma/TC32-TG19/2004/1. http://www.ecma-international.org/activities/Communications/2004tg19-001.pdf

[7]

Fitzmaurice, G. W. Situated Information Spaces and Spatially Aware Palmtop Computers. In Commun. ACM, 36 (7), 39--49, 1993.

Digital Library

[8]

Hardy, R., Rukzio, E. Touch&Interact: Touch-based Interaction of Mobile Phones with Displays. In MobileHCI'08, 245--254, 2008.

Digital Library

[9]

Hart, S. G., Staveland, L. E. Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. In Human Mental Workload, 239--250, 1998.

[10]

Holleis, P., Otto, F., Hussmann, H., Schmidt, A. 2007. Keystroke-level Model for Advanced Mobile Phone Interaction. In CHI '07, 1505--1514, 2007.

Digital Library

[11]

Jones, M., Jones, S., Marsden, G., Patel, D. An Evaluation of Techniques for Browsing Photograph Collections on Small Displays. In MobileHCI'04, 132--143, 2004.

[12]

Juniper Predicts 700 Million NFC Cell Phones by 2013. In ContactlessNews. September 10, 2008.

[13]

Kim, S., Choi, E. Y., Choi, J., Hong, J. S. Touch and Share: Intuitive Peer Selection. In PERMID'08, 2008.

[14]

Kindberg, T., Spasojevic, M., Fleck, R., Sellen, A., The Ubiquitous Camera: an In-Depth Study of Camera Phone Use. In Pervasive Computing, 4 (2), 2005.

Digital Library

[15]

Lewis, J. R. IBM Computer Usability Satisfaction Questionnaires: Psychometric Evaluation and Instructions for Use. In International Journal of Human-Computer Interaction 7 (1), 57--78, 1995.

Digital Library

[16]

Madhavapeddy, A., Scott, D., Sharp, R., Upton, E. Using Camera-Phones to Enhance Human Computer Interaction. In Adj. Proceedings of Ubicomp'04, 2004.

[17]

Microsoft Surface, http://www.microsoft.com/surface/

[18]

Miyaoku, K., Higashino, S., Tonomura, Y. C-blink: a Hue-difference-based Light Signal Marker for Large Screen Interaction via any Mobile Terminal. In UIST'04, 147--156, 2004.

Digital Library

[19]

Myers, B. A., Stiel, H., Gargiulo, R. Collaboration using Multiple PDAs Connected to a PC. In CSCW'98, 285--294, 1998.

Digital Library

[20]

Pering, T., Ballagas, R., Want, R. Spontaneous Marriages of Mobile Devices and Interactive Spaces. In Communicatoins of the ACM 48 (9), 53--59, 2005.

Digital Library

[21]

Reilly, D., Rodgers, M., Argue, R., Nunes, M., Inkpen, K. Marked-up Maps: Combining Paper Maps and Electronic Information Resources. In Personal and Ubiquitous Computing, 10 (4), 215--226, 2006.

Digital Library

[22]

Rekimoto, J. Pick-and-drop: a Direct Manipulation Technique for Multiple Computer Environments. In UIST'97, 31--39, 1997.

Digital Library

[23]

Rukzio, E., Leichtenstern, K., Callaghan, V., Holleis, P., Schmidt, A., Chin, J. An Experimental Comparison of Physical Mobile Interaction Techniques: Touching, Pointing and Scanning. In Ubicomp'06, 87--104, 2006

Digital Library

[24]

Silfverberg, M., MacKenzie, I. S., Kauppinen, T. An Isometric Joystick as a Pointing Device for Handheld Information Terminals. In GI'01, 119--126, 2001

Digital Library

[25]

Want, R., Fishkin, K. P., Gujar, A., Harrison, B. L. Bridging Physical and Virtual Worlds with Electronic Tags. In CHI'99, 370--37, 1999

Digital Library

Cited By

Cao QZhang JFan SRong JQi MDuan ZZhao PLiu LZhou ZChen W(2024)NearFetch: Enhancing Touch-Based Mobile Interaction on Public Displays with an Embedded Programmable NFC ArrayProceedings of the 26th International Conference on Multimodal Interaction10.1145/3678957.3685749(234-243)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3678957.3685749
Emmert MSchönwerth NSchmid AWolff CWimmer R(2024)I've Got the Data in My Pocket! - Exploring Interaction Techniques with Everyday Objects for Cross-Device Data TransferProceedings of Mensch und Computer 202410.1145/3670653.3670778(242-255)Online publication date: 1-Sep-2024
https://dl.acm.org/doi/10.1145/3670653.3670778
Kim SPark JChae MJung SChang H(2019)A device binding method based on content illumination pattern in public display environmentsPLOS ONE10.1371/journal.pone.021449314:5(e0214493)Online publication date: 10-May-2019
https://doi.org/10.1371/journal.pone.0214493
Show More Cited By

Index Terms

Touch & connect and touch & select: interacting with a computer by touching it with a mobile phone
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Touch screens
  2. Interaction design
    1. Interaction design process and methods
      1. Interface design prototyping

Recommendations

Two NFC interaction techniques for quickly exchanging pictures between a mobile phone and a computer
MobileHCI '09: Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services

Uploading and downloading pictures between a mobile phone and a computer is still a very cumbersome process. Because of this, many users actually do not copy, move or backup their pictures onto another computer until the storage capacity of the mobile ...
Exploring Expressive NFC-Based Mobile Phone Interaction with Large Dynamic Displays
NFC '09: Proceedings of the 2009 First International Workshop on Near Field Communication

Inherent obstacles in current mobile applications are the limited input and output capabilities of mobile phones. In many ways, e.g. in terms of display capabilities and processing power, today’s mobile phones are quite versatile and provide opportunity ...
Pen + touch = new tools
UIST '10: Proceedings of the 23nd annual ACM symposium on User interface software and technology

We describe techniques for direct pen+touch input. We observe people's manual behaviors with physical paper and notebooks. These serve as the foundation for a prototype Microsoft Surface application, centered on note-taking and scrapbooking of ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

MobileHCI '09: Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services

September 2009

473 pages

ISBN:9781605582818

DOI:10.1145/1613858

Conference Chair:
Reinhard Oppermann
Fraunhofer FIT
,
Program Chairs:
Markus Eisenhauer
Fraunhofer FIT
,
Matthias Jarke
RWTH Aachen + Fraunhofer FIT
,
Volker Wulf
University of Siegen + Fraunhofer FIT

Copyright © 2009 Copyright is held by the author/owner(s).

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 September 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

MobileHCI '09

MobileHCI '09: 11th International Conference on Human Computer Interaction with Mobile Devices and Services

September 15 - 18, 2009

Bonn, Germany

Acceptance Rates

MobileHCI '09 Paper Acceptance Rate 23 of 95 submissions, 24%;

Overall Acceptance Rate 202 of 906 submissions, 22%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

34
Total Citations
View Citations
887
Total Downloads

Downloads (Last 12 months)29
Downloads (Last 6 weeks)0

Reflects downloads up to 18 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Cao QZhang JFan SRong JQi MDuan ZZhao PLiu LZhou ZChen W(2024)NearFetch: Enhancing Touch-Based Mobile Interaction on Public Displays with an Embedded Programmable NFC ArrayProceedings of the 26th International Conference on Multimodal Interaction10.1145/3678957.3685749(234-243)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3678957.3685749
Emmert MSchönwerth NSchmid AWolff CWimmer R(2024)I've Got the Data in My Pocket! - Exploring Interaction Techniques with Everyday Objects for Cross-Device Data TransferProceedings of Mensch und Computer 202410.1145/3670653.3670778(242-255)Online publication date: 1-Sep-2024
https://dl.acm.org/doi/10.1145/3670653.3670778
Kim SPark JChae MJung SChang H(2019)A device binding method based on content illumination pattern in public display environmentsPLOS ONE10.1371/journal.pone.021449314:5(e0214493)Online publication date: 10-May-2019
https://doi.org/10.1371/journal.pone.0214493
Roels RDe Witte ASigner B(2018)INFEXProceedings of the ACM on Human-Computer Interaction10.1145/31794272:EICS(1-26)Online publication date: 19-Jun-2018
https://dl.acm.org/doi/10.1145/3179427
Mäkelä VKhamis MMecke LJames JTurunen MAlt FMandryk RHancock MPerry MCox A(2018)Pocket TransfersProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3173709(1-13)Online publication date: 21-Apr-2018
https://dl.acm.org/doi/10.1145/3173574.3173709
Machda FAsnar YAkbar S(2018)Designing a Big Screen Interaction Based on Smartphone Touch Gestures2018 5th International Conference on Data and Software Engineering (ICoDSE)10.1109/ICODSE.2018.8705847(1-6)Online publication date: Nov-2018
https://doi.org/10.1109/ICODSE.2018.8705847
Makela VJames JKeskinen THakulinen JTurunen M(2017)"It's Natural to Grab and Pull": Retrieving Content from Large Displays Using Mid-Air GesturesIEEE Pervasive Computing10.1109/MPRV.2017.294096616:3(70-77)Online publication date: 2017
https://doi.org/10.1109/MPRV.2017.2940966
Xiao RHudson SHarrison CHancock MMarquardt NSchöning JTory M(2016)CapCamProceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces10.1145/2992154.2992182(169-178)Online publication date: 6-Nov-2016
https://dl.acm.org/doi/10.1145/2992154.2992182
Korzetz MKühn RHeisig PSchlegel TPaternò FVäänänen KChurch KHäkkilä JKrüger ASerrano M(2016)Natural collocated interactions for merging results with mobile devicesProceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct10.1145/2957265.2961839(746-752)Online publication date: 6-Sep-2016
https://dl.acm.org/doi/10.1145/2957265.2961839
Bauer JEbert A(2015)Mobile Devices for Virtual Reality Interaction. A Survey of Techniques and MetaphorsVirtual Realities10.1007/978-3-319-17043-5_6(91-107)Online publication date: 1-Apr-2015
https://doi.org/10.1007/978-3-319-17043-5_6
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents