research-article

A Comparison of Techniques for Cross-Device Interaction from Mobile Devices to Large Displays

Authors:

Dimitrios Raptis,

Jesper Kjeldskov,

Bjarke M. Lauridsen,

Ivan S. Penchev,

Elias Ringhauge,

Eric V. RuderAuthors Info & Claims

MoMM '16: Proceedings of the 14th International Conference on Advances in Mobile Computing and Multi Media

Pages 137 - 146

https://doi.org/10.1145/3007120.3007140

Published: 28 November 2016 Publication History

Abstract

In recent years there has been an increasing interest in cross-device interaction research involving mobile computing. We contribute to this research with a comparative study of four interaction techniques for moving information from a mobile device to a large display. The four techniques (Pinch, Swipe, Throw, and Tilt) were compared through a laboratory experiment with 53 participants, measuring their effectiveness, efficiency and error size. Findings from the experiment revealed that the Swipe technique performed best on all measures. In terms of effectiveness, the Tilt technique performed the worst, and especially so with small targets. In terms of efficiency and error size, the Pinch technique was the slowest and also the most imprecise. We also found that target size mattered considerably for all techniques, confirming previous research. Based on our findings we discuss why the individual techniques performed as observed, and discuss implications for using mobile devices in cross-device interaction design.

References

[1]

Benko, H. and Wilson, A.D. 2010. Multi-point interactions with immersive omnidirectional visualizations in a dome. In ACM International Conference on Interactive Tabletops and Surfaces (ITS '10). ACM, New York, NY, USA, 19--28.

Digital Library

[2]

Boring, S., Altendorfer, M., Broll, G., Hilliges, O. and Butz, A. 2007. Shoot & copy: phonecam-based information transfer from public displays onto mobile phones. In Proceedings of the 4th international conference on mobile technology, applications, and systems and the 1st international symposium on Computer human interaction in mobile technology (Mobility '07). ACM, New York, NY, USA, 24--31.

Digital Library

[3]

Boring, S., Jurmu, M., and Butz, A. 2009. Scroll, tilt or move it: using mobile phones to continuously control pointers on large public displays. In Proceedings of the 21st Annual Conference of the Australian Computer-Human Interaction Special Interest Group: Design: Open 24/7 (OZCHI '09). ACM, New York, NY, USA, 161--168.

Digital Library

[4]

Bragdon, A., DeLine, R., Hinckley, R. and Morris, M.R. 2011. Code space: touch + air gesture hybrid interactions for supporting developer meetings. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS '11). ACM, New York, NY, USA, 212--221.

Digital Library

[5]

Chen, X., Grossman, T., Wigdor, D.J. and Fitzmaurice, G. 2014. Duet: exploring joint interactions on a smart phone and a smart watch. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 159--168.

Digital Library

[6]

Hamilton, P. and Wigdor, D.J. 2014. Conductor: enabling and understanding cross-device interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 2773--2782.

Digital Library

[7]

Hoaglin, D.C., Iglewicz, B. and Tukey, J.W., 1986. Performance of some resistant rules for outlier labeling. Journal of the American Statistical Association, 81(396), pp. 991--999.

[8]

Ikematsu, K. and Siio, I. 2015. Memory Stones: An Intuitive Information Transfer Technique between Multi-touch Computers. In Proceedings of the 16th International Workshop on Mobile Computing Systems and Applications (HotMobile '15). ACM, New York, NY, USA, 3--8.

Digital Library

[9]

Jokela, T., Ojala, J. and Olsson, T. 2015. A Diary Study on Combining Multiple Information Devices in Everyday Activities and Tasks. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 3903--3912.

Digital Library

[10]

Lucero, A., Holopainen, J. and Jokela, T. 2012. MobiComics: collaborative use of mobile phones and large displays for public expression. In Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services (MobileHCI '12). ACM, New York, NY, USA, 383--392.

Digital Library

[11]

Lund, A.M. 2001. Measuring Usability with the USE Questionnaire. STC Usability SIG Newsletter. (2001).

[12]

Marquardt, N., Hinckley, K. and Greenberg, S. 2012. Cross-device interaction via micro-mobility and f-formations. In Proceedings of the 25th annual ACM symposium on User interface software and technology (UIST '12). ACM, New York, NY, USA, 13--22.

Digital Library

[13]

Myers, B.A. 2001. Using handhelds and PCs together. Commun. ACM 44, 11 (November 2001), 34--41.

Digital Library

[14]

Nielsen, H.S., Olsen, M.P., Skov, M.B. and Kjeldskov, J. 2014. JuxtaPinch: exploring multi-device interaction in collocated photo sharing. In Proceedings of the 16th international conference on Human-computer interaction with mobile devices & services (MobileHCI '14). ACM, New York, NY, USA, 183--192.

Digital Library

[15]

Rekimoto, J. 1997. Pick-and-drop: a direct manipulation technique for multiple computer environments. In Proceedings of the 10th annual ACM symposium on User interface software and technology (UIST '97). ACM, New York, NY, USA, 31--39.

Digital Library

[16]

Rekimoto, J. 1998. February. Multiple-Computer User Interfaces: A cooperative environment consisting of multiple digital devices. In International Workshop on Cooperative Buildings (pp. 33--40). Springer Berlin Heidelberg.

Digital Library

[17]

Rädle, R., Jetter, H., Schreiner, M., Lu, Z., Reiterer, H. and Rogers, Y. 2015. Spatially-aware or Spatially-agnostic?: Elicitation and Evaluation of User-Defined Cross-Device Interactions. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 3913--3922.

Digital Library

[18]

Scheible, J., Ojala, T. and Coulton, P. 2008. MobiToss: a novel gesture based interface for creating and sharing mobile multimedia art on large public displays. In Proceedings of the 16th ACM international conference on Multimedia (MM '08). ACM, New York, NY, USA, 957--960.

Digital Library

[19]

Schmidt, D., Chehimi, F., Rukzio, E. and Gellersen, H. 2010. PhoneTouch: a technique for direct phone interaction on surfaces. In Proceedings of the 23nd annual ACM symposium on User interface software and technology (UIST '10). ACM, New York, NY, USA, 13--16.

Digital Library

[20]

Schmidt, D., Seifert, J., Rukzio, E. and Gellersen, H. A 2012. A cross-device interaction style for mobiles and surfaces. In Proceedings of the Designing Interactive Systems Conference (DIS '12). ACM, New York, NY, USA, 318--327.

Digital Library

[21]

Skov, M.B., Kjeldskov, J., Paay, J., Jensen, H.P. and Olsen, M.P. 2015. Investigating Cross-Device Interaction Techniques: A Case of Card Playing on Handhelds and Tablets. In Proceedings of the Annual Meeting of the Australian Special Interest Group for Computer Human Interaction (OzCHI '15). ACM, New York, NY, USA, 446--454.

Digital Library

[22]

Sørensen, H., Raptis, D., Kjeldskov, J. and Skov, M.B. 2014. The 4C framework: principles of interaction in digital ecosystems. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '14). ACM, New York, NY, USA, 87--97.

Digital Library

[23]

Walter, R., Bailly, G., Valkanova, N. and Müller, J. Cuenesics: Using Mid-air Gestures to Select Items on Interactive Public Displays. In Proc. MobileHCI '14, ACM Press (2014), 299--308. Bowman, M., Debray, S. K., and Peterson, L. L. 1993. Reasoning about naming systems. ACM Trans. Program. Lang. Syst. 15, 5 (Nov. 1993), 795--825.

Digital Library

Cited By

Pei SKim DOlwal AZhang YDu R(2024)UI Mobility Control in XR: Switching UI Positionings between Static, Dynamic, and Self EntitiesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642220(1-12)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642220
Kühn RKegel KKallenbach FKorzetz MAßmann USchlegel T(2023)Mobile Device-Based Interactions for Collocated Direct Voting in Collaborative ScenariosLearning and Collaboration Technologies10.1007/978-3-031-34550-0_37(520-537)Online publication date: 9-Jun-2023
https://doi.org/10.1007/978-3-031-34550-0_37
Suarez GChoquevilca KPadilla AGalvez M(2021)Leaper: Video Game Development on Android Devices with Cross-Device Interaction2021 IEEE Sciences and Humanities International Research Conference (SHIRCON)10.1109/SHIRCON53068.2021.9652333(1-4)Online publication date: 17-Nov-2021
https://doi.org/10.1109/SHIRCON53068.2021.9652333
Show More Cited By

Index Terms

A Comparison of Techniques for Cross-Device Interaction from Mobile Devices to Large Displays
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Investigating Cross-Device Interaction between a Handheld Device and a Large Display
CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

There is a growing interest in HCI research to explore cross-device interaction, giving rise to an interest in different approaches facilitating interaction between handheld devices and large displays. Contributing to this, we have investigated the use ...
A comparison of techniques for cross-device interaction from mobile devices to large displays

In recent years there has been an increasing interest in cross-device interaction research involving mobile computing. We contribute to this research with a comparative study of four interaction techniques for moving information from a mobile device to ...
Interaction with large ubiquitous displays using camera-equipped mobile phones

In the ubiquitous computing environment, people will interact with everyday objects (or computers embedded in them) in ways different from the usual and familiar desktop user interface. One such typical situation is interacting with applications through ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

MoMM '16: Proceedings of the 14th International Conference on Advances in Mobile Computing and Multi Media

November 2016

363 pages

ISBN:9781450348065

DOI:10.1145/3007120

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

@WAS: International Organization of Information Integration and Web-based Applications and Services

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 November 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

MoMM '16

MoMM '16: 14th International Conference on Advances in Mobile Computing and Multi Media

November 28 - 30, 2016

Singapore, Singapore

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

11
Total Citations
View Citations
311
Total Downloads

Downloads (Last 12 months)33
Downloads (Last 6 weeks)1

Reflects downloads up to 12 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Pei SKim DOlwal AZhang YDu R(2024)UI Mobility Control in XR: Switching UI Positionings between Static, Dynamic, and Self EntitiesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642220(1-12)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642220
Kühn RKegel KKallenbach FKorzetz MAßmann USchlegel T(2023)Mobile Device-Based Interactions for Collocated Direct Voting in Collaborative ScenariosLearning and Collaboration Technologies10.1007/978-3-031-34550-0_37(520-537)Online publication date: 9-Jun-2023
https://doi.org/10.1007/978-3-031-34550-0_37
Suarez GChoquevilca KPadilla AGalvez M(2021)Leaper: Video Game Development on Android Devices with Cross-Device Interaction2021 IEEE Sciences and Humanities International Research Conference (SHIRCON)10.1109/SHIRCON53068.2021.9652333(1-4)Online publication date: 17-Nov-2021
https://doi.org/10.1109/SHIRCON53068.2021.9652333
Karan MBerkman MÇatak G(2021)Smartphone as a Paired Game Input Device: An Application on HoloLens Head Mounted Augmented Reality SystemGame + Design Education10.1007/978-3-030-65060-5_22(265-277)Online publication date: 20-Jul-2021
https://doi.org/10.1007/978-3-030-65060-5_22
Dedo RYabar JMauricio D(2020)Inkatán: A Game for Smart TV and Android with Ensemble Interactions2020 3rd International Conference on Information and Computer Technologies (ICICT)10.1109/ICICT50521.2020.00043(235-241)Online publication date: Mar-2020
https://doi.org/10.1109/ICICT50521.2020.00043
Korzetz MKühn RAßmann USchlegel T(2020)A Design Kit for Mobile Device-Based Interaction TechniquesHCI International 2020 - Posters10.1007/978-3-030-50726-8_7(52-59)Online publication date: 10-Jul-2020
https://doi.org/10.1007/978-3-030-50726-8_7
Kühn RKorzetz MKallenbach FKegel KAßmann USchlegel T(2020)Investigating Mobile Device-Based Interaction Techniques for Collocated MergingLearning and Collaboration Technologies. Designing, Developing and Deploying Learning Experiences10.1007/978-3-030-50513-4_7(92-108)Online publication date: 19-Jul-2020
https://dl.acm.org/doi/10.1007/978-3-030-50513-4_7
Korzetz MKühn RBüschel LSchumann FAßmann USchlegel T(2020)Introducing Mobile Device-Based Interactions to Users: An Investigation of Onboarding TutorialsHuman-Computer Interaction. Multimodal and Natural Interaction10.1007/978-3-030-49062-1_29(428-442)Online publication date: 19-Jul-2020
https://dl.acm.org/doi/10.1007/978-3-030-49062-1_29
Vanderdonckt JNguyen T(2019)MoCaDiXProceedings of the ACM on Human-Computer Interaction10.1145/33311593:EICS(1-40)Online publication date: 13-Jun-2019
https://dl.acm.org/doi/10.1145/3331159
Atencio LAybar BPadilla A(2018)Comparative Analysis of Cross-Platform Communication MechanismsProceedings of the 2nd International Conference on Compute and Data Analysis10.1145/3193077.3193083(75-79)Online publication date: 23-Mar-2018
https://dl.acm.org/doi/10.1145/3193077.3193083
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents