research-article

UI Testing Cross-Device Applications

Authors:

Michael Spiegel,

Alfonso Murolo,

Moira C. NorrieAuthors Info & Claims

ISS '16: Proceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces

Pages 179 - 188

https://doi.org/10.1145/2992154.2992177

Published: 06 November 2016 Publication History

Abstract

The increasing number of devices available to a user has prompted the research community to explore how these can be used in combination. Frameworks and toolkits have been proposed to facilitate the design and implementation of these cross-device applications. Still, implementing cross-device applications remains complex because of the fragmentation of the user interface and logic across devices and the flexibility required to adapt to different combinations of devices. Testing in particular has been identified as a critical challenge. To address these issues, we introduce XD-Testing, a library that provides explicit and implicit device selectors, device templates and scenarios, as well as a visualiser for application screenshots. In a case study, we demonstrate how we used the library to author human-readable tests for a cross-device gallery that verify if a UI distributes correctly and if it works as expected despite being distributed.

References

[1]

Badam, S. K., and Elmqvist, N. PolyChrome: A Cross-Device Framework for Collaborative Web Visualization. In Proc. ITS (2014).

Digital Library

[2]

Bruegge, B., and Dutoit, A. H. Object-Oriented Software Engineering Using UML, Patterns and Java. Prentice Hall, 2004.

Digital Library

[3]

Bruns, A., Kornstadt, A., and Wichmann, D. Web Application Tests with Selenium. IEEE Software 26, 5 (2009).

Digital Library

[4]

Chi, P. P., and Li, Y. Weave: Scripting Cross-Device Wearable Interaction. In Proc. CHI (2015).

Digital Library

[5]

Chi, P. P., Li, Y., and Hartmann, B. Enhancing Cross-Device Interaction Scripting with Interactive Illustrations. In Proc. CHI (2016).

Digital Library

[6]

Dong, T., Churchill, E. F., and Nichols, J. Understanding the Challenges of Designing and Developing Multi-Device Experiences. In Proc. DIS (2016).

Digital Library

[7]

Geronimo, L. D., Husmann, M., and Norrie, M. C. Surveying Personal Device Ecosystems with Cross-Device Applications in Mind. In Proc. PerDis (2016).

Digital Library

[8]

Ghiani, G., Manca, M., and Paternó, F. Authoring Context-dependent Cross-device User Interfaces Based on Trigger/Action Rules. In Proc. MUM (2015).

Digital Library

[9]

Gjerlufsen, T., Klokmose, C. N., Eagan, J., Pillias, C., and Beaudouin-Lafon, M. Shared Substance: Developing Flexible Multi-Surface Applications. In Proc. CHI (2011).

Digital Library

[10]

Hamilton, P., and Wigdor, D. J. Conductor: Enabling and Understanding Cross-Device Interaction. In Proc. CHI (2014).

Digital Library

[11]

Hesenius, M., Griebe, T., Gries, S., and Gruhn, V. Automating UI Tests for Mobile Applications with Formal Gesture Descriptions. In Proc. MobileHCI (2014).

Digital Library

[12]

Houben, S., Tell, P., and Bardram, J. E. ActivitySpace: Managing Device Ecologies in an Activity-Centric Configuration Space. In Proc. ITS (2014).

Digital Library

[13]

Husmann, M., Geronimo, L. D., and Norrie, M. C. XD-Bike: A Cross-Device Repository of Mountain Biking Routes. In ICWE Workshops (2016).

[14]

Husmann, M., Heyder, N., and Norrie, M. C. Is a Framework Enough? Cross-Device Testing and Debugging. In Proc. EICS (2016).

Digital Library

[15]

Kaasila, J., Ferreira, D., Kostakos, V., and Ojala, T. Testdroid: Automated Remote UI Testing on Android. In Proc. MUM (2012).

Digital Library

[16]

Klokmose, C. N., Eagan, J., Baader, S., Mackay, W., and Beaudouin-Lafon, M. Webstrates: Shareable Dynamic Media. In Proc. UIST (2015).

Digital Library

[17]

Leotta, M., Clerissi, D., Ricca, F., and Tonellla, P. Capture-Replay vs. Programmable Web Testing: an Empirical Assessment During Test Case Evolution. In Proc. WCRE (2013).

[18]

Marquardt, N., Diaz-Marino, R., Boring, S., and Greenberg, S. The Proximity Toolkit: Prototyping Proxemic Interactions in Ubiquitous Computing Ecologies. In Proc. UIST (2011).

Digital Library

[19]

Marquardt, N., Hinckley, K., and Greenberg, S. Cross-Device Interaction via Micro-Mobility and F-Formations. In Proc. UIST (2012).

Digital Library

[20]

Mikkonen, T., Systä, K., and Pautasso, C. Towards Liquid Web Applications. In Proc. ICWE (2015).

Digital Library

[21]

Nebeling, M., Husmann, M., and Norrie, M. C. Interactive Development of Cross-Device User Interfaces. In Proc. CHI (2014).

Digital Library

[22]

Nebeling, M., Husmann, M., Zimmerli, C., Valente, G., and Norrie, M. C. XDSession: Integrated Development and Testing of Cross-Device Applications. In Proc. EICS (2015).

Digital Library

[23]

Rädle, R., Jetter, H.-C., Marquardt, N., Reiterer, H., and Rogers, Y. HuddleLamp: Spatially-Aware Mobile Displays for Ad-hoc Around-the-Table Collaboration. In Proc. ITS (2014).

Digital Library

[24]

Santosa, S., and Wigdor, D. A Field Study of Multi-Device Workflows in Distributed Workspaces. In Proc. UbiComp (2013).

Digital Library

[25]

Schreiner, M., Rädle, R., Jetter, H., and Reiterer, H. Connichiwa: A Framework for Cross-Device Web Applications. In Proc. CHI EA (2015).

Digital Library

[26]

Seyed, T., Azazi, A., Chan, E., Wang, Y., and Maurer, F. SoD-Toolkit: A Toolkit for Interactively Prototyping and Developing Multi-Sensor, Multi-Device Environments. In Proc. ITS (2015).

Digital Library

[27]

Shakeri Hossein Abad, Z., Anslow, C., and Maurer, F. Multi Surface Interactions with Geospatial Data: A Systematic Review. In Proc. ITS (2014).

Digital Library

[28]

Streitz, N. A., Geissler, J., Holmer, T., Konomi, S., Müller-Tomfelde, C., Reischl, W., Rexroth, P., Seitz, P., and Steinmetz, R. i-land: An interactive landscape for creativity and innovation. In Proc. CHI (1999).

Digital Library

[29]

Wozniak, P., Goyal, N., Kucharski, P., Lischke, L., Mayer, S., and Fjeld, M. RAMPARTS: Supporting Sensemaking with Spatially-Aware Mobile Interactions. In Proc. CHI (2016).

Digital Library

[30]

Yang, J., and Wigdor, D. Panelrama: Enabling Easy Specification of Cross-Device Web Applications. In Proc. CHI (2014).

Digital Library

[31]

Zagermann, J., Pfeil, U., Rädle, R., Jetter, H.-C., Klokmose, C., and Reiterer, H. When Tablets Meet Tabletops: The Effect of Tabletop Size on Around-the-Table Collaboration with Personal Tablets. In Proc. CHI (2016).

Digital Library

Cited By

Ye HLeng JXiao CWang LFu H(2023)ProObjAR: Prototyping Spatially-aware Interactions of Smart Objects with AR-HMDProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580750(1-15)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580750
Pautasso C(2023)A Brief History of Liquid Software2023 IEEE International Conference on Edge Computing and Communications (EDGE)10.1109/EDGE60047.2023.00058(354-363)Online publication date: Jul-2023
https://doi.org/10.1109/EDGE60047.2023.00058
Garousi VCutting DFelderer M(2022)What Users Think of COVID-19 Contact-Tracing Apps: An Analysis of Eight European AppsIEEE Software10.1109/MS.2021.309728439:3(22-30)Online publication date: May-2022
https://doi.org/10.1109/MS.2021.3097284
Show More Cited By

Index Terms

UI Testing Cross-Device Applications
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Cross-Device Taxonomy: Survey, Opportunities and Challenges of Interactions Spanning Across Multiple Devices
CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems

Designing interfaces or applications that move beyond the bounds of a single device screen enables new ways to engage with digital content. Research addressing the opportunities and challenges of interactions with multiple devices in concert is of ...
Is a framework enough?: cross-device testing and debugging
EICS '16: Proceedings of the 8th ACM SIGCHI Symposium on Engineering Interactive Computing Systems

Although numerous cross-device frameworks have been proposed in recent years, we know of only a few cross-device applications that have been implemented and many of these are prototypes to showcase the frameworks. Fewer still have been deployed and are ...
Interactive development of cross-device user interfaces
CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Current GUI builders provide a design environment for user interfaces that target either a single type or fixed set of devices, and provide little support for scenarios in which the user interface, or parts of it, are distributed over multiple devices. ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ISS '16: Proceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces

November 2016

554 pages

ISBN:9781450342483

DOI:10.1145/2992154

General Chairs:
Mark Hancock
University of Waterloo, Canada
,
Nicolai Marquardt
University College London, UK
,
Program Chairs:
Johannes Schöning
Hasselt University, Belgium
,
Melanie Tory
Tableau Research, USA

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 November 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Swiss National Science Foundation (SNF)

Conference

ISS '16

Sponsor:

SIGCHI

ISS '16: 2016 ACM International Conference on Interactive Surfaces and Spaces

November 6 - 9, 2016

Ontario, Niagara Falls, Canada

Acceptance Rates

ISS '16 Paper Acceptance Rate 33 of 119 submissions, 28%;

Overall Acceptance Rate 147 of 533 submissions, 28%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

13
Total Citations
View Citations
419
Total Downloads

Downloads (Last 12 months)28
Downloads (Last 6 weeks)3

Reflects downloads up to 17 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Ye HLeng JXiao CWang LFu H(2023)ProObjAR: Prototyping Spatially-aware Interactions of Smart Objects with AR-HMDProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580750(1-15)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580750
Pautasso C(2023)A Brief History of Liquid Software2023 IEEE International Conference on Edge Computing and Communications (EDGE)10.1109/EDGE60047.2023.00058(354-363)Online publication date: Jul-2023
https://doi.org/10.1109/EDGE60047.2023.00058
Garousi VCutting DFelderer M(2022)What Users Think of COVID-19 Contact-Tracing Apps: An Analysis of Eight European AppsIEEE Software10.1109/MS.2021.309728439:3(22-30)Online publication date: May-2022
https://doi.org/10.1109/MS.2021.3097284
Garousi VCutting DFelderer M(2022)Mining user reviews of COVID contact-tracing appsJournal of Systems and Software10.1016/j.jss.2021.111136184:COnline publication date: 3-Jan-2022
https://dl.acm.org/doi/10.1016/j.jss.2021.111136
Bingham SSemple CFlannagan CDunwoody L(2022)Adapting and usability testing of an eLearning resource to enhance healthcare professional provision of sexual support across cancer careSupportive Care in Cancer10.1007/s00520-022-06798-wOnline publication date: 12-Jan-2022
https://doi.org/10.1007/s00520-022-06798-w
Santos PMadeira RCorreia N(2021)Applications across Co-located Devices: User Interface Distribution, State Management and CollaborationThe 23rd International Conference on Information Integration and Web Intelligence10.1145/3487664.3487748(602-613)Online publication date: 29-Nov-2021
https://dl.acm.org/doi/10.1145/3487664.3487748
Zhang RShi YSchuller BAndré EOviatt SQuigley AMarquardt NAslan IJu R(2021)User Experience for Multi-Device Ecosystems: Challenges and OpportunitiesExtended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411763.3441325(1-5)Online publication date: 8-May-2021
https://dl.acm.org/doi/10.1145/3411763.3441325
Jetter HRädle RFeuchtner TAnthes CFriedl JKlokmose CBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)"In VR, everything is possible!": Sketching and Simulating Spatially-Aware Interactive Spaces in Virtual RealityProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376652(1-16)Online publication date: 21-Apr-2020
https://dl.acm.org/doi/10.1145/3313831.3376652
Brudy FHolz CRädle RWu CHouben SKlokmose CMarquardt NBrewster SFitzpatrick GCox AKostakos V(2019)Cross-Device TaxonomyProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300792(1-28)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290605.3300792
Paternò F(2019)Concepts and design space for a better understanding of multi-device user interfacesUniversal Access in the Information Society10.1007/s10209-019-00650-5Online publication date: 4-Apr-2019
https://doi.org/10.1007/s10209-019-00650-5
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents