Abstract
The growing success of second-screen devices is changing the way users relate and interact with the television bringing a new dimension to the TV ecosystem. Nevertheless, the specificities of mobile devices are creating numerous and significant challenges in the field of usability and user experience (UX). In addition, the evaluation of applications of the TV ecosystem should not be restricted to the measurement of its instrumental qualities typically belonging to the usability dimension, since it is also important to consider dimensions related to the UX. This paper focuses on the evaluation of a second screen application - the TV content discovery App GUIDER. Two data collection strategies for the evaluation of the App were used: a methodology based on InApp questions (that allows to measure momentary UX) and a more conventional evaluation based on an online questionnaire answered at the end of evaluation sessions (episodic UX). The use of both data collection strategies was intended to get comparative insights to validate if the InApp questions approach could get similar results when compared with those from traditional surveys. The results showed that the response deviation was very low reinforcing the suitability of such alternative data gathering method. The results indicate that triggering InApp questions while users are interacting is a promising method for evaluating applications, namely for UX dimensions, either for functional prototypes or final products. Nevertheless, the validation of such hypothesis requires further and dedicated research.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Zhang, D., Adipat, B.: Challenges, methodologies, and issues in the usability testing of mobile applications. Int. J. Hum. Comput. Interact. 18, 293–308 (2005)
Treder, M., Pachucki, A., Zielonko, A., Lukasiewicz, K.: Mobile Book of Trends (2014)
Bank, C., Zuberi, W.: Mobile UI Design Patterns (2014)
Abreu, J., Almeida, P., Teles, B.: TV discovery & enjoy: a new approach to help users finding the right TV program to watch. In: Proceedings of the 2014 ACM International Conference on Interactive Experiences for TV and Online Video, pp. 63–70 (2014)
Roto, V., Law, E., Vermeeren, A., Hoonhout, J.: User experience white paper. In: Bringing Clarity to Concept User Exp., pp. 1–12 (2011)
T.N. Company: Screen wars: the battle for eye space in a TV-everywhere world (2015). http://www.nielsen.com/us/en/insights/reports/2015/screen-wars-the-battle-for-eye-space-in-a-tv-everywhere-world.html, Accessed: 13 June 2015
R. B. Media, Second Screen Series - Paper 1: Setting The Scene, vol. 1 (2012)
Hsu, S.H., Wen, M.-H., Lin, H.-C., Lee, C.-C., Lee, C.-H.: AIMED-A personalized TV recommendation system. In: European Conference on Interactive Television, pp. 166–174 (2007)
BBC Research & Development, “Sibyl Recommender System” (2012). http://sibyl.prototyping.bbc.co.uk/. Accessed: 26 Dec 2013
Krauss, C., George, L., Arbanowski, S.: New Systems Programming. TV predictor: personalized program recommendations to be displayed on SmartTVs. In: Proceedings of the 2nd Int. Work. Big Data Streams Heterog. Source Min. Algorithms Appl. BigMine 2013. Vol. 23, pp. 63–70. ACM, New York (2013)
Obrist, M., Bernhaupt, R., Tscheligi, M.: Interactive television for the home: An ethnographic study on users’ requirements and experiences. Int. J. HCI 24(2) (2008)
Gauntlett, D., Hill, A.: TV living: Television, culture and everyday life. Routledge (2002)
Law, E.: The measurability and predictability of user experience. In: Proceedings of EICS, pp. 1–10. ACM, New York (2011)
I.S.O. (ISO), Ergonomics of Human–System Interaction – Part 210: Human-centred Design for Interactive Systems (formerly known as 13407) (2010)
User Experience. https://en.wikipedia.org/wiki/User_experience. Accessed 13 Jan 2017
Vermeeren, A.P.O.S., Law, E.L.-C., Roto, V., Obrist, M., Hoonhout, J., Vananen-Vainio-Mattila, K.: User experience evaluation methods: current state and development needs. In: Proceedings of the 6th Nord. Conf. Human Computer Interact. Extending Boundaries, pp. 521–530. ACM (2010)
All about UX (2017). http://www.allaboutux.org/. Accessed 13 Jan 2017
Bernhaupt, R., Pirker, M.: Evaluating user experience for interactive television: towards the development of a domain-specific user experience questionnaire. In: Kotzé, P., Marsden, G., Lindgaard, G., Wesson, J., Winckler, M. (eds.) INTERACT 2013. LNCS, vol. 8118, pp. 642–659. Springer, Heidelberg (2013). doi:10.1007/978-3-642-40480-1_45
Drouet, D., Bernhaupt, R.: User experience evaluation methods: lessons learned from an interactive TV case-study. In: Bogdan, C., Gulliksen, J., Sauer, S., Forbrig, P., Winckler, M., Johnson, C., Palanque, P., Bernhaupt, R., Kis, F. (eds.) HCSE/HESSD -2016. LNCS, vol. 9856, pp. 351–358. Springer, Cham (2016). doi:10.1007/978-3-319-44902-9_22
Abreu, J., Almeida, P., Silva, T.: A UX evaluation approach for second-screen applications. In: Abásolo, M.J., Perales, Francisco J., Bibiloni, A. (eds.) jAUTI/CTVDI -2015. CCIS, vol. 605, pp. 105–120. Springer, Cham (2016). doi:10.1007/978-3-319-38907-3_9
Brooke, J., et al.: SUS-A quick and dirty usability scale. Usability Eval. Ind. 189(194), 4–7 (1996)
Attrakdiff (2017). http://www.attrakdiff.de/, Accessed 13 Jan 2017
Jenny Preece, H.S., Rogers, Y.: Interaction Design: Beyond Human-Computer Interaction (2015)
Benedek, J., Miner, T.: Measuring Desirability: New methods for evaluating desirability in a usability lab setting. Proc. Usability Prof. Assoc. 2003(8–12), 57 (2002)
Burzacca, P., Paternò, F.: Remote usability evaluation of mobile web applications. In: Kurosu, M. (ed.) HCI 2013. LNCS, vol. 8004, pp. 241–248. Springer, Heidelberg (2013). doi:10.1007/978-3-642-39232-0_27
Harrison, R., Flood, D., Duce, D.: Usability of mobile applications: literature review and rationale for a new usability model. J. Interact. Sci. 1(1), 1 (2013)
Pagano, D., Maalej, W.: User feedback in the appstore: an empirical study. In: 2013 21st IEEE International Requirements Engineering Conference (RE), pp. 125–134 (2013)
Nayebi, F., Desharnais, J.-M., Abran, A.: The state of the art of mobile application usability evaluation. 2012 25th IEEE Canadian Conference on Electrical and Computer Engineering, pp. 1–4, May 2012
Abreu, J., Almeida, P., Silva, T., Oliveira, R.: Discovering in a second screen app: perspectives from portuguese and brazilian markets. Procedia Comput. Sci. 64, 1240–1247 (2015)
Hassenzahl, M.: The interplay of beauty, goodness, and usability in interactive products. Hum.-Comput. Interact. 19(4), 319–349 (2004)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Ferraz de Abreu, J., Almeida, P., Beça, P. (2017). InApp Questions – an Approach for Contextual Evaluation of Applications. In: Abásolo, M., Almeida, P., Pina Amargós, J. (eds) Applications and Usability of Interactive TV. jAUTI 2016. Communications in Computer and Information Science, vol 689. Springer, Cham. https://doi.org/10.1007/978-3-319-63321-3_12
Download citation
DOI: https://doi.org/10.1007/978-3-319-63321-3_12
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-63320-6
Online ISBN: 978-3-319-63321-3
eBook Packages: Computer ScienceComputer Science (R0)