Article

Techniques for measuring quality of experience

Authors:

Fernando Kuipers,

Danny De Vleeschauwer,

Kjell BrunnströmAuthors Info & Claims

WWIC'10: Proceedings of the 8th international conference on Wired/Wireless Internet Communications

Pages 216 - 227

https://doi.org/10.1007/978-3-642-13315-2_18

Published: 01 June 2010 Publication History

Abstract

Quality of Experience (QoE) relates to how users perceive the quality of an application. To capture such a subjective measure, either by subjective tests or via objective tools, is an art on its own. Given the importance of measuring users’ satisfaction to service providers, research on QoE took flight in recent years. In this paper we present an overview of various techniques for measuring QoE, thereby mostly focusing on freely available tools and methodologies.

References

[1]

Armitage, G., Stewart, L.: Limitations of using Real-World, Public Servers to Estimate Jitter Tolerance Of First Person Shooter Games. In: Proc. of ACM SIGCHI ACE2004 Conference, Singapore (June 2004)

Digital Library

[2]

Beigbeder, T., Coughlan, R., Lusher, C., Plunkett, J., Agu, E., Claypool, M.: The Effect of Loss and Latency on User Performance in Unreal Tournament 2003 R. In: Proc. of NetGames'04, Oregon, USA (2004)

Digital Library

[3]

Van den Branden Lambrecht, C.J., Verscheure, O.: Perceptual quality measure using a spatiotemporal model of the human visual system. In: Proc. of SPIE, vol. 2668, pp. 450-461 (1996)

[4]

Chen, K.-T., Huang, C.-Y., Huang, P., Lei, C.-L.: Quantifying Skype User Satisfaction. In: Proc. of SIGCOMM'06, Pisa, Italy, September 11-15 (2006)

Digital Library

[5]

Davis, A.G., Bayart, D., Hands, D.S.: Hybrid No-Reference Video Quality Prediction. In: Proc. of IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB), Bilbao, Spain, May 13-15 (2009)

[6]

Degrande, N., Laevens, K., De Vleeschauwer, D., Sharpe, R.: Increasing the user perceived quality for IPTV services. IEEE Communications Magazine 46(2), 94- 100 (2008)

Digital Library

[7]

Dick, M., Wellnitz, O., Wolf, L.: Analysis of factors affecting Players' Performance and Perception in Multiplayer Games. In: Proc. of NetGames'05, Hawthorne, NY, USA (2005)

Digital Library

[8]

Godana, B.E., Kooij, R.E., Ahmed, O.K.: Impact of Advertisements during Channel Zapping on Quality of Experience. In: Proc. of The Fifth International Conference on Networking and Services, ICNS 2009, Valencia, Spain, April 20-25 (2009)

Digital Library

[9]

Huynh-Thu, Q., Ghanbari, M.: Scope of validity of PSNR in image/video quality assessment. Electronics letters 44(13) (June 19, 2008)

[10]

Janssen, J., De Vleeschauwer, D., Büchli, M.J.C., Petit, G.H.: Assessing Voice Quality in Packet-Based Telephony. IEEE Internet Computing 6(3), 48-56 (2002)

Digital Library

[11]

Ke, C.-H., Shieh, C.-K., Hwang, W.-S., Ziviani, A.: An Evaluation Framework for More Realistic Simulations of MPEG Video Transmission. Journal of Information Science and Engineering 24, 425-440 (2008)

[12]

Klaue, J., Rathke, B., Wolisz, A.: EvalVid - A framework for video transmission and quality evaluation. In: Proc. of the International Conference on Modelling Techniques and Tools for Computer Performance Evaluation, pp. 255-272 (2003)

[13]

Kooij, R.E., Ahmed, O.K., Brunnström, K.: Perceived Quality of Channel Zapping. In: Proc. of the fifth IASTED International Conference on Comm. Systems and Networks, Palma de Mallorca, Spain, August 28-30, pp. 155-158 (2006)

[14]

Kooij, R.E., Nicolai, F., Ahmed, O.K., Brunnström, K.: Model validation of channel zapping quality. In: Proc. of Human Vision and Electronic Imaging Conf., January 19-22 (2009)

[15]

Lu, Y., Fallica, B., Kuipers, F.A., Kooij, R.E., Van Mieghem, P.: Assessing the Quality of Experience of SopCast. Int. J. Internet Protocol Technology 4(1), 11-23 (2009)

Digital Library

[16]

Lu, Y., Zhao, Y., Kuipers, F.A., Van Mieghem, P.: Measurement Study of Multiparty Video Conferencing. In: Proc. of IFIP Networking 2010, Chennai, India, May 10-14 (2010)

Digital Library

[17]

Pinson, M., Wolf, S.: A New Standardized Method for Objectively Measuring Video Quality. IEEE Transactions on Broadcasting 50(3) (September 2004)

[18]

Takahasi, A., Hands, D., Barriac, V.: Standardization Activities in the ITU for a QoE Assesment of IPTV. IEEE Communications Magazine, 78-84 (February 2008)

Digital Library

[19]

Wang, Z., Li, Q.: Video quality assessment using a statistical model of human visual speed perception. Journal of the Optical Society of America A 24(12), B61-B69 (2007)

[20]

Wang, Z., Bovik, A.C.: Mean squared error: love it or leave it? - A new look at signal fidelity measures. IEEE Signal Processing Magazine 26(1), 98-117 (2009)

[21]

Wattimena, F., Kooij, R.E., van Vugt, J.M., Ahmed, O.K.: Predicting the perceived quality of a First Person Shooter: the Quake IV G-model. In: Proc. of NetGames'06, Singapore, October 30-31 (2006)

Digital Library

[22]

Zander, S., Armitage, G.: Empirically Measuring the QoS Sensitivity of Interactive Online Game Players. In: Proc. of Australian Telecommunications Networks & Applications Conference 2004, Sydney, Australia (December 2004)

Cited By

Moharana BKeighrey CScott DMurray NKeighrey C(2022)Subjective evaluation of group user QoE in collaborative virtual environment (CVE)Proceedings of the 14th International Workshop on Immersive Mixed and Virtual Environment Systems10.1145/3534086.3534333(23-29)Online publication date: 14-Jun-2022
https://dl.acm.org/doi/10.1145/3534086.3534333
Suznjevic MSkorin-Kapov LCerekovic AMatijasevic M(2019)How to measure and model QoE for networked games?Multimedia Systems10.1007/s00530-019-00615-x25:4(395-420)Online publication date: 1-Aug-2019
https://dl.acm.org/doi/10.1007/s00530-019-00615-x
Sutika TFunilkul STriyason TSupattatham M(2018)Quality of Smartphone User Experience AnalysisProceedings of the 10th International Conference on Advances in Information Technology10.1145/3291280.3291784(1-6)Online publication date: 10-Dec-2018
https://dl.acm.org/doi/10.1145/3291280.3291784
Show More Cited By

Recommendations

Profiting by Experience
Mathematical Drawing and Measuring Instruments
Measuring and Comparing Effectiveness of Data Quality Techniques
CAiSE '09: Proceedings of the 21st International Conference on Advanced Information Systems Engineering

Poor quality data may be detected and corrected by performing various quality assurance activities that rely on techniques with different efficacy and cost. In this paper, we propose a quantitative approach for measuring and comparing the effectiveness ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Guide Proceedings

WWIC'10: Proceedings of the 8th international conference on Wired/Wireless Internet Communications

June 2010

397 pages

ISBN:3642133142

Editors:
Evgeny Osipov
Department of Computer Science and Electrical Engineering, Luleå University of Technology, Luleå, Sweden
,
Andreas Kassler
Computer Science Department, Karlstad University, Universitetgetan 2, Karlstad, Sweden
,
Thomas Michael Bohnert
Computer Science Department, CEC Zurich, Kreuzplatz 20, Zurich, Switzerland
,
Xavier Masip-Bruin
Departament d'Arquitectura de Computadors, Universitat Politècnica de Catalunya, Avgda. Víctor Balaguer, s/n, Barcelona, Spain

Sponsors

ERICSSON
Luleå Univ. of Techn.: Luleå University of Technology
CDT: CDT

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 01 June 2010

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 10 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Moharana BKeighrey CScott DMurray NKeighrey C(2022)Subjective evaluation of group user QoE in collaborative virtual environment (CVE)Proceedings of the 14th International Workshop on Immersive Mixed and Virtual Environment Systems10.1145/3534086.3534333(23-29)Online publication date: 14-Jun-2022
https://dl.acm.org/doi/10.1145/3534086.3534333
Suznjevic MSkorin-Kapov LCerekovic AMatijasevic M(2019)How to measure and model QoE for networked games?Multimedia Systems10.1007/s00530-019-00615-x25:4(395-420)Online publication date: 1-Aug-2019
https://dl.acm.org/doi/10.1007/s00530-019-00615-x
Sutika TFunilkul STriyason TSupattatham M(2018)Quality of Smartphone User Experience AnalysisProceedings of the 10th International Conference on Advances in Information Technology10.1145/3291280.3291784(1-6)Online publication date: 10-Dec-2018
https://dl.acm.org/doi/10.1145/3291280.3291784
Louafi HCoulombe SCheriet M(2018)A TOPSIS-based QoE model for adapted content selection of slide documentsMultimedia Tools and Applications10.1007/s11042-018-5887-777:20(26741-26768)Online publication date: 1-Oct-2018
https://dl.acm.org/doi/10.1007/s11042-018-5887-7
Botia Valderrama DGaviria Gómez N(2016)Nonintrusive method based on neural networks for video Quality of Experience assessmentAdvances in Multimedia10.1155/2016/17308142016(1-1)Online publication date: 1-Jan-2016
https://dl.acm.org/doi/10.1155/2016/1730814
Skarseth KBjørlo HHalvorsen PRiegler MGriwodz CHanjalic ASnoek CWorring MBulterman DHuet BKelliher AKompatsiaris YLi J(2016)OpenVQProceedings of the 24th ACM international conference on Multimedia10.1145/2964284.2973800(1197-1200)Online publication date: 1-Oct-2016
https://dl.acm.org/doi/10.1145/2964284.2973800
Kamyod CNielsen RPrasad NPrasad R(2016)A Novel Estimation Framework for Quality of ResilienceWireless Personal Communications: An International Journal10.1007/s11277-016-3395-590:3(1369-1386)Online publication date: 1-Oct-2016
https://dl.acm.org/doi/10.1007/s11277-016-3395-5
Märtens MShen SIosup AKuipers F(2015)Toxicity detection in multiplayer online gamesProceedings of the 2015 International Workshop on Network and Systems Support for Games10.5555/2984075.2984080(1-6)Online publication date: 3-Dec-2015
https://dl.acm.org/doi/10.5555/2984075.2984080
Vasileva-Stojanovska TVasileva MMalinovski TTrajkovik V(2015)An ANFIS model of quality of experience prediction in educationApplied Soft Computing10.1016/j.asoc.2015.04.04734:C(129-138)Online publication date: 1-Sep-2015
https://dl.acm.org/doi/10.1016/j.asoc.2015.04.047
Howard ECooper CWittie MSwinford SYang QIshibashi YCheok A(2014)Cascading impact of lag on quality of experience in cooperative multiplayer gamesProceedings of the 13th Annual Workshop on Network and Systems Support for Games10.5555/2755535.2755551(1-6)Online publication date: 4-Dec-2014
https://dl.acm.org/doi/10.5555/2755535.2755551
Show More Cited By

View Options

View options

Media

Figures

Other

Tables

View Table of Contents