Abstract
The transmission and analysis of video is often used for a variety of applications outside the entertainment sector, and generally this class of video is used to perform a specific task. Therefore it is crucial to measure, and ultimately, optimize task-based video quality. To develop accurate objective measurements and models for video quality assessment, subjective experiments must be performed. Problems of quality measurements for task-based video are partially addressed in a few preliminary standards and a Recommendation (ITU-T P.912, “Subjective Video Quality Assessment Methods for Recognition Tasks,”) that mainly introduce basic definitions, methods of testing and requirements for subjects taking part in psychophysical experiments. Nevertheless, to the best of the authors’ knowledge, the issue of requirements for subjects has been not verified in any specific academic research. Consequently, in this paper, we compare groups of subjects assessing video quality for task-based video. Once a comparison has been made for task-based video, specifications amendments for P.912 are developed. These will assist researchers of task-based video quality in identifying the subjects that will allow them to successfully perform the psychophysical experiment required.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
ANSI S3.2, American National Standard Method for Measuring the Intelligibility of Speech over Communications Systems (1989)
ITU-T P.800, Methods for subjective determination of transmission quality (1996), http://www.itu.int/rec/T-REC-P.800-199608-I
ITU-T P.910, Subjective video quality assessment methods for multimedia applications (1999), http://www.itu.int/rec/T-REC-P.910-200804-I
ITU-T P.912, Subjective video quality assessment methods for recognition tasks (2008), http://www.itu.int/rec/T-REC-P.912-200808-I
ITU-R BT.500-12, Methodology for the subjective assessment of the quality of television pictures (2009), http://www.itu.int/rec/R-REC-BT.500-12-200909-I
CENELEC EN 50132, Alarm systems. CCTV surveillance systems for use in security applications (2011)
Ford, C.G., McFarland, M.A., Stange, I.W.: Subjective video quality assessment methods for recognition tasks. In: Proceedings of SPIE, vol. 7240, 72400Z–72400Z–11 (2009)
Leszczuk, M., Stange, I., Ford, C.: Determining image quality requirements for recognition tasks in generalized public safety video applications: Definitions, testing, standardization, and current trends. In: 2011 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB), pp. 1–5 (June 2011)
Leszczuk, M.: Assessing Task-Based Video Quality — A Journey from Subjective Psycho-Physical Experiments to Objective Quality Models. In: Dziech, A., Czyżewski, A. (eds.) MCSS 2011. CCIS, vol. 149, pp. 91–99. Springer, Heidelberg (2011), http://dx.doi.org/10.1007/978-3-642-21512-4_11
Spangler, T.: Golden eyes. Multichannel News (October 2009)
Szczuko, P., Romaniak, P., Leszczuk, M., Mirek, R., Pleva, M., Ondas, S., Szwoch, G., Korus, P., Kollmitzer, C., Dalka, P., Kotus, J., Ciarkowski, A., Dąbrowski, A., Pawłowski, P., Marciniak, T., Weychan, R., Misiorek, F.: D1.2, report on ns and cs hardware construction. Tech. rep., The INDECT Consortium: Intelligent Information System Supporting Observation, Searching and Detection for Security of Citizens in Urban Environment, European Seventh Framework Programme FP7-218086-collaborative project, Europa (2010), cop.
VQEG: The Video Quality Experts Group, http://www.vqeg.org/
VQiPS: Video quality tests for object recognition applications. Public Safety Communications DHS-TR-PSC-10-09, U.S. Department of Homeland Security’s Office for Interoperability and Compatibility (June 2010)
VQiPS: Recorded-video quality tests for object recognition tasks. Public Safety Communications DHS-TR-PSC-11-01, U.S. Department of Homeland Security’s Office for Interoperability and Compatibility (June 2011)
Watson, A.: Video acuity: A metric to quantify the effective performance of video systems. In: Imaging Systems Applications, p. IMD3. Optical Society of America (2011), http://www.opticsinfobase.org/abstract.cfm?URI=IS-2011-IMD3
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Leszczuk, M.I., Koń, A., Dumke, J., Janowski, L. (2012). Redefining ITU-T P.912 Recommendation Requirements for Subjects of Quality Assessments in Recognition Tasks. In: Dziech, A., Czyżewski, A. (eds) Multimedia Communications, Services and Security. MCSS 2012. Communications in Computer and Information Science, vol 287. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-30721-8_19
Download citation
DOI: https://doi.org/10.1007/978-3-642-30721-8_19
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-30720-1
Online ISBN: 978-3-642-30721-8
eBook Packages: Computer ScienceComputer Science (R0)