Nothing Special   »   [go: up one dir, main page]

skip to main content
research-article

Objective image quality assessment based on support vector regression

Published: 01 March 2010 Publication History

Abstract

Objective image quality estimation is useful in many visual processing systems, and is difficult to perform in line with the human perception. The challenge lies in formulating effective features and fusing them into a single number to predict the quality score. In this brief, we propose a new approach to address the problem, with the use of singular vectors out of singular value decomposition (SVD) as features for quantifying major structural information in images and then support vector regression (SVR) for automatic prediction of image quality. The feature selection with singular vectors is novel and general for gauging structural changes in images as a good representative of visual quality variations. The use of SVR exploits the advantages of machine learning with the ability to learn complex data patterns for an effective and generalized mapping of features into a desired score, in contrast with the oft-utilized feature pooling process in the existing image quality estimators; this is to overcome the difficulty of model parameter determination for such a system to emulate the related, complex human visual system (HVS) characteristics. Experiments conducted with three independent databases confirm the effectiveness of the proposed system in predicting image quality with better alignment with the HVS's perception than the relevant existing work. The tests with untrained distortions and databases further demonstrate the robustness of the system and the importance of the feature selection.

References

[1]
Z. Wang and A. C. Bovik, Modern Image Quality Assessment.. San Rafael, CA: Morgan & Claypool, 2006.
[2]
P. Barten, Contrast Sensitivity of the Human Eye and Its Effects on Image Quality.. Pittsburgh, PA: SPIE, 1999.
[3]
D. M. Rouse and S. S. Hemami, "Analyzing the role of visual structure in the recognition of natural image content with multi-scale SSIM," in Proc. Western New York Image Process. Workshop, Oct. 2007.
[4]
Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, "Image quality assessment: From error measurement to structural similarity," IEEE Trans. Image Process., vol. 13, no. 4, pp. 600-612, Apr. 2004.
[5]
W. Lin, L. Dong, and P. Xue, "Visual distortion gauge based on discrimination of noticeable contrast changes," IEEE Trans. Circuits Syst. Video Technol., vol. 15, no. 7, pp. 900-909, Jul. 2005.
[6]
A. Blum and P. Langley, "Selection of relevant features and examples in machine learning," Artif. Intell., vol. 97, no. 1-2, pp. 245-271, 1997.
[7]
M. P. Eckert and A. P. Bradley, "Perceptual quality metrics applied to still image compression," Signal Process., vol. 70, pp. 177-200, 1998.
[8]
P. Gastaldo, S. Rovetta, and R. Zunino, "Objective quality assessment of MPEG-2 video streams by using CBP neural networks," IEEE Trans. Neural Netw., vol. 13, no. 4, pp. 939-947, Jul. 2002.
[9]
P. L. Callet, V. G. Christian, and B. Dominique, "A convolutional neural network approach for objective video quality assessment," IEEE Trans. Neural Netw., vol. 17, no. 5, pp. 1316-1327, Sep. 2006.
[10]
A. Bouzerdoum, A. Havstad, and A. Beghdadi, "Image quality assessment using a neural network approach," in Proc. 4th IEEE Int. Symp. Signal Process. Inf. Technol., 2004, pp. 330-333.
[11]
P. Carrai, I. Heynderickz, P. Gastaldo, R. Zunino, and P. R. Monza, "Image quality assessment by using neural networks," in Proc. IEEE Int. Symp. Circuits Syst., vol. 5, pp. 253-256.
[12]
G. W. Stewart, "Stochastic perturbation theory," SIAM Rev., vol. 32, no. 4, pp. 579-610, 1990.
[13]
A. M. Eskicioglu, A. Gusev, and A. Shnayderman, "An SVD-based gray-scale image quality measure for local and global assessment," IEEE Trans. Image Process., vol. 15, no. 2, pp. 422-429, Feb. 2006.
[14]
Schölkopf and A. J. Smola, Learning With Kernels. Cambridge, MA: MIT Press, 2002.
[15]
D. M. Chandler and S. S. Hemami, "VSNR: A wavelet-based visual signal-to-noise ratio for natural images," IEEE Trans. Image Process., vol. 16, no. 9, pp. 2284-2298, Sep. 2007.
[16]
H. R. Sheikh, Z. Wang, A. C. Bovik, and L. K. Cormack, "Image and video quality assessment research at LIVE," {Online}. Available: http:// live.ece.utexas.edu/research/quality
[17]
P. Le Callet, "Florent Autrusseau subjective quality assessment IRCCyN/IVC database," {Online}. Available: http://www2.irccyn. ec-nantes.fr/ivcdb
[18]
A. M. Rohaly, J. Libert, P. Corriveau, and A. Webster, Eds., "Final report from the video quality experts group on the validation of objective models of video quality assessment," Mar. 2000 {Online}. Available: www.vqeg.org
[19]
Y. Horita, Y. Kawayoke, and Z. M. P. Sazzad, "Image quality evaluation database," {Online}. Available: http://160.26.142.130/ toyama_database.zip

Cited By

View all
  • (2023)Learning cascade regression for super-resolution image quality assessmentApplied Intelligence10.1007/s10489-023-04905-w53:22(27304-27322)Online publication date: 7-Sep-2023
  • (2022)A novel hybrid approach of ABC with SCA for the parameter optimization of SVR in blind image quality assessmentNeural Computing and Applications10.1007/s00521-021-06435-334:6(4165-4191)Online publication date: 1-Mar-2022
  • (2021)Assessment of Machine Learning-Based Audiovisual Quality PredictorsACM Transactions on Multimedia Computing, Communications, and Applications10.1145/343037617:2(1-22)Online publication date: 21-Apr-2021
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image IEEE Transactions on Neural Networks
IEEE Transactions on Neural Networks  Volume 21, Issue 3
March 2010
166 pages

Publisher

IEEE Press

Publication History

Published: 01 March 2010
Accepted: 20 December 2009
Revised: 12 October 2009
Received: 09 June 2009

Author Tags

  1. Image quality assessment
  2. image quality assessment
  3. image structure
  4. singular value decomposition (SVD)
  5. support vector regression (SVR)

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 24 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2023)Learning cascade regression for super-resolution image quality assessmentApplied Intelligence10.1007/s10489-023-04905-w53:22(27304-27322)Online publication date: 7-Sep-2023
  • (2022)A novel hybrid approach of ABC with SCA for the parameter optimization of SVR in blind image quality assessmentNeural Computing and Applications10.1007/s00521-021-06435-334:6(4165-4191)Online publication date: 1-Mar-2022
  • (2021)Assessment of Machine Learning-Based Audiovisual Quality PredictorsACM Transactions on Multimedia Computing, Communications, and Applications10.1145/343037617:2(1-22)Online publication date: 21-Apr-2021
  • (2021)An image retrieval scheme based on block level hybrid dct-svd fused featuresMultimedia Tools and Applications10.1007/s11042-020-10005-580:5(7271-7312)Online publication date: 1-Feb-2021
  • (2020)The Role of Attributes in Product Quality ComparisonsProceedings of the 2020 Conference on Human Information Interaction and Retrieval10.1145/3343413.3377956(253-262)Online publication date: 14-Mar-2020
  • (2020)Training Objective Image and Video Quality Estimators Using Multiple DatabasesIEEE Transactions on Multimedia10.1109/TMM.2019.293568722:4(961-969)Online publication date: 1-Apr-2020
  • (2020)ReDMarkExpert Systems with Applications: An International Journal10.1016/j.eswa.2019.113157146:COnline publication date: 15-May-2020
  • (2019)Subjective and Objective Quality Assessment of Stitched Images for Virtual RealityIEEE Transactions on Image Processing10.1109/TIP.2019.292185828:11(5620-5635)Online publication date: 1-Nov-2019
  • (2018)Dataset and Metrics for Predicting Local Visible DifferencesACM Transactions on Graphics10.1145/319649337:5(1-14)Online publication date: 26-Nov-2018
  • (2018)A perceptual quality metric for 3D triangle meshes based on spatial poolingFrontiers of Computer Science: Selected Publications from Chinese Universities10.1007/s11704-017-6328-x12:4(798-812)Online publication date: 1-Aug-2018
  • Show More Cited By

View Options

View options

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media