Abstract
No-reference image quality assessment (NR-IQA) aims to evaluate the perceived quality of distorted images without prior knowledge of pristine version of the images. The quality score is predicted based on the features extracted from the distorted image, which needs to correlate with the mean opinion score. The prediction of an image quality score becomes a trivial task, if the noise affecting the quality of an image can be modeled. In this paper, gradient magnitude and Wiener filtered discrete wavelet coefficients are utilized for image quality assessment. In order to reconstruct an estimated noise image, Wiener filter is applied to discrete wavelet coefficients. The estimated noise image and the gradient magnitude are modeled as conditional Gaussian random variables. Joint adaptive normalization is applied to the conditional random distribution of the estimated noise image and the gradient magnitude to form a feature vector. The feature vector is used as an input to a pre-trained support vector regression model to predict the image quality score. The proposed NR-IQA is tested on five commonly used image quality assessment databases and shows better performance as compared to the existing NR-IQA techniques. The experimental results show that the proposed technique is robust and has good generalization ability. Moreover, it also shows good performance when training is performed on images from one database and testing is performed on images from another database.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Bosse S, Maniry D, Müller K-R, Wiegand T, Samek W (2016) Neural network-based full-reference image quality assessment. In: Picture coding symposium (PCS), 2016. IEEE, pp 1–5
Fang Y, Ma K, Wang Z, Lin W, Fang Z, Zhai G (2015) No-reference quality assessment of contrast-distorted images based on natural scene statistics. IEEE Signal Process Lett 22(7):838–842
Ferzli R, Karam LJ (2009) A no-reference objective image sharpness metric based on the notion of just noticeable blur (jnb). IEEE Trans Image Process 18(4):717–728
Golestaneh S, Karam LJ (2016) Reduced-reference quality assessment based on the entropy of dwt coefficients of locally weighted gradient magnitudes. IEEE Trans Image Process 25(11):5293–5303
Gu K, Zhai G, Yang X, Zhang W (2015) Using free energy principle for blind image quality assessment. IEEE Trans Multimed 17(1):50–63
Guan J, Zhang W, Gu J, Ren H (2015) No-reference blur assessment based on edge modeling. J Vis Commun Image Represent 29:1–7
Heeger DJ (1992) Normalization of cell responses in cat striate cortex. Vis Neurosci 9(2):181–197
Hore A, Ziou D (2010) Image quality metrics: Psnr vs. ssim. In: 2010 20th international conference on pattern recognition (icpr). IEEE, pp 2366–2369
Huang Y, Chen X, Ding X (2016) A harmonic means pooling strategy for structural similarity index measurement in image quality assessment. Multimed Tools Appl 75(5):2769–2780
Huynh-Thu Q, Ghanbari M (2008) Scope of validity of psnr in image/video quality assessment. Electron Lett 44(13):800–801
Jenadeleh M, Moghaddam ME (2017) Biqws: efficient wakeby modeling of natural scene statistics for blind image quality assessment. Multimed Tools Appl 76(12):13859–13880
Kazubek M (2003) Wavelet domain image denoising by thresholding and wiener filtering. IEEE Signal Process Lett 10(11):324–326
Kerouh F, Serir A (2014) A perceptual blind blur image quality metric. In: 2014 IEEE international conference on acoustics, speech and signal processing (ICASSP). IEEE, pp 2784–2788
Khosravi MH, Hassanpour H (2017) Model-based full reference image blurriness assessment. Multimed Tools Appl 76(2):2733–2747
Kim D-O, Han H-S, Park R-H (2010) Gradient information-based image quality metric, IEEE Trans Consum Electron 56(2):930–936
Kristan M, Perš J, Perše M, Kovačič S (2006) A bayes-spectral-entropy-based measure of camera focus using a discrete cosine transform. Pattern Recognit Lett 27(13):1431–1439
Larson EC, Chandler DM (2010) Most apparent distortion: full-reference image quality assessment and the role of strategy. J Electron Imaging 19(1):011006–011006
Lee D, Plataniotis KN (2016) Toward a no-reference image quality assessment using statistics of perceptual color descriptors. IEEE Trans Image Process 25(8):3875–3889
Li C, Bovik AC (2010) Content-partitioned structural similarity index for image quality assessment. Signal Process Image Commun 25(7):517–526
Li Y, Po L-M, Xu X, Feng L, Yuan F, Cheung C-H, Cheung K-W (2015) No-reference image quality assessment with shearlet transform and deep neural networks. Neurocomputing 154:94–109
Li Q, Lin W, Xu J, Fang Y (2016) Blind image quality assessment using statistical structural and luminance features. IEEE Trans Multimedia 18(12):2457–2469
Li J, Zou L, Yan J, Deng D, Qu T, Xie G (2016) No-reference image quality assessment using prewitt magnitude based on convolutional neural networks. Signal Image and Video Process 10(4): 609–616
Liu A, Lin W, Narwaria M (2012) Image quality assessment based on gradient similarity. IEEE Trans Image Process 21(4):1500–1512
Liu L, Dong H, Huang H, Bovik AC (2014) No-reference image quality assessment in curvelet domain. Signal Process Image Commun 29(4):494–505
Liu X, Pedersen M, Hardeberg JY (2014) Cid: Iq–a new image quality database. In: International conference on image and signal processing. Springer, pp 193–202
Liu L, Hua Y, Zhao Q, Huang H, Bovik AC (2016) Blind image quality assessment by relative gradient statistics and adaboosting neural network. Signal Process Image Commun 40:1–15
Liu M, Gu K, Zhai G, Le Callet P, Zhang W (2017) Perceptual reduced-reference visual quality assessment for contrast alteration. IEEE Trans Broadcast 63(1):71–81
Liu D, Li F, Song H (2017) Regularity of spectral residual for reduced reference image quality assessment. IET Image Process 11(12):1135–1141
Lu W, Xu T, Ren Y, He L (2016) Statistical modeling in the shearlet domain for blind image quality assessment. Multimed Tools Appl 75(22):14417–14431
Lyu S, Simoncelli EP (2008) Nonlinear image representation using divisive normalization. In: IEEE conference on computer vision and pattern recognition, CVPR 2008. IEEE, pp 1–8
Maalouf A , Larabi M-C (2010) A no reference objective color image sharpness metric. In: 2010 18th European signal processing conference. IEEE, pp 1019–1022
Manap RA, Shao L, Frangi AF (2017) Patch-iq: a patch based learning framework for blind image quality assessment. Inf Sci 420:329–344
Mittal A, Moorthy AK, Bovik AC (2012) No-reference image quality assessment in the spatial domain. IEEE Trans Image Process 21(12):4695–4708
Mittal A, Soundararajan R, Bovik AC (2013) Making a “completely blind” image quality analyzer. IEEE Signal Process Lett 20(3):209–212
Moorthy AK, Bovik AC (2010) A two-step framework for constructing blind image quality indices. IEEE Signal Process Lett 17(5):513–516
Moorthy AK, Bovik AC (2011) Blind image quality assessment: from natural scene statistics to perceptual quality. IEEE Trans Image Process 20(12):3350–3364
Ni Z, Ma L, Zeng H, Chen J, Cai C, Ma K-K (2017) Esim: Edge similarity for screen content image quality assessment. IEEE Trans Image Process 26(10):4818–4831
Nizami IF, Majid M, Afzal H, Khurshid K (2017) Impact of feature selection algorithms on blind image quality assessment. Arab J Sci Eng 43(8):4057–4070
Nizami IF, Majid M, Khurshid K (2017) Efficient feature selection for blind image quality assessment based on natural scene statistics. In: 2017 14th international bhurban conference on applied sciences and technology (IBCAST). IEEE, pp 318–322
Nizami IF, Majid M, Khurshid K (2018) New feature selection algorithms for no-reference image quality assessment. Appl Intell 48:3482–3501
Omari M, El Hassouni M, Abdelouahad AA, Cherifi H (2015) A statistical reduced-reference method for color image quality assessment. Multimed Tools Appl 74(19):8685–8701
Ponomarenko N, Jin L, Ieremeiev O, Lukin V, Egiazarian K, Astola J, Vozel B, Chehdi K, Carli M, Battisti F et al (2015) Image database tid2013: peculiarities, results and perspectives. Signal Process Image Commun 30:57–77
Ponomarenko N, Lukin V, Zelensky A, Egiazarian K, Carli M, Battisti F (2009) Tid2008-a database for evaluation of full-reference visual quality assessment metrics. Adv Mod Radioelectron 10(4): 30–45
Portilla J, Strela V, Wainwright MJ, Simoncelli EP (2001) Adaptive wiener denoising using a gaussian scale mixture model in the wavelet domain. In: Proceedings 2001 international conference on image processing, vol 2. IEEE, pp 37–40
Rao RP, Olshausen BA, Lewicki MS, Jordan MI, Dietterich TG (eds) (2002) Probabilistic models of the brain: perception and neural function. MIT Press, Cambridge
Rezaie F, Helfroush MS, Danyali H (2017) No-reference image quality assessment using local binary pattern in the wavelet domain. Multimed Tools Appl 77(2):2529–2541
Saad MA, Bovik AC, Charrier C (2012) Blind image quality assessment: a natural scene statistics approach in the dct domain. IEEE Trans Image Process 21(8):3339–3352
Saha A, Wu QJ (2016) Full-reference image quality assessment by combining global and local distortion measures. Signal Process 128:186–197
Sang Q, Qi H, Wu X, Li C, Bovik AC (2014) No-reference image blur index based on singular value curve. J Vis Commun Image Represent 25(7):1625–1630
Serir A, Beghdadi A, Kerouh F (2013) No-reference blur image quality measure based on multiplicative multiresolution decomposition. J Vis Commun Image Represent 24(7):911–925
Sheikh HR, Sabir MF, Bovik AC (2006) A statistical evaluation of recent full reference image quality assessment algorithms. IEEE Trans Image Process 15(11):3440–3451
Wang Z, Bovik AC, Sheikh HR, Simoncelli EP (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13(4):600–612
Wang C, Shen M, Yao C (2015) No-reference quality assessment for dct-based compressed image. J Vis Commun Image Represent 28:53–59
Wu J, Lin W, Shi G, Li L, Fang Y (2016) Orientation selectivity based visual pattern for reduced-reference image quality assessment. Inf Sci 351:18–29
Wu J, Xia Z, Li H, Sun K, Gu K, Lu H (2017) No-reference image quality assessment with center-surround based natural scene statistics. Multimed Tools Appl 77:20731–20751
Wu M, Chen L, Tian J (2018) A hybrid learning-based framework for blind image quality assessment. Multidim Syst Sign Process 29(3):839–849
Xu S, Jiang S, Min W (2017) No-reference/blind image quality assessment: a survey. IETE Tech Rev 34(3):223–245
Xue W, Mou X, Zhang L, Bovik AC, Feng X (2014) Blind image quality assessment using joint statistics of gradient magnitude and laplacian features. IEEE Trans Image Process 23(11):4850–4862
Ye P, Kumar J, Kang L, Doermann D (2012) Unsupervised feature learning framework for no-reference image quality assessment. In: 2012 IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 1098–1105
Yoneyama A, Minamoto T (2015) No-reference image blur assessment in the dwt domain and blurred image classification. In: 2015 12th international conference on information technology-new generations (ITNG). IEEE, pp 329–334
Zhang L, Zhang L, Mou X, Zhang D (2011) Fsim: a feature similarity index for image quality assessment. IEEE Trans Image Process 20(8):2378–2386
Zhang Y, Moorthy AK, Chandler DM, Bovik AC (2014) C-diivine: no-reference image quality assessment based on local magnitude and phase statistics of natural scenes. Signal Process Image Commun 29(7):725–747
Zhang M, Muramatsu C, Zhou X, Hara T, Fujita H (2015) Blind image quality assessment using the joint statistics of generalized local binary pattern. IEEE Signal Process Lett 22(2):207–210
Zhang L, Zhang L, Bovik AC (2015) A feature-enriched completely blind image quality evaluator. IEEE Trans Image Process 24(8):2579–2591
Zhang C, Pan J, Chen S, Wang T, Sun D (2016) No reference image quality assessment using sparse feature representation in two dimensions spatial correlation. Neurocomputing 173:462–470
Zhang Y, Wu J, Xie X, Li L, Shi G (2016) Blind image quality assessment with improved natural scene statistics model. Digital Signal Process 57:56–65
Zhang Y, Phan TD, Chandler DM (2017) Reduced-reference image quality assessment based on distortion families of local perceived sharpness. Signal Process Image Commun 55:130–145
Zhou W, Yu L, Qiu W, Zhou Y, Wu M (2017) Local gradient patterns (lgp): an effective local-statistical-feature extraction scheme for no-reference image quality assessment. Inf Sci 397:1–14
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Khan, M., Nizami, I.F. & Majid, M. No-reference image quality assessment using gradient magnitude and wiener filtered wavelet features. Multimed Tools Appl 78, 14485–14509 (2019). https://doi.org/10.1007/s11042-018-6797-4
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-018-6797-4