Nothing Special   »   [go: up one dir, main page]
Skip to main content

Advertisement

SpringerLink
Log in

Multiply distorted image quality assessment based on feature level fusion and optimal feature selection

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

No reference image quality assessment (NR-IQA) has received considerable importance in the last decade due to a rise in the use of multimedia content in our daily lives. Due to limitations in technology, multiple distortions may be introduced in the images that need to be assessed. Recently feature selection has shown promising results for single distorted NR-IQA and their effectiveness on multiple distorted images still need to be addressed. In this paper, impact of feature level fusion and feature selection on multiple distorted image quality assessment is presented. To this end features are extracted from multiple distorted images using six NR-IQA techniques (BLIINDS-II, BRISQUE, CurveletQA, DIIVINE, GM-LOG, SSEQ) that extract features in different (discrete cosine transform, spatial, curvelet transform, wavelet transform, spatial and gradient, spatial and spectral) domains. The extracted features from different domains are fused to generate a single feature vector. All combinations of feature-level fusion from six different techniques have been evaluated. Three different feature selection algorithms (genetic search, linear forward search, particle swarm optimization) are then applied to select optimum features for NR-IQA. The selected features are then used by the support vector regression model to predict the quality score. The performance of the proposed methodology is evaluated for two multiple distorted IQA databases (LIVE multiple distorted image dataset (LIVEMD), multiply distorted image database (MDID2017)), two singly synthetically distorted IQA databases (Tampere image database (TID2013), Computational and subjective image quality database (CSIQ)), and one screen content IQA database (Screen content image quality database (SIQAD)). Experimental results show that the fusion of features from different domains gives better performance in comparison to existing multiple-distorted NR-IQA techniques with SROCC scores of 0.9555, 0.9587, 0.6892, 0.9452, and 0.7682 on the LIVEMD, MDID, TID2013, CSIQ, and SIQAD databases respectively. Moreover, the performance is further improved when the genetic search feature selection algorithm is applied to fused features to remove the redundant and irrelevant features. The SROCC scores are improved to 0.9691, 0.9723, and 0.6897 for LIVEMD, MDID, and TID2013 databases respectively.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  1. Chen Y, Wang J, Chen X, Zhu M, Yang K, Wang Z, Xia R (2019) Single-image super-resolution algorithm based on structural self-similarity and deformation block features. IEEE Access 7:58791–58801

    Article  Google Scholar 

  2. Chen Y, Wang J, Liu S, Chen X, Xiong J, Xie J, Yang K (2019) Multiscale fast correlation filtering tracking algorithm based on a feature fusion model. Concurrency and Computation: Practice and Experience: e5533

  3. Chen Y, Wang J, Xia R, Zhang Q, Cao Z, Yang K (2019) The visual object tracking algorithm research based on adaptive combination kernel. Journal of Ambient Intelligence and Humanized Computing 10(12):4855–4867

    Article  Google Scholar 

  4. Chen Y, Xiong J, Xu W, Zuo J (2019) A novel online incremental and decremental learning algorithm based on variable support vector machine. Clust Comput 22(3):7435–7445

    Article  Google Scholar 

  5. Chen Y, Xu W, Zuo J, Yang K (2019) The fire recognition algorithm using dynamic feature fusion and iv-svm classifier. Clust Comput 22(3):7665–7675

    Article  Google Scholar 

  6. Chen Y, Liu L, Tao J, Xia R, Zhang Q, Yang K, Xiong J, Chen X (2020) The improved image inpainting algorithm via encoder and similarity constraint. Vis Comput: 1–15

  7. Chen Y, Tao J, Liu L, Xiong J, Xia R, Xie J, Zhang Q, Yang K (2020) Research of improving semantic image segmentation based on a feature fusion model. Journal of Ambient Intelligence and Humanized Computing

  8. Chen Y, Tao J, Zhang Q, Yang K, Chen X, Xiong J, Xia R, Xie J (2020) Saliency detection via the improved hierarchical principal component analysis method. Wireless Communications and Mobile Computing

  9. Dai T, Gu K, Niu L, Zhang Y-B, Lu W, Xia S-T (2018) Referenceless quality metric of multiply-distorted images based on structural degradation. Neurocomputing 290:185–195

    Article  Google Scholar 

  10. Gu K, Zhai G, Yang X, Zhang W (2014) Hybrid no-reference quality metric for singly and multiply distorted images. IEEE Trans Broadcast 60 (3):555–567

    Article  Google Scholar 

  11. Gutlein M, Frank E, Hall M, Karwath A (2009) Large-scale attribute selection using wrappers. In: IEEE Symposium on computational intelligence and data mining, 2009. CIDM’09. IEEE, pp 332–339

  12. Jayaraman D, Mittal A, Moorthy AK, Bovik AC (2012) Objective quality assessment of multiply distorted images. In: 2012 conference record of the forty sixth asilomar conference on signals, systems and computers, ASILOMAR. IEEE, pp 1693–1697

  13. Jiang Q, Shao F, Gao W, Chen Z, Jiang G, Ho Y-S (2018) Unified no-reference quality assessment of singly and multiply distorted stereoscopic images. IEEE Trans Image Process 28(4):1866–1881

    Article  MathSciNet  Google Scholar 

  14. Kalatehjari E, Yaghmaee F (2018) A new reduced-reference image quality assessment based on the svd signal projection. Multimedia Tools and Applications 77(19):25053–25076

    Article  Google Scholar 

  15. Kennedy J. (2011) Particle swarm optimization. In: Encyclopedia of machine learning. Springer, Berlin, pp 760–766

  16. Larson EC, Chandler DM (2010) Most apparent distortion: full-reference image quality assessment and the role of strategy. Journal of Electronic Imaging 19(1):011006

    Article  Google Scholar 

  17. Lay DC (2006) Linear algebra and its applications third edition update, University of Maryland, College Park

  18. Li Q, Lin W, Fang Y (2016) No-reference quality assessment for multiply-distorted images in gradient domain. IEEE Signal Processing Letters 23(4):541–545

    Article  Google Scholar 

  19. Li C, Li Y, Yuan Y, Wu X, Sang Q (2018) Quaternion wavelet transform based full reference image quality assessment for multiply distorted images. PloS one 13(6)

  20. Li C, Zhang Y, Wu X, Zheng Y (2018) A multi-scale learning local phase and amplitude blind image quality assessment for multiply distorted images. IEEE Access 6:64577–64586

    Article  Google Scholar 

  21. Liao X, Li K, Yin J (2017) Separable data hiding in encrypted image based on compressive sensing and discrete fourier transform. Multimedia Tools and Applications 76(20):20739–20753

    Article  Google Scholar 

  22. Liu L, Dong H, Huang H, Bovik AC (2014) No-reference image quality assessment in curvelet domain. Signal Processing: Image Communication 29(4):494–505

    Google Scholar 

  23. Liu L, Liu B, Huang H, Bovik AC (2014) No-reference image quality assessment based on spatial and spectral entropies. Signal Processing: Image Communication 29(8):856–863

    Google Scholar 

  24. Luo Y, Qin J, Xiang X, Tan Y, Liu Q, Xiang L (2020) Coverless real-time image information hiding based on image block matching and dense convolutional network. J Real-Time Image Proc 17(1):125–135

    Article  Google Scholar 

  25. Miao X, Chu H, Liu H, Yang Y, Li X (2019) Quality assessment of images with multiple distortions based on phase congruency and gradient magnitude. Signal Processing: Image Communication 79:54–62

    Google Scholar 

  26. Min X, Gu K, Zhai G, Liu J, Yang X, Chen CW (2017) Blind quality assessment based on pseudo-reference image. IEEE Transactions on Multimedia 20(8):2049–2062

    Article  Google Scholar 

  27. Min X, Zhai G, Gu K, Liu Y, Yang X (2018) Blind image quality estimation via distortion aggravation. IEEE Trans Broadcast 64(2):508–517

    Article  Google Scholar 

  28. Mittal A, Moorthy AK, Bovik AC (2012) No-reference image quality assessment in the spatial domain. IEEE Trans Image Process 21(12):4695–4708

    Article  MathSciNet  MATH  Google Scholar 

  29. Mittal A, Soundararajan R, Bovik AC (2012) Making a completely blind image quality analyzer. IEEE Signal Processing Letters 20(3):209–212

    Article  Google Scholar 

  30. Moorthy AK, Bovik AC (2011) Blind image quality assessment: from natural scene statistics to perceptual quality. IEEE Trans Image Process 20 (12):3350–3364

    Article  MathSciNet  MATH  Google Scholar 

  31. Nizami IF, Majid M, Afzal H, Khurshid K (2018) Impact of feature selection algorithms on blind image quality assessment. Arab J Sci Eng 43(8):4057–4070

    Article  Google Scholar 

  32. Nizami IF, Majid M, Khurshid K (2018) New feature selection algorithms for no-reference image quality assessment. Appl Intell 48(10):3482–3501

    Article  Google Scholar 

  33. Nizami IF, Majid M, Manzoor W, Khurshid K, Jeon B (2019) Distortion-specific feature selection algorithm for universal blind image quality assessment. EURASIP Journal on Image and Video Processing 2019(1):19

    Article  Google Scholar 

  34. Nizami IF, Majid M, ur Rehman M, Anwar SM, Nasim A, Khurshid K (2020) No-reference image quality assessment using bag-of-features with feature selection. Multimedia Tools and Applications 79(11):1–26

    Google Scholar 

  35. Ponomarenko N, Jin L, Ieremeiev O, Lukin V, Egiazarian K, Astola J, Vozel B, Chehdi K, Carli M, Battisti F, et al. (2015) Image database tid2013: peculiarities, results and perspectives. Signal Processing: Image Communication 30:57–77

    Google Scholar 

  36. Saad MA, Bovik AC, Charrier C (2012) Blind image quality assessment: a natural scene statistics approach in the dct domain. IEEE Trans Image Process 21(8):3339–3352

    Article  MathSciNet  MATH  Google Scholar 

  37. Sheikh HR, Bovik AC (2006) Image information and visual quality. IEEE Trans Image Process 15(2):430–444

    Article  Google Scholar 

  38. Siedlecki W, Sklansky J (1989) A note on genetic algorithms for large-scale feature selection. Pattern Recogn Lett 10(5):335–347

    Article  MATH  Google Scholar 

  39. Sun W, Liao Q, Xue J-H, Zhou F (2018) Spsim: a superpixel-based similarity index for full-reference image quality assessment. IEEE Trans Image Process 27(9):4232–4244

    Article  MathSciNet  MATH  Google Scholar 

  40. Sun L, Wu F, Zhan T, Liu W, Wang J, Jeon B (2020) Weighted nonlocal low-rank tensor decomposition method for sparse unmixing of hyperspectral images. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 13:1174–1188

    Article  Google Scholar 

  41. Sun W, Zhou F, Liao Q (2017) Mdid: a multiply distorted image database for image quality assessment. Pattern Recogn 61:153–168

    Article  Google Scholar 

  42. Wang Z, Bovik AC, Sheikh HR, Simoncelli EP (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13(4):600–612

    Article  Google Scholar 

  43. Wang Z, Simoncelli EP, Bovik AC (2003) Multiscale structural similarity for image quality assessment. In: Conference record of the thirty-seventh asilomar conference on signals, systems and computers, 2004, vol 2. IEEE, pp 1398–1402

  44. Xue W, Mou X, Zhang L, Bovik AC, Feng X (2014) Blind image quality assessment using joint statistics of gradient magnitude and laplacian features. IEEE Trans Image Process 23(11):4850–4862

    Article  MathSciNet  MATH  Google Scholar 

  45. Xue W, Zhang L, Mou X (2013) Learning without human scores for blind image quality assessment. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 995–1002

  46. Xue W, Zhang L, Mou X, Bovik AC (2013) Gradient magnitude similarity deviation: a highly efficient perceptual image quality index. IEEE Trans Image Process 23(2):684–695

    Article  MathSciNet  MATH  Google Scholar 

  47. Yang H, Fang Y, Lin W (2015) Perceptual quality assessment of screen content images. IEEE Trans Image Process 24(11):4408–4421

    Article  MathSciNet  MATH  Google Scholar 

  48. Yin X, Zhang M, Wang L, Liu Y (2020) Interface debonding performance of precast segmental nano-materials based concrete (psnbc) beams. Materials Express 10(8):1317–1327

    Article  Google Scholar 

  49. Yu F, Liu L, He B, Huang Y, Shi C, Cai S, Song Y, Du S, Wan Q (2019) Analysis and fpga realization of a novel 5d hyperchaotic four-wing memristive system, active control synchronization, and secure communication application. Complexity

  50. Yu F, Liu L, Xiao L, Li K, Cai S (2019) A robust and fixed-time zeroing neural dynamics for computing time-variant nonlinear equation using a novel nonlinear activation function. Neurocomputing 350:108–116

    Article  Google Scholar 

  51. Yue G, Hou C, Gu K, Ling N, Li B (2018) Analysis of structural characteristics for quality assessment of multiply distorted images. IEEE Transactions on Multimedia 20(10):2722–2732

    Article  Google Scholar 

  52. Zhang Y, Chandler DM (2013) No-reference image quality assessment based on log-derivative statistics of natural scenes. Journal of Electronic Imaging 22(4):043025

    Article  Google Scholar 

  53. Zhang Y, Chandler DM (2018) Opinion-unaware blind quality assessment of multiply and singly distorted images via distortion parameter estimation. IEEE Trans Image Process 27(11):5433–5448

    Article  MathSciNet  Google Scholar 

  54. Zhang L, Zhang L, Mou X, Zhang D (2011) Fsim: a feature similarity index for image quality assessment. IEEE Trans Image Process 20(8):2378–2386

    Article  MathSciNet  MATH  Google Scholar 

  55. Zhang L, Zhang L, Bovik AC (2015) A feature-enriched completely blind image quality evaluator. IEEE Trans Image Process 24(8):2579–2591

    Article  MathSciNet  MATH  Google Scholar 

  56. Zhang Y, Mou X, Chandler DM (2019) Learning no-reference quality assessment of multiply and singly distorted images with big data. IEEE Transactions on Image Processing

  57. Zhou L, Zhang T, Tian Y, Huang H (2020) Fraction-order total variation image blind restoration based on self-similarity features. IEEE Access 8:30436–30444

    Article  Google Scholar 

  58. Zhu W, Zhai G, Min X, Hu M, Liu J, Guo G, Yang X (2019) Multi-channel decomposition in tandem with free-energy principle for reduced-reference image quality assessment. IEEE Transactions on Multimedia 21(9):2334–2346

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Electrical Engineering, Bahria University, Islamabad, Pakistan

    Imran Fareed Nizami & Asad Waqar

  2. Department of Computer Engineering, University of Engineering and Technology Taxila, Punjab, Pakistan

    Mehreen Akhtar & Muhammad Majid

  3. Department of Mathematical Sciences, Federal Urdu University of Arts, Science and Technology, Islamabad, Pakistan

    Amer Bilal Mann

Authors
  1. Imran Fareed Nizami
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mehreen Akhtar
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Asad Waqar
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Amer Bilal Mann
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Muhammad Majid
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Imran Fareed Nizami.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Nizami, I.F., Akhtar, M., Waqar, A. et al. Multiply distorted image quality assessment based on feature level fusion and optimal feature selection. Multimed Tools Appl 80, 21843–21883 (2021). https://doi.org/10.1007/s11042-021-10672-y

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-021-10672-y

Keywords

Search

Navigation