research-article

Perceptual evaluation of single-image super-resolution reconstruction

Authors:

Guangcheng Wang,

Jiansheng QianAuthors Info & Claims

2017 IEEE International Conference on Image Processing (ICIP)

Pages 3145 - 3149

https://doi.org/10.1109/ICIP.2017.8296862

Published: 17 September 2017 Publication History

Abstract

In recent years, single-image super-resolution (SR) reconstruction has aroused wide attention. Massive SR enhancement algorithms have been proposed. However, much less work has been down on the perceptual evaluation of SR enhanced images and the corresponding enhancement algorithms. In this work, we create a Super-resolution Reconstructed Image Database (SRID), which consists of images produced by two interpolation methods and six popular SR image enhancement algorithms at different amplification factors. Then, subjective experiment is conducted to collect the subjective scores by using the single-stimulus method. The performances of the SR image enhancement algorithms are then evaluated by the obtained subjective scores. Finally, the performances of the general-purpose no-reference (NR) image quality metrics are investigated on the SRID database. This study shows that it is difficult for the state-of-the-art NR image quality metrics to predict the quality of SR enhanced images.

6. References

[1]

T. S. Huang and P. Y. Tsai, “Multi-frame image restoration and registration,” Adv. Comput. Vis. Image Process., vol. 1, no. 2, pp. 317–339, 1984.

[2]

Z. Wang, A. C. Bovik, H. R. Sheikh and E. P. Simoncelli, “Image quality assessment: From error visibility to structural similarity,” IEEE Trans. Image Process., vol. 13, no. 4, pp. 35–44, 2004.

[3]

L. Zhang, L. Zhang, X. Q. Mou and D. Zhang, “FSIM: a feature similarity index for image quality assessment,” IEEE Trans. Image Process., vol. 20, no. 8, pp. 2378–2386, 2011.

Digital Library

[4]

L. Li, H. Cai, Y. Zhang, W. Lin, A. C. Kot and X. Sun, “Sparse Representation-Based Image Quality Index With Adaptive Sub-Dictionaries,” IEEE Trans. Image Process., vol. 25, no. 8, pp. 3775–3786, 2016.

[5]

K. Gu, L. Li, H. Lu, X. Min and W. Lin, “A Fast Reliable Image Quality Predictor by Fusing Micro- and Macro-Structures,” IEEE Trans. Industrial Electronics, vol. 64, no. 5, pp. 3903–3912, 2017.

[6]

H. S. Hou and H. C. Andrews, “Cubic splines for image interpolation and digital filtering,” IEEE Trans. Signal Process., vol. 26, no. 6, pp. 508–517, 1978.

[7]

A. Giachetti and N. Asuni, “Real-time artifact-free image upscaling,” IEEE Trans. Image Process., vol. 20, no. 10, pp. 2760–2768, 2011.

Digital Library

[8]

J. Yang, Z. Wang, Z. Lin, S. T. Cohen and T. S. Huang, “Coupled dictionary training for image super-resolution,” IEEE Trans. Image Process., vol. 21, no. 8, pp. 3467–3478, 2012.

Digital Library

[9]

H. H and W. C. Siu, “Single image super-resolution using Gaussian process regression,” in Proc. Int. Conf. Comput. Vis. Pattern Recognit. (CVPR), pp. 449–456, 2011.

[10]

L. Wang, S. Xiang, G. Meng, H. Wu and C. H. Pan, “single-image super-resolution via adaptive gradient magnitude self-interpolation,” IEEE Trans. Circuits Syst. Video Technol., vol. 23, no. 8, pp. 1289–1299, 2013.

Digital Library

[11]

H. Xu, G. Zhai and X. K. Yang, “Single image super-resolution with detail enhancement based on local fractal analysis of gradient,” IEEE Trans. Circuits Syst. Video Technol., vol. 23, no. 10, pp. 1740–1299, 2013.

Digital Library

[12]

P. Purkait, N. R. Pal and B. Chanda, “A fuzzy-rule-based approach for single frame super resolution,” IEEE Trans. Image Process., vol. 23, no. 5, pp. 2277–2290, 2014.

[13]

L. Li, W. Lin, X. Wang, G. Yang, K. Bahrami and A. C. Kot, “No-reference image blur assessment based on discrete orthogonal moments,” IEEE Trans. Cybernetics, vol. 46, no. 1, pp. 39–50, 2016.

[14]

L. Li, H. Zhu, G. Yang and J. Qian, “Referenceless Measure of Blocking Artifacts by Tchebichef Kernel Analysis,” IEEE Signal Process. Lett., vol. 21, no. 1, pp. 122–125, 2014.

[15]

ITU, “Methodology for the subjective assessment of the quality of television pictures,” Recommendation, International Telecommunication Union/ITU Radio communication Sector, 2009.

[16]

L. Li, Y. Zhou, W. Lin, J. Wu, X. Zhang and B. Chen, “No-reference quality assessment of deblocked images,” Neurocomputing, vol. 177, pp. 572–584, 2016.

Digital Library

[17]

(Aug. 2003). Final Report from the Video Quality Experts Group on the Validation of Objective Models of Video Quality Assessment, phase II. [Online]. Available: http://www.vqeg.org.

[18]

A. Mittal, A. K. Moorthy and A. C. Bovik, “No-reference image quality assessment in the spatial domain,” IEEE Trans. Image Process., vol. 21, no. 12, pp. 4695–4708, 2012.

Digital Library

[19]

A. Mittal, R. Soundararajan and A. C. Bovik, “Making a completely blind image quality analyzer,” IEEE Signal Process. Lett., vol. 20, no. 3, pp. 209–212, 2013.

[20]

K. Gu, G. Zhai, X. K. Yang and W. J. Zhang, “Using free energy principle for blind image quality assessment,” IEEE Trans. Mulultimedia, vol. 17, no. 1, pp. 50–63, 2015.

[21]

A. K. Moorthy and A. C. Bovik, “A two-step framework for constructing blind image quality indices,” IEEE Signal Process. Lett., vol. 17, no. 5, pp. 513–516, 2010.

[22]

M. A. Saad and A. C. Bovik, “Blind image quality assessment: A natural scene statistics approach in the DC-T domain,” IEEE Trans. Image Process., vol. 21, no. 8, pp. 3339–3352, 2012.

Digital Library

[23]

P. Ye, J. Kumar, L. Kang and D. Doermann, “Unsuper-vised feature learning framework for no-reference image quality assessment,” in Proc. Int. Conf. Comput. Vis. Pattern Recognit. (CVPR), pp. 1098–1105, 2012.

[24]

Y. Zhang and D. M. Chandler, “No-reference image quality assessment based on log derivative statistics of natural scenes,” Journal of Electronic Imaging, vol. 22, no. 4, pp. 451–459, 2013.

[25]

A. K. Moorthy and A. C. Bovik, “Blind image quality assessment: From natural scene statistics to perceptual quality,” IEEE Trans. Image Process., vol. 20, no. 12, pp. 3350–3364, 2011.

Digital Library

[26]

L. Zhang, L. Zhang and A. C. Bovik, “A feature-enriched completely blind image quality evaluator,” IEEE Trans. Image Process., vol. 24, no. 8, pp. 2579–2591, 2015.

Digital Library

[27]

K. Gu, G. Zhai, X. Yang and W. Zhang, “Hybrid No-Reference Quality Metric for Singly and Multiply Distorted Images,” IEEE Trans. Broadcasting, vol. 60, no. 3, pp. 555–567, 2014.

Cited By

Rasheed AJabberi MHamdani TAlimi A(2023)Exploring the Potential of High-Resolution Drone Imagery for Improved 3D Human Avatar Reconstruction: A Comparative Study with Mobile ImagesImage and Video Technology10.1007/978-981-97-0376-0_13(167-181)Online publication date: 22-Nov-2023
https://dl.acm.org/doi/10.1007/978-981-97-0376-0_13
Zhou WWang ZMagalhães Jdel Bimbo ASatoh SSebe NAlameda-Pineda XJin QOria VToni L(2022)Quality Assessment of Image Super-Resolution: Balancing Deterministic and Statistical FidelityProceedings of the 30th ACM International Conference on Multimedia10.1145/3503161.3547899(934-942)Online publication date: 10-Oct-2022
https://dl.acm.org/doi/10.1145/3503161.3547899

Index Terms

Perceptual evaluation of single-image super-resolution reconstruction
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
  2. Computer graphics
    1. Image manipulation

Index terms have been assigned to the content through auto-classification.

Recommendations

Single Image Super-Resolution Reconstruction Technique based on A Single Hybrid Dictionary

A new sparse domain approach is proposed in this paper to realize the single image super-resolution (SR) reconstruction based upon one single hybrid dictionary, which is deduced from the mixture of both the high resolution (HR) image patch samples and ...
Fast Learning-Based Single Image Super-Resolution

We present a learning-based single image super-resolution (SISR) method to obtain a high resolution (HR) image from a single given low resolution (LR) image. Our method gives more accurate results while also testing (runs) and training faster with a ...
Image super-resolution: use of self-learning and gabor prior
ACCV'12: Proceedings of the 11th Asian conference on Computer Vision - Volume Part III

Recent approaches on single image super-resolution (SR) have attempted to exploit self-similarity to avoid the use of multiple images. In this paper, we propose an SR method based on self-learning and Gabor prior. Given a low resolution (LR) test image ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Guide Proceedings

2017 IEEE International Conference on Image Processing (ICIP)

Sep 2017

4869 pages

Copyright © 2017.

Publisher

IEEE Press

Publication History

Published: 17 September 2017

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 02 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Rasheed AJabberi MHamdani TAlimi A(2023)Exploring the Potential of High-Resolution Drone Imagery for Improved 3D Human Avatar Reconstruction: A Comparative Study with Mobile ImagesImage and Video Technology10.1007/978-981-97-0376-0_13(167-181)Online publication date: 22-Nov-2023
https://dl.acm.org/doi/10.1007/978-981-97-0376-0_13
Zhou WWang ZMagalhães Jdel Bimbo ASatoh SSebe NAlameda-Pineda XJin QOria VToni L(2022)Quality Assessment of Image Super-Resolution: Balancing Deterministic and Statistical FidelityProceedings of the 30th ACM International Conference on Multimedia10.1145/3503161.3547899(934-942)Online publication date: 10-Oct-2022
https://dl.acm.org/doi/10.1145/3503161.3547899

View Options

View options

Figures

Tables

Media

View Table of Conten