Dynamic Weight of Adaptive Information Density Network for Image Super-Resolution
Pages 123 - 129
Abstract
A model algorithm based on image information density characteristics is proposed to achieve network structure adjustment. The image dense region classification is fed back to the subsequent network. According to the classification information, the image sampling window is sent to different network to realize pixel-level channel switching, thereby reducing the network deployment process's computational pressure. The dynamic weighting network adjusts the weight coefficients of pixels in the sampling window to approximate the image's shape and generate better texture effects than FSRCNN. When using the public test sets to evaluate the adaptive information density network structure, the computation complexity of SRCNN and FSRCNN was reduced by about 28%, and the PSNR only reduced by about 0.1dB.
References
[1]
Dong, C., Loy, C. C., He, K., & Tang, X. (2015). Image super-resolution using deep convolutional networks. IEEE transactions on pattern analysis and machine intelligence, 38(2), 295-307.
[2]
Dong, C., Loy, C. C., & Tang, X. (2016). Accelerating the Super-Resolution Convolutional Neural Network: Supplementary File. Computer Vision-ECCV 2016.
[3]
Dai, J., Qi, H., Xiong, Y., Li, Y., Zhang, G., Hu, H., & Wei, Y. (2017). Deformable convolutional networks. In Proceedings of the IEEE international conference on computer vision (pp. 764-773).
[4]
Zhu, X., Hu, H., Lin, S., & Dai, J. (2019). Deformable convnets v2: More deformable, better results. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 9308-9316).
[5]
Ma, J., Wang, W., & Wang, L. (2017, November). Irregular convolutional neural networks. In 2017 4th IAPR Asian Conference on Pattern Recognition (ACPR) (pp. 268-273). IEEE.
[6]
Gao, H., Zhu, X., Lin, S., & Dai, J. (2019). Deformable kernels: Adapting effective receptive fields for object deformation. arXiv preprint arXiv:1910.02940.
[7]
Pertuz, S., Puig, D., & Garcia, M. A. (2013). Analysis of focus measure operators for shape-from-focus. Pattern Recognition, 46(5), 1415-1432.
[8]
Li Qi, Feng Huajun, Xu Zhihai, Bian Meijuan, Shen Su, & Dai Ruichun. (2002). Research on the evaluation function of digital image sharpness. Acta Photonica Sinica, 31(6), 736.
[9]
Yao, Y., Abidi, B., Doggaz, N., & Abidi, M. (2006, May). Evaluation of sharpness measures and search algorithms for the auto-focusing of high-magnification images. In Visual Information Processing XV (Vol. 6246, p. 62460G). International Society for Optics and Photonics.
[10]
Zhang, X., Jia, C., & Xie, K. (2016). Evaluation of autofocus algorithm for automatic dectection of caenorhabditis elegans lipid droplets. Progress in Biochemistry and Biophysics (PBB), 43, 167-175.
[11]
Shi, W., Caballero, J., Huszár, F., Totz, J., Aitken, A. P., Bishop, R., ... & Wang, Z. (2016). Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 1874-1883).
[12]
Kim, Y., Choi, J. S., & Kim, M. (2018). A real-time convolutional neural network for super-resolution on fpga with applications to 4k uhd 60 fps video services. IEEE Transactions on Circuits and Systems for Video Technology, 29(8), 2521-2534.
[13]
He, Z., Huang, H., Jiang, M., Bai, Y., & Luo, G. (2018, April). FPGA-based real-time super-resolution system for ultra high definition videos. In 2018 IEEE 26th Annual International Symposium on Field-Programmable Custom Computing Machines (FCCM) (pp. 181-188). IEEE.
[14]
Otsu, N. (1979). A threshold selection method from gray-level histograms. IEEE transactions on systems, man, and cybernetics, 9(1), 62-66.
[15]
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016). Rethinking the inception architecture for computer vision. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 2818-2826).
[16]
Yu, F., & Koltun, V. (2015). Multi-scale context aggregation by dilated convolutions. arXiv preprint arXiv:1511.07122.
[17]
He, K., Zhang, X., Ren, S., & Sun, J. (2016). Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 770-778).
[18]
Chollet, F. (2017). Xception: Deep learning with depthwise separable convolutions. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 1251-1258).
[19]
Howard, A. G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., ... & Adam, H. (2017). Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:1704.04861.
Recommendations
Adaptive shock filter for image super-resolution and enhancement
Adaptive shock filter is used to reduce distortion artifacts of upsampled images.Both edge-stopping function term and forward diffusion process term are proposed.The weight of shock filter relies on the gradients of the interpolated image. In view of ...
Curvature preserving image super-resolution with gradient-consistency-anisotropic-regularization prior
Single image super-resolution (SR) often suffers from annoying interpolation artifacts such as blur, jagged edges, and ringing. In this paper, we aim to achieve artifact-free SR reconstruction from an input low resolution (LR) image using adaptive de-...
Efficient Blind Image Super-Resolution
Advances in Computational IntelligenceAbstractA hybrid method to Single Image Super-resolution is proposed. We used zero-shot super-resolution method to reconstruct high-resolution image from low-resolution one based on the degradation trained on unpaired high-resolution and low-resolution ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
February 2021
143 pages
ISBN:9781450389082
DOI:10.1145/3456126
Copyright © 2021 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 29 June 2021
Check for updates
Author Tags
Qualifiers
- Article
- Research
- Refereed limited
Conference
ASSE '21
ASSE '21: 2021 2nd Asia Service Sciences and Software Engineering Conference
February 24 - 26, 2021
Macau, Macao
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 65Total Downloads
- Downloads (Last 12 months)9
- Downloads (Last 6 weeks)0
Reflects downloads up to 23 Nov 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format