Structural similarity-based rate control algorithm for 3D video
Pages 25897 - 25908
Abstract
Human vision easily identifies the structural degradation in a video and thus perceptual quality improvement is necessary. To adjust the video quality to match with the human vision we proposed a structural similarity (SSIM) based rate control algorithm for the 3D video. We incorporated a structural similarity index (SSIM) as the quality metric in rate control algorithm. The rate-distortion model and Lagrange multiplier are derived considering the structural dissimilarity (dSSIM) as the distortion metric to achieve the rate control with perceptual quality improvement. Furthermore, the optimal joint bit allocation scheme at texture video/depth map level, frame level, and basic unit (BU) level is modified to incorporate dSSIM for measuring distortion. The proposed algorithm is implemented in HEVC compression standard HTM-16.2. The performance of the proposed algorithm is compared using RD curves, BD-Rate comparison, and subjective evaluation. Besides, rate accuracy is also computed to measure the bit rate mismatch. Compared to the original λ-domain rate control algorithm, the proposed algorithm achieves a better SSIM along with a reduction in bit rate.
References
[1]
Bai Y, Zhang Y, Li Z (2015) 3D Video Coding using Just Noticeable Depth Difference based on H. 265/HEVC. In: 11Th international conference on computational intelligence and security (CIS). IEEE, pp 142–145
[2]
Chen X, Gu D (2014) Macroblock Layer Rate Control based on Structural Similarity and Mean Absolute Difference for H. 264. Adv Multimed:5
[3]
Cordina M, Debono CJ (2016) A Depth Map Rate Control Algorithm for HEVC Multi-View Video plus Depth. In: IEEE International conference on multimedia & expo workshops (ICMEW), pp 1–6
[4]
Cui Z, Gan Z, Zhu X (2011) Structural Similarity Optimal MB Layer Rate Control for H. 264. In: Proceedings of IEEE International Conference on Wireless Communications and Signal Processing (WCSP), pp 1–5
[5]
Fehn C (2004) Depth-Image-Based Rendering (DIBR), Compression, and Transmission for a New Approach on 3D-TV. In: Electronic imaging 2004. International society for optics and photonics, pp 93–104
[6]
Fujii Laboratory, Nagoya University. Available at: http://www.fujii.nuee.nagoya-u.ac.jp/multiview-data/, [Online; accessed on 29-July-2018]
[7]
HM Reference Software HTM-16.2. Available at: https://hevc.hhi.fraunhofer.de/trac/3d-hevc/browser/3DVCSoftware/tags/HTM-16.2, [Online; accessed on 21-September-2018]
[8]
Li B, Li H, Li L, and Zhang J Lambda Domain Rate Control Algorithm for High Efficiency Video Coding IEEE Trans Image Process 2014 23 3841-3854
[9]
Morvan Y, Farin D (2007) Joint Depth/Texture Bit-Allocation for Multi-View Video Compression. In: Picture coding symposium (PCS)
[10]
Ou TS, Huang YH, Chen HH (2010) A Perceptual-based Approach to Bit Allocation for H. 264 Encoder. In: Visual communications and image processing 2010. International society for optics and photonics, vol 7744, pp 77441b
[11]
Shao F, Jiang G, Lin W, Yu M, and Dai Q Joint Bit Allocation and Rate Control for Coding Multi-View Video plus Depth Based 3D Video IEEE Trans Multimed 2013 15 8 1843-1854
[12]
De Silva DVS, Fernando WAC, Nur G, Ekmekcioglu E, Worrall ST (2010) 3D Video Assessment with Just Noticeable Difference in Depth Evaluation. In: IEEE International conference on image processing. IEEE, pp 4013–4016
[13]
Tan S, Ma S, Wang S, Wang S, and Gao WInter-View Dependency-Based Rate Control for 3D-HEVCIEEE Trans Circ Syst Video Technol2017272337-35110.1109/TCSVT.2015.2511878
[14]
Tan S, Si J, Ma S, Wang S, Gao W (2014) Adaptive Frame Level Rate Control in 3D-HEVC. In: Proceedings of IEEE visual communications and image processing conf, pp 382–385.
[15]
Harshalatha Y, Biswas PK (2018) SSIM-based Joint-Bit Allocation for 3D Video Coding. Multimed Tools Appl 77(15):19,051.
[16]
Yang C, An P, Shen L (2016) Adaptive Bit Allocation for 3D Video Coding. Circ Syst Signal Process:1–23
[17]
Yeo C, Tan HL, and Tan YH On Rate Distortion Optimization using SSIM IEEE Trans Circ Syst Video Technol 2013 23 7 1170-1181
[18]
Yuan H, Chang Y, Li M, Yang F (2010) Model Based Bit Allocation Between Texture Images and Depth maps. In: International conference on computer and communication technologies in agriculture engineering (CCTAE). IEEE, vol 3, pp 380–383
[19]
Zhao H, Xie W, Zhang Y, Yu L, Men A (2013) An SSIM-Motivated LCU-Level Rate Control Algorithm for HEVC. In: Proceedings of Picture coding symp. (PCS), pp 85–88.
[20]
Zitnick CL, Kang SB, Uyttendaele M, Winder S, Szeliski R (2004) High-quality video view interpolation using a layered representation. In: ACM Transactions on graphics (TOG). ACM, vol 23, pp 600–608
Index Terms
- Structural similarity-based rate control algorithm for 3D video
Index terms have been assigned to the content through auto-classification.
Recommendations
SSIM-based joint-bit allocation for 3D video coding
The quality of a 3D video display depends on virtual view synthesis process which is affected by the bit allocation criterion. The performance of a bit allocation algorithm is dependent on various encoding parameters like quantization parameter, motion ...
On Lagrange multiplier and quantizer adjustment for H.264 frame-layer video rate control
H.264/AVC encoder employs a complex mode-decision technique based on rate-distortion optimization. It calculates rate-distortion cost (RDcost) for all possible modes to choose the best one having the minimum RDcost. This paper presents a frame-layer ...
SSIM-based error-resilient rate-distortion optimization of H.264/AVC video coding for wireless streaming
The SSIM-based rate-distortion optimization (RDO) has been verified to be an effective tool for H.264/AVC to promote the perceptual video coding performance. However, the current SSIM-based RDO is not efficient for improving the perceptual quality of ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
© The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature 2021.
Publisher
Kluwer Academic Publishers
United States
Publication History
Published: 01 July 2021
Accepted: 05 April 2021
Revision received: 21 February 2021
Received: 05 February 2020
Author Tags
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 07 Mar 2025