Abstract
Light field (LF) attracts tremendous attention due to its capability of recording the intensity of scene objects as well as the direction of the light ray, which also dramatically increases the amount of redundant data. In this paper, we explore the structure of the light field images, and propose a pseudo-sequence based light field image compression with sub-aperture reordering and adaptive reconstruction to efficiently improve the coding performances. In the proposed method, we firstly decompose the lenslet image into sub-aperture images, and then design an optimized sub-aperture scan order to rearrange them sequentially as a pseudo-sequence. Third, we take advantage of the state-of-the-art video codec to compress the pseudo-sequence by leveraging both intra- and inter-view correlations. Considering the interpolation and transform induced by the reconstruction procedure from sub-aperture images to lenslet image, we propose an enhanced reconstruction method by applying region-based non-local adaptive filters which extracts the non-local similarities for collaborative filtering to promote the quality of reconstructed lenslet images. Extensive experimental results show that the proposed method achieves up to 15.7% coding gain in terms of BD-rate.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
JPEG Pleno Final Call for Proposals on Light Field Coding. https://jpeg.org/items/20170208_cfp_pleno.html
Li, Y., Sjostrom, M., Olsson, R., Jennehag, U.: Efficient intra prediction scheme for light field image compression. In: 2014 IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 539–543 (2014)
Zhong, R., Wang, S., Cornelis, B., Zheng, Y., Yuan, J., Munteanu, A.: L1-optimized linear prediction for light field image compression. In: 2016 IEEE Picture Coding Symposium, pp. 1–5 (2016)
Conti, C., Nunes, P., Soares, L.D.: HEVC-based light field image coding with bi-predicted self-similarity compensation. In: 2016 IEEE International Conference on Multimedia and Expo Workshops, pp. 1–4 (2016)
Zhang, X., Xiong, R., Ma, S., Gao, W.: Adaptive loop filter with temporal prediction. In: 2012 IEEE Picture Coding Symposium (PCS), pp. 437–440 (2012)
Zhang, X., Xiong, R., Lin, W., Zhang, J., Wang, S., Ma, S., Gao, W.: Low-rank based nonlocal adaptive loop filter for high efficiency video compression. IEEE Trans. Circ. Syst. Video Technol. (2016)
Ma, S., Zhang, X., Zhang, J., Jia, C., Wang, S., Gao, W.: Nonlocal in-loop filter: the way toward next-generation video coding? IEEE Multimed. 23(2), 16–26 (2016)
Zhang, J., Jia, C., Ma, S., Gao, W.: Non-local structure-based filter for video coding. In: 2015 IEEE International Symposium on Multimedia, pp. 301–306 (2015)
Li, L., Li, Z., Li, B., Liu, D., Li, H.: Pseudo sequence based 2-D hierarchical reference structure for light-field image compression. arXiv preprint arXiv:1612.07309
Dansereau, D.G.: Light Field Toolbox for Matlab. Software Manual (2015)
Liu, D., Wang, L., Li, L., Xiong, Z., Wu, F., Zeng, W.: Pseudo-sequence-based light field image compression. In: 2016 IEEE International Conference on Multimedia and Expo Workshops, pp. 1–4 (2016)
Chen, J., Hou, J., Chau, L.P.: Light field compression with disparity guided sparse coding based on structural key views. arXiv preprint arXiv:1610.03684
Zhao, S., Chen, Z., Yang, K., Huang, H.: Light field image coding with hybrid scan order. In: 2016 IEEE Visual Communications and Image Processing, pp. 1–4 (2016)
Rerabek, M., Yuan, L., Authier, L.A., Ebrahimi, T.: EPFL light-field image dataset. ISO/IEC JTC 1/SC 29/WG1 (2015)
Tsai, C.-Y., et al.: Adaptive loop filtering for video coding. IEEE J. Selected Top. Sig. Process. 7(6), 934–945 (2013)
Bossen, F., Flynn, D., Shring, K.: HEVC reference software manual. JCTVC-D404, Daegu, Korea (2011)
Bjontegaard, G.: Calculation of average PSNR differences between RD-curves. ITU SG16 Document VCEG-M33, April 2001
Girod, B.: The efficiency of motion-compensating prediction for hybrid coding of video sequences. IEEE J. Sel. Areas Commun. 5(7), 1140–1154 (1987)
Acknowledgement
This work was supported in part by the National High-tech R&D Program of China (863 Program, 2015AA015903) National Natural Science Foundation of China (61632001, 61571017, 61421062), and the Top-Notch Young Talents Program of China, which are gratefully acknowledged.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG, part of Springer Nature
About this paper
Cite this paper
Jia, C., Yang, Y., Zhang, X., Wang, S., Wang, S., Ma, S. (2018). Light Field Image Compression with Sub-apertures Reordering and Adaptive Reconstruction. In: Zeng, B., Huang, Q., El Saddik, A., Li, H., Jiang, S., Fan, X. (eds) Advances in Multimedia Information Processing – PCM 2017. PCM 2017. Lecture Notes in Computer Science(), vol 10735. Springer, Cham. https://doi.org/10.1007/978-3-319-77380-3_5
Download citation
DOI: https://doi.org/10.1007/978-3-319-77380-3_5
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-77379-7
Online ISBN: 978-3-319-77380-3
eBook Packages: Computer ScienceComputer Science (R0)