Abstract
In this paper, we propose a new approach for block-based lossless image compression by defining a new semiparametric finite mixture model-based adaptive arithmetic coding. Conventional adaptive arithmetic encoders start encoding a sequence of symbols with a uniform distribution, and they update the frequency of each symbol by incrementing its count after it has been encoded. When encoding an image row by row or block by block, conventional adaptive arithmetic encoders provide the same compression results. In addition, images are normally non-stationary signals, which means that different areas in an image have different probability distributions, so conventional adaptive arithmetic encoders which provide probabilities for the whole image are not very efficient. In the proposed compression scheme, an image is divided into non-overlapping blocks of pixels, which are separately encoded with an appropriate statistical model. Hence, instead of starting to encode each block with a uniform distribution, we propose to start with a probability distribution which is modeled by a semiparametric mixture obtained from the distributions of its neighboring blocks. The semiparametric model parameters are estimated through maximum likelihood using the expectation–maximization algorithm in order to maximize the arithmetic coding efficiency. The results of comparative experiments show that we provide significant improvements over conventional adaptive arithmetic encoders and the state-of-the-art lossless image compression standards.
Similar content being viewed by others
References
S. Alcaraz-Corona, R. Rodriguez-Dagnino, Bi-level image compression estimating the markov order of dependencies. IEEE J. Sel. Topics Signal Process 4(3), 605–611 (2010)
P.J. Ausbeck Jr, The piecewise-constant image model. Proc. IEEE 88(11), 1779–1789 (2000)
B. Carpentieri, M.J. Weinberger, G. Seroussi, Lossless compression of continuous-tone images. Proc. IEEE 88(11), 1797–1809 (2000)
A.P. Dempster, N.M. Laird, D.B. Rubin, Maximum likelihood from incomplete data via the em algorithm. J. R. Stat. Soc. Ser. B 39(1), 1–38 (1977)
P.G. Howard, J.S. Vitter, Arithmetic coding for data compression. Proc. IEEE 82(6), 857–865 (1994)
N. Kuroki, T. Manabe, M. Numa, Adaptive arithmetic coding for image prediction errors. in Proceedings of the International Symposium on Circuits and Systems, ISCAS’04, vol. 3, pp. 961–964 (2004)
D. Marpe, H. Schwarz, T. Wiegand, Context-based adaptive binary arithmetic coding in the h.264/avc video compression standard. IEEE Trans. Circuits Syst. Video Technol. 13(7), 620–636 (2003)
A. Masmoudi, A. Masmoudi, A new arithmetic coding model for a block-based lossless image compression based on exploiting inter-block correlation. Signal Image Video Process., 9(5), 1021–1027 (2015)
A. Masmoudi, W. Puech, Lossless chaos-based crypto-compression scheme for image protection. IET Image Proc. 8(15), 671–686 (2014)
A. Masmoudi, W. Puech, M.S. Bouhlel, Efficient adaptive arithmetic coding based on updated probability distribution for lossless image compression. J. Electron. Imaging 19(2), 023014-023014-6 (2010)
A. Masmoudi, W. Puech, A. Masmoudi, An improved lossless image compression based arithmetic coding using mixture of non-parametric distributions. Multimed. Tools Appl., 1–15 (2014)
I. Matsuda, Y. Umezu, N. Ozaki, J. Maeda, S. Itoh, A lossless coding scheme using adaptive predictors and arithmetic code optimized for each image. Syst. Comput. Jpn. 38(4), 1–11 (2007)
G.P. Mclachlan, D. Peel, Finite Mixture Models. Wiley Series in Probability and Statistics, 1st edn. (Wiley, Hoboken, 2000)
K. Minoo, T. Nguyen, Entropy coding via parametric source model with applications in fast and efficient compression of image and video data. in Data Compression Conference, DCC’09, pp. 461–461 (2009)
A. Moffat, R.M. Neal, I.H. Witten, Arithmetic coding revisited. ACM Trans. Inf. Syst. 16(3), 256–294 (1998)
G. Motta, J. Storer, B. Carpentieri, Lossless image coding via adaptive linear prediction and classification. Proc. IEEE 88(11), 1790–1796 (2000)
M. Roberts, Local order estimating Markovian analysis for noiseless source coding and authorship identification. Ph.D. thesis, Stanford University, Stanford, California (1982)
F. Rubin, Arithmetic stream coding using fixed precision registers. in Data Compression Conference. IEEE Trans. Inf. Theory, pp. 672–675 (1979)
D. Salomon, Data Compression: the Complete Reference, 4th edn. (Springer, Berlin, 2007)
D.S. Taubman, M.W. Marcellin, JPEG2000: Image Compression Fundamentals; Standards and Practice (Springer, Berlin, 2002)
M.J. Weinberger, G. Seroussi, G. Sapiro, The LOCO-I lossless image compression algorithm: principles and standardization into JPEG-LS. IEEE Trans. Image Process. 9(8), 1309–1324 (2000)
I.H. Witten, R.M. Neal, J.G. Cleary, Arithmetic coding for data compression. Commun. ACM 30(6), 520–540 (1987)
H. Ye, G. Deng, J.C. Devlin, Parametric probability models for lossless coding of natural images. in EUSIPCO, pp. 514–517 (2002)
L. Zhang, D. Wang, D. Zheng, Segmentation of source symbols for adaptive arithmetic coding. IEEE Trans. Broadcast. 58(2), 228–235 (2012)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Masmoudi, A., Masmoudi, A. & Puech, W. A New Semiparametric Finite Mixture Model-Based Adaptive Arithmetic Coding for Lossless Image Compression. Circuits Syst Signal Process 35, 1163–1186 (2016). https://doi.org/10.1007/s00034-015-0103-8
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00034-015-0103-8