Abstract
Mixture models may be a useful and flexible tool to describe data with a complicated structure, for instance characterized by multimodality or asymmetry. The literature about Bayesian analysis of mixture models is huge, nevertheless an “objective” Bayesian approach for these models is not widespread, because it is a well-established fact that one needs to be careful in using improper prior distributions, since the posterior distribution may not be proper, yet noninformative priors are often improper. In this work, a preliminary analysis based on the use of a dependent Jeffreys’ prior in the setting of mixture models will be presented. The Jeffreys’ prior which assumes the parameters of a Gaussian mixture model is shown to be improper and the conditional Jeffreys’ prior for each group of parameters is studied. The Jeffreys’ prior for the complete set of parameters is then used to approximate the derived posterior distribution via a Metropolis–Hastings algorithm and the behavior of the simulated chains is investigated to reach evidence in favor of the properness of the posterior distribution.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Banterle, M., Grazian, C., Robert, C.P.: Accelerating Metropolis-Hastings algorithms: delayed acceptance with prefetching. arXiv:1406.2660 (2014)
Basford, K.E., McLachlan, G.J.: Likelihood estimation with normal mixture models. Appl. Stat. 34(3), 282–289 (1985)
Diebolt, J. and Robert, C.P.: Estimation of finite mixture distributions through Bayesian sampling. J. R. Stat. Soc. Ser. B Stat Methodol. 56(2), 363–375 (1994)
Frühwirth-Schnatter, S.: Finite Mixture and Markov Switching Models: Modeling and Applications to Random Processes, 1st edn. Springer, New York (2006)
Jeffreys’, H.: Theory of Probability, 1st edn. The Clarendon Press, Oxford (1939)
McLachlan, G.J., Peel, D.: Finite Mixture Models, 1st edn. Wiley, Newark (2000)
Mengersen, K., Robert, C.: Testing for mixtures: a Bayesian entropic approach (with discussion). In: Berger, J., Bernardo, J., Dawid, A., Lindley, D., Smith, A. (eds.) Bayesian Statistics, vol. 5, pp. 255–276. Oxford University Press, Oxford (1996)
Richardson, S., Green, P.J.: On Bayesian analysis of mixtures with an unknown number of components. J. R. Stat. Soc. Ser. B Stat Methodol. 59(4), 731–792 (1997)
Robert, C.: The Bayesian Choice, 2nd ed. Springer, New York (2001)
Roeder, K., Wasserman, L.: Practical Bayesian density estimation using mixtures of normals. J. Am. Stat. Assoc. 92(439), 894–902 (1997)
Titterington, D.M., Smith, A.F.M., Makov, U.E.: Statistical Analysis of Finite Mixture Distributions, vol. 7. Wiley, Newark (1985)
Wasserman, L.: Asymptotic inference for mixture models using data-dependent priors. J. R. Stat. Soc. Ser. B Stat Methodol. 62(1), 159–180 (2000)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Grazian, C., Robert, C.P. (2015). Jeffreys’ Priors for Mixture Estimation. In: Frühwirth-Schnatter, S., Bitto, A., Kastner, G., Posekany, A. (eds) Bayesian Statistics from Methods to Models and Applications. Springer Proceedings in Mathematics & Statistics, vol 126. Springer, Cham. https://doi.org/10.1007/978-3-319-16238-6_4
Download citation
DOI: https://doi.org/10.1007/978-3-319-16238-6_4
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-16237-9
Online ISBN: 978-3-319-16238-6
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)