Compară metode
Examinează metodele selectate una lângă alta; rândurile care diferă sunt evidențiate.
| Propagarea prin Așteptare (EP)× | Aproximarea Laplace× | Metoda Monte Carlo cu Lanțuri Markov (MCMC)× | Inferența variațională× | |
|---|---|---|---|---|
| Domeniu | Bayesian | Bayesian | Bayesian | Bayesian |
| Familie | Bayesian methods | Bayesian methods | Bayesian methods | Bayesian methods |
| Anul apariției≠ | 2001 | 1986 | — | 1999 |
| Autorul original≠ | Thomas P. Minka | Pierre-Simon Laplace (1774); Bayesian formalisation: Tierney & Kadane (1986) | — | Jordan, Ghahramani, Jaakkola & Saul |
| Tip≠ | Approximate inference algorithm | Analytical posterior approximation | Posterior sampling algorithm | Approximate Bayesian inference |
| Sursa seminală≠ | Minka, T. P. (2001). Expectation propagation for approximate Bayesian inference. In Proceedings of the Seventeenth Conference on Uncertainty in Artificial Intelligence (UAI-01), pp. 362–369. Morgan Kaufmann. link ↗ | Tierney, L. & Kadane, J. B. (1986). Accurate approximations for posterior moments and marginal densities. Journal of the American Statistical Association, 81(393), 82–86. DOI ↗ | Gelman, A., Carlin, J. B., Stern, H. S., Dunson, D. B., Vehtari, A. & Rubin, D. B. (2013). Bayesian Data Analysis (3rd ed.). CRC Press. ISBN: 978-1439840955 | Jordan, M. I., Ghahramani, Z., Jaakkola, T. S., & Saul, L. K. (1999). An introduction to variational methods for graphical models. Machine Learning, 37(2), 183–233. DOI ↗ |
| Denumiri alternative≠ | EP, expectation propagation, EP algorithm, assumed-density filtering generalisation | Laplace's method, saddle-point approximation (Bayesian), second-order Gaussian approximation, LA | markov chain monte carlo, MCMC sampling, MCMC (Markov Zinciri Monte Carlo) | VI, variational Bayes, VB, mean-field variational inference |
| Înrudite≠ | 3 | 3 | 3 | 4 |
| Rezumat≠ | Expectation Propagation (EP) is a deterministic message-passing algorithm for approximate posterior inference in Bayesian models, introduced by Thomas P. Minka at UAI 2001. It iteratively refines a set of local approximate factors — each drawn from the exponential family — so that their product closely matches the true intractable posterior, achieving higher accuracy than mean-field variational inference on many probabilistic machine learning tasks. | The Laplace approximation is a classical analytic technique that replaces an intractable posterior distribution with a multivariate Gaussian centred at the posterior mode, using the curvature of the log-posterior at that mode to set the covariance. Formalised for Bayesian statistics by Tierney and Kadane (1986) in their landmark Journal of the American Statistical Association paper, it provides a fast, deterministic alternative to Markov chain Monte Carlo and forms the mathematical core of Integrated Nested Laplace Approximations (INLA). | Markov Chain Monte Carlo (MCMC) is a family of computational algorithms for sampling from complex probability distributions, most commonly the posterior distributions that arise in Bayesian inference. Rather than computing posteriors analytically — which is rarely possible for realistic models — MCMC constructs a Markov chain whose stationary distribution is the target posterior and draws dependent samples from it, enabling full probabilistic inference for virtually any model. | Variational inference (VI) is a family of techniques that turn Bayesian posterior computation into an optimisation problem. Instead of drawing samples from the exact posterior — as Markov chain Monte Carlo does — VI posits a simpler, tractable family of distributions and finds the member of that family closest to the true posterior by maximising the evidence lower bound (ELBO). Introduced in its modern graphical-model form by Jordan, Ghahramani, Jaakkola and Saul (1999) and given a comprehensive statistical treatment by Blei, Kucukelbir and McAuliffe (2017), VI is now the standard scalable inference engine in probabilistic machine learning. |
| ScholarGateSet de date ↗ |
|
|
|
|