เปรียบเทียบวิธี
ดูวิธีที่เลือกเทียบกันแบบเคียงข้าง แถวที่ต่างกันจะถูกเน้นไว้
| Automatic Differentiation Variational Inference (ADVI)× | การแพร่กระจายความคาดหวัง (EP)× | |
|---|---|---|
| สาขาวิชา | เบย์ | เบย์ |
| ตระกูล | Bayesian methods | Bayesian methods |
| ปีกำเนิด≠ | 2017 | 2001 |
| ผู้ริเริ่ม≠ | Kucukelbir, Tran, Ranganath, Gelman, Blei | Thomas P. Minka |
| ประเภท≠ | Variational inference algorithm | Approximate inference algorithm |
| แหล่งต้นตำรับ≠ | Kucukelbir, A., Tran, D., Ranganath, R., Gelman, A. & Blei, D. M. (2017). Automatic differentiation variational inference. Journal of Machine Learning Research, 18(14), 1–45. link ↗ | Minka, T. P. (2001). Expectation propagation for approximate Bayesian inference. In Proceedings of the Seventeenth Conference on Uncertainty in Artificial Intelligence (UAI-01), pp. 362–369. Morgan Kaufmann. link ↗ |
| ชื่อเรียกอื่น | ADVI, black-box variational inference, automatic variational inference, gradient-based variational inference | EP, expectation propagation, EP algorithm, assumed-density filtering generalisation |
| ที่เกี่ยวข้อง | 3 | 3 |
| สรุป≠ | Automatic Differentiation Variational Inference (ADVI) is a black-box algorithm for approximate Bayesian posterior inference, introduced by Kucukelbir, Tran, Ranganath, Gelman, and Blei (2017, JMLR). Given any probabilistic model whose log-joint density is differentiable, ADVI automatically transforms constrained latent variables to unconstrained real space, fits a Gaussian variational family by maximising the evidence lower bound (ELBO) with stochastic gradient ascent, and returns an approximate posterior without model-specific derivations. It is the default variational inference engine in Stan and is available in PyMC and NumPyro. | Expectation Propagation (EP) is a deterministic message-passing algorithm for approximate posterior inference in Bayesian models, introduced by Thomas P. Minka at UAI 2001. It iteratively refines a set of local approximate factors — each drawn from the exponential family — so that their product closely matches the true intractable posterior, achieving higher accuracy than mean-field variational inference on many probabilistic machine learning tasks. |
| ScholarGateชุดข้อมูล ↗ |
|
|