Hierarchical Variational Inference

Hierarchical variational inference (HVI) extends standard variational inference by placing a richer, hierarchical structure on the variational family itself. Instead of using a simple mean-field approximation, HVI introduces auxiliary latent variables that capture dependencies among the main latent variables, yielding tighter evidence lower bounds and more accurate posterior approximations for complex Bayesian models.