Variational Inference

Variational inference (VI) is a technique to approximate a particular probability distribution. VI accomplishes this by finding a probability distribution q from a family of distributions Q that is as close to the target distribution p as possible.

Kullber-Leiback Divergence (KL-Divergence) is used for this task.