
where \({\small \mbox{KL}(q(z)||p_{{\eta }}(z))=\mathbb {E}_{q(z)}[\log {q(z)}-\log {p(z)}]}\)  is a Kullback–Leibler (KL) divergence based regularization term. Whether the KL term is explicitly imposed is a key distinction between regular dropout [1]}, [2]} and their Bayesian generalizations [3]}, [4]}, [5]}, [6]}, [7]}.
