
Unsupervised IB theory seems like generalization of VAEs model, with an encoder to learn representation and a decoder to reconstruct. \(\beta \) -VAE [1]} is actually the upper bound of it:
\(\mathcal {L}_{\beta - VAE}=&\mathbb {E}_{p(x)}[D_{KL}(q_{\phi }(z|x)\Vert p(z))\nonumber \\&-\beta \mathbb {E}_{q_{\phi }(z|x)}[\log (p_{\theta }(x|z))]]\) 
