  In this paper we formalize the notions of information elements andinformation lattices, first proposed by Shannon. Exploiting this formalization,we identify a comprehensive parallelism between information lattices andsubgroup lattices. Qualitatively, we demonstrate isomorphisms betweeninformation lattices and subgroup lattices. Quantitatively, we establish adecisive approximation relation between the entropy structures of informationlattices and the log-index structures of the corresponding subgroup lattices.This approximation extends the approximation for joint entropies carried outpreviously by Chan and Yeung. As a consequence of our approximation result, weshow that any continuous law holds in general for the entropies of informationelements if and only if the same law holds in general for the log-indices ofsubgroups. As an application, by constructing subgroup counterexamples we findsurprisingly that common information, unlike joint information, obeys neitherthe submodularity nor the supermodularity law. We emphasize that the notion ofinformation elements is conceptually significant--formalizing it helps toreveal the deep connection between information theory and group theory. Theparallelism established in this paper admits an appealing group-actionexplanation and provides useful insights into the intrinsic structure amonginformation elements from a group-theoretic perspective.
Exploiting this formalization, we identify a comprehensive parallelism between information lattices and subgroup lattices. Qualitatively, we demonstrate isomorphisms between information lattices and subgroup lattices. Quantitatively, we establish a decisive approximation relation between the entropy structures of information lattices and the log-index structures of the corresponding subgroup lattices.