Bits-Back scheme [1]} prevents algorithms from applying a large batch size [2]}.
Coder. Generative models only cooperate well with a dynamic entropy coder, which is far slower than static variants used in traditional algorithms. For most AI algorithms, the coder decodes only about 1 MB/s single-threaded.
Data transfer. Data transfer between CPU memory and GPU memory can also be a bottleneck for AI algorithms.

