We use a linear encoder-decoder with three layers in the encoder and decoder, tanh activation functions, and latent size 2. We choose this architecture as Laplace Redux [1]} supports various hessian approximations for this simple network. We use Laplace Redux for all post-hoc experiments except for the approximate diagonal hessian.
