Unless noted otherwise, we use a \(\beta=0.1\), batch size of 64 and the RMSprop optimizer with a learning rate of 1e-6 by default. We linearly warmup the learning rate from 0 to 1e-6 over 150 steps. For TL;DR summarization, we use \(\beta=0.5\), while rest of the parameters remain the same.