Since the main experiments are conducted in 16-bit precision, we test training in full precision (32-bit) to see if the additional bits improve performance. Training on full precision inputs gains about 1 BLEU point, indicating that we are not discarding significant information by storing probability vectors at half precision.