We trained our model for ~14K update steps with the Adam optimizer (Kingma and Ba, 2014), warm up learning rates<cite> (Vaswani et al., 2017</cite> ) with a size of 12,000, and batch size of approximately 17,000 tokens for each triplet.