In addition to shared embedding described in<cite> Vaswani et al. (2017)</cite> , we also utilize weight sharing across the embedding and output layers in a manner similar to Junczys-Dowmunt and Grundkiewicz (2018).