Papers Explained 36: MobileBERT
MobileBERT is as deep as BERTLARGE, but each building block is made much smaller, the hidden dimension of each building block is only 128. On the other hand, we introduce two linear transformations for each building block to adjust its input and output dimensions to 512. We refer to such…
Papers Explained 36: MobileBERT MobileBERT is as deep as BERTLARGE, but each building block is made much smaller, the hidden dimension of each building block is only 128. On the other hand, we introduce two linear transformations for each building block to adjust its input and output dimensions to 512. We refer to such… nlp
Papers Explained 36 MobileBERT MobileBERT deep BERTLARGE building block made much smaller hidden dimension building block 128 hand introduce two linear transformation building block adjust input output dimension 512 refer such… nlp