where \({\bf g}^l\)  is the sentence representation of the \(l\) -th layer \({\bf H}^l\) , which is calculated by Equation REF .
The motivation for this mechanism is that recent studies reveal that different encoder layers capture linguistic properties of the input sentence at different levels [1]}, and aggregating layers to better fuse semantic information has proven to be of profound value [2]}, [3]}, [4]}, [5]}. In this work, we propose to fuse the global information across layers.
<FIGURE>