The \(\Vert \)  indicates the boundary between the encoder and the classifier. Reporting 66 tables for five different configurations, when only one was needed as shown in [1]}, appears useless and may only confuse and exhaust the reader without adding anything to the discussion. However, what is irremediably flawed is the line of reasoning in their conclusions, as we will show in the remainder of this section. Li et al. [2]}, indeed, conclude by stating that all the tested LSTM configurations “... exhibit the same broad pattern of results”.
Figure REF  shows the encodings as computed (and reported) in [2]}, clearly indicating that the encodings learned by LSTM4 (which is the exact configuration used in [1]}) does not show the “problematic” one-hot pattern as the other four configurations.
<FIGURE>