The datasets used in our experiments are listed in Table REF  with summary statistics. We further pre-process and tokenize the datasets using the standard procedure and follow [1]}. We note that IMDB [2]}, Diabetes(MIMIC) [3]}, Anemia(MIMIC) [3]}, AgNews [5]}, ADR Tweets [6]} and SST [7]} are datasets for the binary classification setup. SNLI [8]} is a dataset for the multiclass classification setup. All of the datasets are in English, however we expect the behavior to persist regardless of the language.
