**Diversity** captures the diversity of distributions of token types in the domain corpus. Diversity has been shown to be an effective feature in related research on curriculum learning in language modeling [28, 21]. We use part-of-speech (POS) tagging to get token types. Since entropy has been shown to be one of the best measures of diversity [3], we use **entropy** of POS tags [28] as our diversity measure.