2 There are two primary approaches to assessing topic coherence: (1) via word intrusion (Chang et (2) by directly measuring observed coherence (Newman et al., 2010;<cite> Lau et al., 2014)</cite> . As such, we use the second approach as the means for generating our gold standard, asking users to judge topic coherence directly over different topic cardinalities.