The 5-gram language model is decoded with a beam search algorithm [1]} on a beam width of 128 to find the most appropriate sequence. A vocabulary size of top 500k words is used based on the sorted frequencies from the raw corpus. To increase the LM weightage, the LM weight is set to 2 and word score value to -1. The LM is also pruned in the 0|0|1 setting to reduce the LM size.
