1. A method comprising: developing a replacement statistical model for a natural language understanding application by: developing a first part without human knowledge; developing a second part using the human knowledge and annotated words; and assigning weighted versions of the first part and the second part to the replacement statistical model; and during execution of the natural language understanding application, replacing a sequence of tags assigned to a sequence of words using the replacement statistical model.