1. An apparatus for tokenizing text, the apparatus comprising: a featurizer, said featurizer structured and arranged to parse text into a set of tokens and features; a classifier connected to said featurizer and structured and arranged to read the set of tokens, said classifier including at least one predetermined classification model for assigning categories to each one of the set of tokens; and a finalizer, said finalizer connected to said classifier and structured and arranged to use the set of tokens and categories to produce a final output of text.