1. A system for language identification, comprising: a feature set of a plurality of character strings of varying length with associated information; the associated information including one or more significance scores for a character string for one or more of a plurality of languages; means for detecting character strings from the feature set within a token from an input text.