1. A method for representing similar text documents and similar segments of text documents as standardized text templates and deviations from standardized text templates, the method comprising: partitioning documents into segments; generating standardized text segment templates from segments of documents; determining the deviations of individual text segments from the standardized text segment templates so generated; representing the individual text segments as the combination of standardized text segment templates and deviations from standardized text segment templates; generating standardized text templates representing text documents as sequences of standardized text segment templates; determining the deviations of the individual text documents from the standardized text templates so generated; and representing the individual text documents as a combination of the standardized text templates and the deviations from the standardized text templates.