1. A data analyzer for use with a pattern classifier to compress a set of indexed data, comprising a data removal module for identifying and removing portions of the set of indexed data having insufficient discriminatory power based on the ensemble statistics of the set of indexed data.