We develop a worst-case analysis of aggregation of classifier ensembles for binary classification. The task of predicting to minimize error is formulated as a game played over a given set of unlabeled data (a transductive setting), where prior label information is encoded as constraints on the game. The minimax solution of this game identifies cases where a weighted combination of the classifiers can perform significantly better than any single classifier.
Our emphasis on the benefit of considering global effects (our transductive setting) even when data are i.i.d. is in the spirit of the idea of shrinkage, well known in statistical literature since at least the James-Stein estimator ( @cite_8 ).
@cite_8
1991769471
A compact multipurpose motion picture film handling cassette useful during exposure, processing and projection operations. An exposure station is located adjacent a corner of the cassette. This arrangement permits the cassette to be mounted in the handle section of a uniquely compact camera and, then subsequently, in a uniquely compact processor-projector unit. The cassette may also include a normally inoperative film processing station. A resilient member of the cassette extends in spaced relationship to idlers intermediate of the exposure station and the cassette's takeup reel and the cassette includes means to receive a force applying member into operative relationship with this resilient member. This resilient member automatically snubs the adjacent idlers when mounted in the camera and is adapted to selectively snub these same idlers when the cassette is in the processor-projector unit.