1. A method implemented on a computing device for generating an ensemble classifier, comprising: using the computing device to perform the following: input a plurality of previously-trained component classifiers; defining a weight for each of the component classifiers, where the weight determines an amount of influence a component classifier associated with the weight has on a linear combination of the multiple component classifiers; defining the ensemble classifier as a weighted combination of the component classifiers; displaying to a user a real-time visual feedback user interface containing visual information that represents properties of the component classifiers and the ensemble classifier; displaying on the real-time visual feedback user interface an ensemble classifier view that depicts an ensemble classifier confusion matrix for the ensemble classifier, the ensemble classifier confusion matrix representing a class space of the ensemble classifier; allowing the user to divide the ensemble classifier confusion matrix into a plurality of sub-partitions; allowing the user to interactively adjust weights of component classifiers for each of the sub-partitions independent of other sub-partitions; and displaying an effect that defining different weights has on an overall accuracy of the ensemble classifier in real time on the real-time visual feedback user interface.