1. A computerized method for classifying images, comprising: receiving an image hierarchy; receiving a first image of interest wherein the image includes at least one feature; classifying the at least one feature of the image according to the image hierarchy; generating a dual variable for a Lagrange function associated with the classification of the at least one feature, where the dual variable controls a trade-off between an information gain and an accuracy; optimizing the classification of the at least one feature of the image using the dual variable controlling the trade-off between the information gain and the accuracy by generating a classifier that maximizes a relationship between the information gain and the accuracy with respect to the dual variable; and generating at least one optimized classification of the at least one feature of the image for the first image of interest.