1. A method for performing integrated feature selection and extraction for classifying an image, the method comprising: selecting a classifying feature from a feature pool for the image; generating one or more higher-order features comprising: pairing the selected classifying feature with one or more respective previously selected classifying features; and placing the one or more higher-order features into the feature pool.