1. A method for analyzing an object being tracked in a sequence of video frames, comprising: receiving a representation of the tracked object, as depicted by a current video frame, of the sequence of video frames; evaluating the representation of the tracked object using at least a first classifier and a second classifier, wherein the first classifier is configured to determine a first classification score indicating whether the tracked object depicts an instance of a first classification type, and wherein the second classifier is configured to determine a second classification score indicating whether the tracked object depicts an instance of a second classification type; determining a final classification value for the tracked object, based on the first and second classification scores; and passing the final classification value for the tracked objects to a machine learning engine configured to identify patterns of behavior engaged in by the tracked object, based at least in part on the final classification value.