1. A computer-implemented method of recognizing gestures, the method comprising: receiving a plurality of color images of a scene; processing images of the plurality of color images, wherein the processing of the images of the plurality of color images comprises: grouping pixels of individual images of the images being processed into a plurality of clusters, each cluster grouped at least based on similarity of color, wherein similarity of color is evaluated by comparing a color of pixels with a color of other pixels within an image, wherein the grouping the pixels is performed without prior identification of an object as a gesture capable object; tracking whether a first cluster of the plurality of clusters in the plurality of color images moves, the first cluster corresponding to a gesture capable object within the scene; tracking whether a second cluster of the plurality of clusters in the plurality of color images moves, the second cluster not corresponding to a gesture capable object within the scene; and determining, based on tracking the first cluster and the second cluster, that the first cluster is performing a gesture, wherein the determining is performed without prior identification of an object performing the gesture as a gesture capable object.