1. A method for processing video data, comprising: detecting human faces in a plurality of video frames in said video data using a processor; for at least one detected human face, identifying a face-specific set of video frames using said processor irrespective of whether said detected human face is present in said face-specific set of video frames in a substantially temporally continuous manner; grouping all video frames in said face-specific set of video frames into a plurality of face tracks using said processor, wherein each face track contains corresponding one or more video frames having at least a substantial temporal continuity therebetween; segmenting pixels associated with said at least one detected human face in each video frame in said face-specific set of video frames using said processor so as to extract color signature of said at least one detected human face in each said face-specific video frame; using said processor, merging two or more of said plurality of face tracks that are disjoint in time based on a comparison of the color signatures of said at least one detected human face appearing in video frames constituting said two or more of said plurality of face tracks; and enabling a user to view on an electronic display for said processor face-specific video segments of said at least one detected human face in said video data based on said merging of temporally disjoint face tracks.