1. A method for detecting salient objects in a sequence of video frames captured from a scene, each frame comprising a plurality of pixels grouped in a plurality of image blocks, said method comprising: (a) receiving pixel data and block feature data for each of the plurality of image blocks, the block feature data being at least one of Sobel edge and spatial high frequency response values for each pixel averaged over the block; (b) classifying the blocks as background or foreground in a current frame based on temporal profile of the block feature data; (c) identifying objects as a plurality of blobs, wherein each blob comprises a plurality of connected foreground blocks in the current frame; (d) grouping the objects as one of: (i) new, (ii) persistent and (iii) recurring based on the number of foreground blocks and tracking count of the blobs; (e) discarding the recurring objects.