1. Multi-view multi-spectral detection and tracking system comprising: at least one imager, at least one of said at least one imager being a multi-spectral imager, said multi-spectral imager acquiring images in a plurality of spectral bands, at least one of said spectral bands extending beyond the visible spectral band, said at least one imager acquiring at least two detection sequences, and at least two tracking sequences, each sequence including at least one image, each acquired image being associated with respective image attributes; an object detector, coupled with said at least one imager, detecting objects of interest in said scene, according to said detection sequence of images and said respective image attributes; an object tracker coupled with said object detector, said object tracker tracking said objects of interest in said scene and determining dynamic spatial characteristics and dynamic spectral characteristics for each object of interest according to said tracking sequences of images and said respective image attributes, said image attributes including at least the spectrum of the image; an object classifier, coupled with said object tracker, classifying said objects of interest according to said dynamic spatial characteristics and said dynamic spectral characteristics; and wherein said object detector comprises a pre-processor couples with a database, said pre-processor at least including; an image registration processor, registering the images acquired from different positions in said scene; an image segmentation processor, segmenting the acquired images into segments, each segment is associated with at least a portion of an object in said scene; and a segments of interest identifier, couples with said image registration processor and with said image segmentation processor, said segments of interest identifier identifies segments of interest in the scene according to the segmented images and a background model of said scene.