1. A video preprocessing system for removing effects of camera motion, comprising: a video source for providing incoming signals representing an image; and a motion compensator coupled to said video source receiving said incoming image for adjusting said incoming image to compensate for camera motion caused by environmental influence on the camera, said motion compensator comprising: a background frame buffer for storing an accumulated background image of said image; and a comparator coupled to said background frame buffer which compares values of a plurality of incoming pixels with values of selected background pixels, wherein each of said background pixels that are compared with said incoming pixels are displaced in position from said incoming pixels by one of a plurality of predetermined relative displacements, wherein said incoming image comprises a plurality of blocks each comprising a first number of pixels, and a different predetermined relative displacement from a first number of predetermined relative displacements is used for each pixel comprising one of said blocks wherein said comparison of said incoming pixels with said background pixels generates error values; an error matrix store for storing said error values; and determining means coupled to said error matrix store for determining a total displacement that can be made to said incoming image to compensate for said camera motion, wherein said determining means uses said error values in said error matrix store in determining said total displacement; wherein said incoming image is adjusted according to said total displacement to compensate for said camera motion.