1. A method for video analytics object detection optimization, the method comprising: acquiring video image data over time from a plurality of synchronized cameras having overlapping views of a plurality of objects moving past the cameras and through a scene image in a linear array and with a determined speed; a processing unit generating at least one object detection within a plurality of frames of the camera video stream data, wherein each of the object detections are associated with a confidence score; and the processing unit modifying each of the confidence scores of the object detection decisions as a function of contexts comprising: a cross-frame constraint defined by other confidence scores of other object detection decisions from the video data that are acquired by a same one of the cameras at different times from a time of the object detection decision; a cross-view constraint defined by other confidence scores of other object detections in the video data from another different one of the cameras that has an overlapping field-of-view with the same one camera and that are also acquired at the different times; and a cross-object constraint defined by a sequential context of the linear array of the objects determined as a function of spatial attributes of the objects relative to the determined speed of the movement of the cameras relative to the objects.