1. An image signal processing system for an integrated sensor processor for capturing different portions of a single two-dimensional (2D) viewpoint, comprising: a focal plane array comprising an array of focal plane elements for generating continuous source image frames in real time of the single 2D viewpoint, said focal plane array divided logically causing each focal plane element in the array of focal plane elements to produce a block of pixels; an analog to digital converter (ADC) layer having an array of ADC elements, the array of ADC elements coupled in an element to element correspondence with the array of focal plane elements, for converting the source image frames into digital image data, wherein each of the ADC elements has an adjustable quantization step size for extending dynamic range of the sensor; a digital processor layer having an array of programmable digital processing elements for performing one or more substantially simultaneous programmable operations on the digital image data, wherein each digital processing element is assigned to one or more of the ADC elements, for integrating the digital image data to form enhanced output frames for each operation performed, wherein a sequence of the enhanced output frames has a lesser frame rate than the rate of generating the continuous source image frames, wherein each of the digital processing elements is dedicated to processing a block of pixels; and an interconnecting layer fabricated on the ADC layer for connecting each one of the ADC elements and the digital processing elements creating a physical element coupling substantially vertically to the focal plane and substantially parallel to one another.