1. A system for modeling illumination levels within an image sequence, comprising: receiving an input image sequence comprising two or more sequential image frames of a scene; probabilistically decomposing the input image sequence into a generative model, said generative model including sets of model parameters that represent at least one probabilistic object learned for each image frame; wherein the generative model parameters for each object includes a probabilistic object appearance model; constructing a probabilistic uniform illumination model for each object from one or more of the image frames having a desired illumination level for the corresponding objects; applying corresponding uniform illumination models to corresponding object appearance models to construct corresponding uniformly illuminated object appearance models for the generative model; and constructing a composite output image sequence from the generative model by using one or more of the uniformly illuminated object appearance models to create each frame of the composite output image sequence.