1. An apparatus for robust fine granularity scalability video encoding, comprising: a base layer encoder receiving an original video image and a base layer reference image for generating a base layer bit stream; and an enhancement layer encoder receiving said original video image, a motion estimation vector, a base layer reconstructed image, and coded base layer discrete cosine transform coefficients for generating an enhancement layer bit stream; wherein said base layer reference image is generated from said enhancement layer encoder or said base layer encoder, and said base layer reconstrcuted image is generated from said base layer encoder.