1. A method for removing a shadow from an aerial or satellite photograph, the method being performed by a shadow removal apparatus, which includes a photographing information collecting unit, a building information extracting unit, a shadow area estimating unit, an image restoration unit, and an image composition unit, the method comprising: collecting aerial or satellite photographs, by the photographing information collecting unit; extracting buildings at each of the collected aerial or satellite photographs, by the building information extracting unit; estimating a shadow area cast by the extracted buildings, by the shadow area estimating unit; restoring a shaded image in the aerial or satellite photograph, which corresponds to the estimated shadow area, by the image restoration unit; and composing the restored image and a residual image of the aerial or satellite photograph except the shadow area, by the image composition unit.