1. An image signal processing (ISP) apparatus which processes an image signal output from an image sensor, comprising: a storage unit storing 4-directional image gradient information which defines a difference in color brightness between adjacent pixels on the basis of edge direction information obtained from a bayer image output from the image sensor; an image processor simultaneously processing in an integrated manner image denoising and interpolation using the 4-directional image gradient information stored in the storage unit.