1. A intermediate image synthesizing method using a mesh based on a multi-view square camera structure, the method comprising steps of: matching distance wherein an overlapping area where an intermediate image to be synthesized and three reference images adjacent to the intermediate image overlap is identified; mesh-mapping wherein a vertex is extracted based on a outline of an object by considering a position characteristic of a difference obtained according to the overlapping area to construct the mesh; block-matching based on an epipolar line to obtain a disparity vector with respect to the vertex wherein a block matching is by carried out by a unit of a predetermined block designated on the epipolar line having the extracted vertex as a center; image-compensating for compensating an image of the overlapping area wherein an image conversion and an image deformation is performed based on the reference images according to a result of the block matching; and image-synthesizing for synthesizing the intermediate image by integrating the compensated image of the overlapping area.