1. An intermediate image synthesizing method using a mesh based on a multi-view square camera structure, the method comprising: performing distance-matching in which an overlapping area where an intermediate image to be synthesized and three reference images adjacent to the intermediate image overlap is identified; performing mesh-mapping in which a vertex is extracted based on an outline of an object by considering a position characteristic of a difference obtained according to the overlapping area, and the mesh is constructed using the vertex; performing block-matching based on an epipolar line to obtain a disparity vector with respect to the vertex, the block-matching being carried out by a unit of a predetermined block designated on the epipolar line having the vertex as a center; performing image-compensating for compensating an image of the overlapping area in which an image conversion and an image deformation is performed based on the reference images according to a result of the block-matching; and performing image-synthesizing for synthesizing the intermediate image by integrating the compensated image of the overlapping area, wherein the performing mesh-mapping comprises: detecting the outline of the object in one of the reference images; extracting the vertex in the detected outline by scanning the one of the reference images adjacent to the outline by a window having a predetermined size so that a single vertex exists in the window; and forming the mesh with respect to the one of the reference images based on the extracted vertex.