1. An ultra-high resolution video processing apparatus, the apparatus comprising: a video division unit to divide video data into at least two divided areas of video data based on a lengthwise direction; a video processing unit to process the divided video data, with the processing of the divided video data including processing pixel data of one divided area of the at least two divided areas by referring to select pixel data of an adjacent divided area, of the at least two divided areas, separate from a processing of pixel data, including the select pixel data, of the adjacent divided area; and a data storage unit comprising a plurality of frame buffers, wherein a first frame buffer among the plurality of frame buffers stores the pixel data of the one divided area together with the select pixel data of the adjacent divided area, and a second frame buffer among the plurality of frame buffers stores the pixel data of the adjacent divided area together with a portion of the pixel data from the one divided area.