1. An image encoder, comprising: a dividing unit to divide a macro block into a plurality of sub-blocks; a unidirectional application determining unit to determine whether an identical prediction mode is applied to each of the plurality of sub-blocks; and a prediction mode determining unit to determine a prediction mode with respect to each of the plurality of sub-blocks based on a determined result of the unidirectional application determining unit.