1. An ultrasound image processing apparatus comprising: an image storage unit which stores ultrasound image data of a plurality of time phases; an image processor which searches image data of a search time phase for a movement point corresponding to a set point which is set in image data of a reference time phase, based on a correlation calculation between image data; and a diagnostic information generator which determines a primary direction of movement of the set point over a plurality of time phases based on the movement points searched over a plurality of time phases and obtains diagnostic information by evaluating the movement of the set point with the primary direction as a reference.