1. A method of displaying a three-dimensional (3D) image by using a display apparatus, the method comprising: generating an annotation related to a point of the 3D image and determining an image depth of the annotation; and displaying the annotation with the 3D image based on the image depth of the annotation, wherein the annotation comprises at least one point or area of the 3D image.