1. An apparatus for lesion detection, the apparatus comprising: a lesion candidate detector configured to detect lesion candidates from a medical image; an adjacent object detector configured to detect anatomical objects from the medical image; a lesion candidate verifier configured to verify each of the lesion candidates based on anatomical context information comprising information regarding a location relationship between each of the lesion candidates and the anatomical objects; and a candidate remover configured to remove one or more false positive lesion candidate from among the detected lesion candidates based on a verification result of the lesion candidate verifier.