1. A system for providing interactive computer-aided detection of abnormalities captured in medical images, said system comprising: an image processor for processing a medical image and extracting features within the medical image relevant to diagnosing the abnormalities, the extracted features satisfying descriptions of a set of pre-defined features; a decision engine for generating a computed diagnosis from the extracted features; and an annotation and modification tool for a user to identify a set of features within the medical image aided with the extracted features and to establish a diagnosis based on the set of identified features and the computed diagnosis.