1. A system for providing interactive computer-aided detection of abnormalities captured in medical images, said system comprising: an image processor, said image processor generating a boundary outline delineating a region within a medical image corresponding to a suspect lesion; a user interface operative connected to said image processor, said user interface providing said boundary outline for user selection and modification and said image processor processing the medical image and extracting features relevant to diagnosing the abnormalities from the medical image, the extracted features satisfying descriptions of a set of pre-defined features and being associated with said region delineated by said selected boundary outline; a decision engine for computing a computed diagnosis from the extracted features; and an annotation and modification tool for a user to identify and modify a set of features within the medical image aided with the extracted features, said annotation and modification tool being operatively connected to said decision engine and providing the set of user identified features to the decision engine, and the decision engine being configured to re-compute the computed diagnosis from the set of user identified features upon receiving said set of user identified features.