Chest X-ray (CXR) is one of the most commonly prescribed medical imaging procedures, often with over 2-10x more scans than other imaging modalities such as MRI, CT scan, and PET scans. These voluminous CXR scans place significant workloads on radiologists and medical practitioners. Organ segmentation is a crucial step to obtain effective computer-aided detection on CXR. In this work, we propose Structure Correcting Adversarial Network (SCAN) to segment lung fields and the heart in CXR images. SCAN incorporates a critic network to impose on the convolutional segmentation network the structural regularities emerging from human physiology. During training, the critic network learns to discriminate between the ground truth organ annotations from the masks synthesized by the segmentation network. Through this adversarial process the critic network learns the higher order structures and guides the segmentation model to achieve realistic segmentation outcomes. Extensive experiments show that our method produces highly accurate and natural segmentation. Using only very limited training data available, our model reaches human-level performance without relying on any existing trained model or dataset. Our method also generalizes well to CXR images from a different patient population and disease profiles, surpassing the current state-of-the-art.
Lung Field Segmentation. Existing work on lung field segmentation broadly falls into three categories @cite_35 . (1) Rule-based systems apply pre-defined set of thresholding and morphological operations that are derived from heuristics @cite_20 . (2) Pixel classification methods classify the pixels as inside or outside of the lung fields based on pixel intensities @cite_4 @cite_17 @cite_33 @cite_11 . (3) More recent methods are based on deformable models such as Active Shape Model (ASM) and Active Appearance Model @cite_6 @cite_22 @cite_30 @cite_2 @cite_18 @cite_19 @cite_14 @cite_16 . Their performance can be highly variable due to the tuning parameters and whether shape model is initialized to the actual boundaries. Also, the high contrast between rib cage and lung fields can cause the model to be trapped in local minima. Our approach uses convolutional networks to perform end-to-end training from images to pixel masks without using ad hoc features. The proposed adversarial training further incorporates prior structural knowledge in a unified framework.
@cite_30 @cite_35 @cite_18 @cite_11 @cite_4 @cite_33 @cite_22 @cite_14 @cite_6 @cite_19 @cite_2 @cite_16 @cite_20 @cite_17
1975020933 2131706783 2141453390 2431732335
In this paper, we propose a new classification method for five categories of lung tissues in high-resolution computed tomography (HRCT) images, with feature-based image patch approximation. We design two new feature descriptors for higher feature descriptiveness, namely the rotation-invariant Gabor-local binary patterns (RGLBP) texture descriptor and multi-coordinate histogram of oriented gradients (MCHOG) gradient descriptor. Together with intensity features, each image patch is then labeled based on its feature approximation from reference image patches. And a new patch-adaptive sparse approximation (PASA) method is designed with the following main components: minimum discrepancy criteria for sparse-based classification, patch-specific adaptation for discriminative approximation, and feature-space weighting for distance computation. The patch-wise labelings are then accumulated as probabilistic estimations for region-level classification. The proposed method is evaluated on a publicly available ILD database, showing encouraging performance improvements over the state-of-the-arts. The task of segmenting the posterior ribs within the lung fields of standard posteroanterior chest radiographs is considered. To this end, an iterative, pixel-based, supervised, statistical classification method is used, which is called iterated contextual pixel classification (ICPC). Starting from an initial rib segmentation obtained from pixel classification, ICPC updates it by reclassifying every pixel, based on the original features and, additionally, class label information of pixels in the neighborhood of the pixel to be reclassified. The method is evaluated on 30 radiographs taken from the JSRT (Japanese Society of Radiological Technology) database. All posterior ribs within the lung fields in these images have been traced manually by two observers. The first observer's segmentations are set as the gold standard; ICPC is trained using these segmentations. In a sixfold cross-validation experiment, ICPC achieves a classification accuracy of 0.86 spl plusmn 0.06, as compared to 0.94 spl plusmn 0.02 for the second human observer. This paper presents a new deformable model using both population-based and patient-specific shape statistics to segment lung fields from serial chest radiographs. There are two novelties in the proposed deformable model. First, a modified scale invariant feature transform (SIFT) local descriptor, which is more distinctive than the general intensity and gradient features, is used to characterize the image features in the vicinity of each pixel. Second, the deformable contour is constrained by both population-based and patient-specific shape statistics, and it yields more robust and accurate segmentation of lung fields for serial chest radiographs. In particular, for segmenting the initial time-point images, the population-based shape statistics is used to constrain the deformable contour; as more subsequent images of the same patient are acquired, the patient-specific shape statistics online collected from the previous segmentation results gradually takes more roles. Thus, this patient-specific shape statistics is updated each time when a new segmentation result is obtained, and it is further used to refine the segmentation results of all the available time-point images. Experimental results show that the proposed method is more robust and accurate than other active shape models in segmenting the lung fields from serial chest radiographs. We work towards efficient methods of categorizing visual content in medical images as a precursor step to segmentation and anatomy recognition. In this paper, we address the problem of automatic detection of level position for a given cardiac CT slice. Specifically, we divide the body area depicted in chest CT into nine semantic categories each representing an area most relevant to the study of a disease and or key anatomic cardiovascular feature. Using a set of handcrafted image features together with features derived form a deep convolutional neural network (CNN), we build a classification scheme to map a given CT slice to the relevant level. Each feature group is used to train a separate support vector machine classifier. The resulting labels are then combined in a linear model, also learned from training data. We report margin zero and margin one accuracy of 91.7 and 98.8 and show that this hybrid approach is a very effective methodology for assigning a given CT image to a relatively narrow anatomic window.