Objective To quantify the accuracy and reproducibility of pathologists’ diagnoses of melanocytic skin lesions.,Design Observer accuracy and reproducibility study.,Setting 10 US states.,Participants Skin biopsy cases (n=240), grouped into sets of 36 or 48.,Pathologists from 10 US states were randomized to independently interpret the same set on two occasions (phases 1 and 2), at least eight months apart.,Main outcome measures Pathologists’ interpretations were condensed into five classes: I (eg, nevus or mild atypia); II (eg, moderate atypia); III (eg, severe atypia or melanoma in situ); IV (eg, pathologic stage T1a (pT1a) early invasive melanoma); and V (eg, ≥pT1b invasive melanoma).,Reproducibility was assessed by intraobserver and interobserver concordance rates, and accuracy by concordance with three reference diagnoses.,Results In phase 1, 187 pathologists completed 8976 independent case interpretations resulting in an average of 10 (SD 4) different diagnostic terms applied to each case.,Among pathologists interpreting the same cases in both phases, when pathologists diagnosed a case as class I or class V during phase 1, they gave the same diagnosis in phase 2 for the majority of cases (class I 76.7%; class V 82.6%).,However, the intraobserver reproducibility was lower for cases interpreted as class II (35.2%), class III (59.5%), and class IV (63.2%).,Average interobserver concordance rates were lower, but with similar trends.,Accuracy using a consensus diagnosis of experienced pathologists as reference varied by class: I, 92% (95% confidence interval 90% to 94%); II, 25% (22% to 28%); III, 40% (37% to 44%); IV, 43% (39% to 46%); and V, 72% (69% to 75%).,It is estimated that at a population level, 82.8% (81.0% to 84.5%) of melanocytic skin biopsy diagnoses would have their diagnosis verified if reviewed by a consensus reference panel of experienced pathologists, with 8.0% (6.2% to 9.9%) of cases overinterpreted by the initial pathologist and 9.2% (8.8% to 9.6%) underinterpreted.,Conclusion Diagnoses spanning moderately dysplastic nevi to early stage invasive melanoma were neither reproducible nor accurate in this large study of pathologists in the USA.,Efforts to improve clinical practice should include using a standardized classification system, acknowledging uncertainty in pathology reports, and developing tools such as molecular markers to support pathologists’ visual assessments.
Knowledge of tumor mutation status is becoming increasingly important for the treatment of cancer, as mutation-specific inhibitors are being developed for clinical use that target only sub-populations of patients with particular tumor genotypes.,Melanoma provides a recent example of this paradigm.,We report here development, validation, and implementation of an assay designed to simultaneously detect 43 common somatic point mutations in 6 genes (BRAF, NRAS, KIT, GNAQ, GNA11, and CTNNB1) potentially relevant to existing and emerging targeted therapies specifically in melanoma.,The test utilizes the SNaPshot method (multiplex PCR, multiplex primer extension, and capillary electrophoresis) and can be performed rapidly with high sensitivity (requiring 5-10% mutant allele frequency) and minimal amounts of DNA (10-20 nanograms).,The assay was validated using cell lines, fresh-frozen tissue, and formalin-fixed paraffin embedded tissue.,Clinical characteristics and the impact on clinical trial enrollment were then assessed for the first 150 melanoma patients whose tumors were genotyped in the Vanderbilt molecular diagnostics lab.,Directing this test to a single disease, 90 of 150 (60%) melanomas from sites throughout the body harbored a mutation tested, including 57, 23, 6, 3, and 2 mutations in BRAF, NRAS, GNAQ, KIT, and CTNNB1, respectively.,Among BRAF V600 mutations, 79%, 12%, 5%, and 4% were V600E, V600K, V600R, and V600M, respectively. 23 of 54 (43%) patients with mutation harboring metastatic disease were subsequently enrolled in genotype-driven trials.,We present development of a simple mutational profiling screen for clinically relevant mutations in melanoma.,Adoption of this genetically-informed approach to the treatment of melanoma has already had an impact on clinical trial enrollment and prioritization of therapy for patients with the disease.