Is More Data All You Need? A Causal Exploration
Curating a large scale medical imaging dataset for machine learning
applications is both time consuming and expensive. Balancing the workload
between model development, data collection and annotations is difficult for
machine learning practitioners, especially under time constraints. Causal
analysis is often used in medicine and economics to gain insights about the
effects of actions and policies. In this paper we explore the effect of dataset
interventions on the output of image classification models. Through a causal
approach we investigate the effects of the quantity and type of data we need to
incorporate in a dataset to achieve better performance for specific subtasks.
The main goal of this paper is to highlight the potential of causal analysis as
a tool for resource optimization for developing medical imaging ML
applications. We explore this concept with a synthetic dataset and an exemplary
use-case for Diabetic Retinopathy image analysis.