Active Bayesian Causal Inference
Causal discovery and causal reasoning are classically treated as separate and
consecutive tasks: one first infers the causal graph, and then uses it to
estimate causal effects of interventions. However, such a two-stage approach is
uneconomical, especially in terms of actively collected interventional data,
since the causal query of interest may not require a fully-specified causal
model. From a Bayesian perspective, it is also unnatural, since a causal query
(e.g., the causal graph or some causal effect) can be viewed as a latent
quantity subject to posterior inference -- other unobserved quantities that are
not of direct interest (e.g., the full causal model) ought to be marginalized
out in this process and contribute to our epistemic uncertainty. In this work,
we propose Active Bayesian Causal Inference (ABCI), a fully-Bayesian active
learning framework for integrated causal discovery and reasoning, which jointly
infers a posterior over causal models and queries of interest. In our approach
to ABCI, we focus on the class of causally-sufficient, nonlinear additive noise
models, which we model using Gaussian processes. We sequentially design
experiments that are maximally informative about our target causal query,
collect the corresponding interventional data, and update our beliefs to choose
the next experiment. Through simulations, we demonstrate that our approach is
more data-efficient than several baselines that only focus on learning the full
causal graph. This allows us to accurately learn downstream causal queries from
fewer samples while providing well-calibrated uncertainty estimates for the
quantities of interest.