@inproceedings{
decruyenaere2023synthetic,
title={Synthetic Data: Can We Trust Statistical Estimators?},
author={Alexander Decruyenaere and Paloma Rabaey and Christiaan Polet and Johan Decruyenaere and Stijn Vansteelandt and Thomas Demeester and Heidelinde Dehaene},
booktitle={Deep Generative Models for Health Workshop NeurIPS 2023},
year={2023},
url={https://openreview.net/forum?id=9cHt8szDMj}
}
The increasing interest in data sharing makes synthetic data appealing. However, the analysis of synthetic data raises a unique set of methodological challenges. In this work, we highlight the importance of inferential utility and provide empirical evidence against naive inference from synthetic data (that handles these as if they were really observed). We argue that the rate of false-positive findings (type 1 error) will be unacceptably high, even when the estimates are unbiased. One of the reasons is the underestimation of the true standard error, which may even progressively increase with larger sample sizes due to slower convergence. This is especially problematic for deep generative models. Before publishing synthetic data, it is essential to develop statistical inference tools for such data.
Synthetic Data: Can We Trust Statistical Estimators?
Alexander Decruyenaere Heidelinde Dehaene Paloma Rabaey Christiaan Polet Johan Decruyenaere Stijn Vansteelandt Thomas Demeester