Convex space learning improves deep-generative oversampling for tabular imbalanced classification on smaller datasets
Data is commonly stored in tabular format. Several fields of research (e.g.,
biomedical, fault/fraud detection), are prone to small imbalanced tabular data.
Supervised Machine Learning on such data is often difficult due to class
imbalance, adding further to the challenge. Synthetic data generation i.e.
oversampling is a common remedy used to improve classifier performance.
State-of-the-art linear interpolation approaches, such as LoRAS and ProWRAS can
be used to generate synthetic samples from the convex space of the minority
class to improve classifier performance in such cases. Generative Adversarial
Networks (GANs) are common deep learning approaches for synthetic sample
generation. Although GANs are widely used for synthetic image generation, their
scope on tabular data in the context of imbalanced classification is not
adequately explored. In this article, we show that existing deep generative
models perform poorly compared to linear interpolation approaches generating
synthetic samples from the convex space of the minority class, for imbalanced
classification problems on tabular datasets of small size. We propose a deep
generative model, ConvGeN combining the idea of convex space learning and deep
generative models. ConVGeN learns the coefficients for the convex combinations
of the minority class samples, such that the synthetic data is distinct enough
from the majority class. We demonstrate that our proposed model ConvGeN
improves imbalanced classification on such small datasets, as compared to
existing deep generative models while being at par with the existing linear
interpolation approaches. Moreover, we discuss how our model can be used for
synthetic tabular data generation in general, even outside the scope of data
imbalance, and thus, improves the overall applicability of convex space
learning.