@inproceedings{
baeg2023mixupbased,
title={Mixup-Based Knowledge Distillation with Causal Intervention for Multi-Task Speech Classification},
author={Kwangje Baeg and Hyeopwoo Lee and Yeomin Yoon and Jongmo Kim},
booktitle={Causal Representation Learning Workshop at NeurIPS 2023},
year={2023},
url={https://openreview.net/forum?id=VJjTq7QmRv}
}
Speech classification is an essential yet challenging subtask of multitask classification, which determines the gender and age groups of speakers. Existing methods face challenges while extracting the correct features indicative of some age groups that have several ambiguities of age perception in speech. Furthermore, the methods cannot fully understand the causal inferences between speech representation and multilabel spaces. In this study, the causes of ambiguous age group boundaries are attributed to the considerable variability in speech, even within the same age group. Additionally, features that indicate speech from the 20’s can be shared by some age groups in their 30’s. Therefore, a two-step approach to (1) mixup-based knowledge distillation to remove biased knowledge with causal intervention and (2) hierarchical multi-task learning with causal inference for the age group hierarchy to utilize the shared information of label dependencies is proposed. Empirical experiments on Korean open-set speech corpora demonstrate that the proposed methods yield a significant performance boost in multitask speech classification.
Mixup-Based Knowledge Distillation with Causal Intervention for Multi-Task Speech Classification
Kwangje Baeg Hyeopwoo Lee Yeomin Yoon Jongmo Kim