Although KD has become a field itself in the machine learning community, many approaches are still performed under a single teacher-student relationship, with a sharing task [1]}. Contrary to these constraints, our method can process multiple and heterogeneous teachers, condensing their knowledge into a single student model covering all tasks.
