@inproceedings{
ma2024sleepmg,
title={Sleep{MG}: Multimodal Generalizable Sleep Staging with Inter-modal Balance of Classification and Domain Discrimination},
author={Shuo Ma and Yingwei Zhang and Zhang Qiqi and Yiqiang Chen and Wang Haoran and Ziyu Jia},
booktitle={ACM Multimedia 2024},
year={2024},
url={https://openreview.net/forum?id=845V78V2mW}
}
Sleep staging is crucial for sleep tracking and health assessment. Polysomnography (PSG), containing multiple modalities such as electroencephalography, electrooculography, electromyography, and electrocardiography, is the fundamental means of sleep staging. 
However, due to performance differences in both classification and domain discrimination across modalities in PSG, existing domain generalization methods face a dilemma of modal imbalance. To balance inter-modal differences and achieve highly accurate cross-domain sleep staging, we propose SleepMG, a Multimodal Generalizable Sleep staging method. SleepMG assesses the classification and domain discrimination performances of each modality and further defines the modal performance metrics by calculating the variance between the performance score and the average performance of each modality. Guided by these metrics, the gradients of the classifier and domain discriminator are adaptively adjusted, placing greater emphasis on poorly-balanced modalities while reducing emphasis on well-balanced modalities. Experimental results on public sleep staging datasets demonstrate that SleepMG outperforms state-of-the-art sleep staging methods, effectively balancing multiple modalities as evidenced by the visual experiment of modal imbalance degree. Our code will be released after formal publication.
SleepMG: Multimodal Generalizable Sleep Staging with Inter-modal Balance of Classification and Domain Discrimination
Shuo Ma Yingwei Zhang Zhang Qiqi Yiqiang Chen Wang Haoran Ziyu Jia