GaitForeMer: Self-Supervised Pre-Training of Transformers via Human Motion Forecasting for Few-Shot Gait Impairment Severity Estimation
Parkinson's disease (PD) is a neurological disorder that has a variety of
observable motor-related symptoms such as slow movement, tremor, muscular
rigidity, and impaired posture. PD is typically diagnosed by evaluating the
severity of motor impairments according to scoring systems such as the Movement
Disorder Society Unified Parkinson's Disease Rating Scale (MDS-UPDRS).
Automated severity prediction using video recordings of individuals provides a
promising route for non-intrusive monitoring of motor impairments. However, the
limited size of PD gait data hinders model ability and clinical potential.
Because of this clinical data scarcity and inspired by the recent advances in
self-supervised large-scale language models like GPT-3, we use human motion
forecasting as an effective self-supervised pre-training task for the
estimation of motor impairment severity. We introduce GaitForeMer, Gait
Forecasting and impairment estimation transforMer, which is first pre-trained
on public datasets to forecast gait movements and then applied to clinical data
to predict MDS-UPDRS gait impairment severity. Our method outperforms previous
approaches that rely solely on clinical data by a large margin, achieving an F1
score of 0.76, precision of 0.79, and recall of 0.75. Using GaitForeMer, we
show how public human movement data repositories can assist clinical use cases
through learning universal motion representations. The code is available at
https://github.com/markendo/GaitForeMer .