Human3.6M Dataset. The Human3.6M dataset [1]} is currently the largest publicly available dataset for human 3D pose estimation. Two experimental protocols are widely used for training and testing. Protocol 1 uses S1, S5, S6, S7, S8, S9 in training and S11 in testing, while Protocol 2 uses S1, S5, S6, S7, S8 in training and S9, S11 in testing. Same as the configuration of MuCo-3DHP dataset, additional 2D human keypoint dataset COCO is used to train together with the Human3.6M dataset. Accordingly, we set the loss value of depth becomes zero when COCO dataset was imported. Following previous work [2]}, we use Protocol 2 and sample every 5th and 64th frames in videos for training and testing respectively.
