docs/pretrain.md

Pretrain

Data

AMASS

1. Please download data from the official website (SMPL+H).
2. We provide the preprocessing scripts as follows. Minor modifications might be necessary.
   • tools/compress_amass.py: downsample the frame rate
   • tools/preprocess_amass.py: render the mocap data and extract the 3D keypoints
   • tools/convert_amass.py: slice them to motion clips

Human 3.6M

Please refer to pose3d.md.

InstaVariety

1. Please download data from human_dynamics to data/motion2d.
2. Use tools/convert_insta.py to preprocess the 2D keypoints (need to specify name_action ).

PoseTrack

Please download PoseTrack18 from MMPose and unzip to data/motion2d.

The processed directory tree should look like this:

.
└── data/
    ├── motion3d/
    │   └── MB3D_f243s81/
    │       ├── AMASS
    │       └── H36M-SH
    ├── motion2d/
    │   ├── InstaVariety/
    │   │   ├── motion_all.npy
    │   │   └── id_all.npy
    │   └── posetrack18_annotations/
    │       ├── train
    │       └── ...
    └── ...

Train

python train.py \
--config configs/pretrain/MB_pretrain.yaml \
-c checkpoint/pretrain/MB_pretrain