Awesome

SkelNet_motion_prediction

This repository contains our work in AAAI2019. We proposed novel architectures for the Human motion prediction from motion capture data. First, Skeleton Network (SkelNet) learns different local moving pattern from body components, and employs such locality for predicting the future human motion. Then, we built up Skeleton Temporal Network (Skel-TNet) that consists SkelNet and RNN, which have advantages in learning spatial and temporal dependencies for predicting human motion, respectively. Our methods achieve state-of-the-art results on the Human3.6M dataset and the CMU motion capture dataset. You can also check our paper for a details.

Xiao Guo, Jongmoo Choi. Human Motion Prediction via Learning Local Structure Representations and Temporal Dependencies. In AAAI2019. Paper.

Dependencies

Tensorflow-gpu 1.3.0
Python 3.6 or 3.5

Files and commands:

User can decide long-term or short-term prediction based on input argument. Specifically, three components in proposed Skel-TNet should be optimized independently.

Supposed target action is walking, required commands are shown below:

SkelNet:

python3 SkelNet/src/long_pre_extraction.py --action walking

C-RNN:

python3 C-RNN/src/long_pre_extraction.py --action walking

Merging_network:

python3 Merging_network/src/long_pre_extraction.py --action walking --iterations 1500

Data contains preprocessing the Human3.6M dataset
spatial_model_walking and temporal_model_walking represent pretained models sending to the Merging Network.

Acknowledgement:

if you find our work useful in your research, please consider to cite our work:

@inproceedings{guo2019human,
    title={Human motion prediction via learning local structure representations and temporal dependencies},
    author={Guo, Xiao and Choi, Jongmoo},
    booktitle={AAAI},
    year={2019}
}